-- Logs begin at Fri 2022-09-23 14:32:29 UTC, end at Fri 2022-09-23 15:46:44 UTC. -- Sep 23 15:08:17.536696 dv-cinder-855013-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 23 15:08:17.546630 dv-cinder-855013-3-smb devstack@keystone.service[81633]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 23 15:08:17.548894 dv-cinder-855013-3-smb devstack@keystone.service[81633]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 23 15:08:17 2022] *** Sep 23 15:08:17.548894 dv-cinder-855013-3-smb devstack@keystone.service[81633]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 15:08:17.548894 dv-cinder-855013-3-smb devstack@keystone.service[81633]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 15:08:17.548894 dv-cinder-855013-3-smb devstack@keystone.service[81633]: nodename: dv-cinder-855013-3-smb Sep 23 15:08:17.548894 dv-cinder-855013-3-smb devstack@keystone.service[81633]: machine: x86_64 Sep 23 15:08:17.548894 dv-cinder-855013-3-smb devstack@keystone.service[81633]: clock source: unix Sep 23 15:08:17.548894 dv-cinder-855013-3-smb devstack@keystone.service[81633]: pcre jit disabled Sep 23 15:08:17.548894 dv-cinder-855013-3-smb devstack@keystone.service[81633]: detected number of CPU cores: 4 Sep 23 15:08:17.548894 dv-cinder-855013-3-smb devstack@keystone.service[81633]: current working directory: / Sep 23 15:08:17.548894 dv-cinder-855013-3-smb devstack@keystone.service[81633]: detected binary path: /usr/bin/uwsgi-core Sep 23 15:08:17.548894 dv-cinder-855013-3-smb devstack@keystone.service[81633]: your processes number limit is 47680 Sep 23 15:08:17.549576 dv-cinder-855013-3-smb devstack@keystone.service[81633]: your memory page size is 4096 bytes Sep 23 15:08:17.549576 dv-cinder-855013-3-smb devstack@keystone.service[81633]: detected max file descriptor number: 2048 Sep 23 15:08:17.549576 dv-cinder-855013-3-smb devstack@keystone.service[81633]: lock engine: pthread robust mutexes Sep 23 15:08:17.549576 dv-cinder-855013-3-smb devstack@keystone.service[81633]: thunder lock: enabled Sep 23 15:08:17.549576 dv-cinder-855013-3-smb devstack@keystone.service[81633]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 23 15:08:17.549576 dv-cinder-855013-3-smb devstack@keystone.service[81633]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 23 15:08:17.588889 dv-cinder-855013-3-smb devstack@keystone.service[81633]: Python main interpreter initialized at 0x55bb83d2b9c0 Sep 23 15:08:17.588889 dv-cinder-855013-3-smb devstack@keystone.service[81633]: python threads support enabled Sep 23 15:08:17.588889 dv-cinder-855013-3-smb devstack@keystone.service[81633]: your server socket listen backlog is limited to 100 connections Sep 23 15:08:17.588889 dv-cinder-855013-3-smb devstack@keystone.service[81633]: your mercy for graceful operations on workers is 90 seconds Sep 23 15:08:17.589254 dv-cinder-855013-3-smb devstack@keystone.service[81633]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 15:08:17.589336 dv-cinder-855013-3-smb devstack@keystone.service[81633]: *** Operational MODE: preforking *** Sep 23 15:08:17.589594 dv-cinder-855013-3-smb devstack@keystone.service[81633]: *** uWSGI is running in multiple interpreter mode *** Sep 23 15:08:17.589594 dv-cinder-855013-3-smb devstack@keystone.service[81633]: spawned uWSGI master process (pid: 81633) Sep 23 15:08:17.589819 dv-cinder-855013-3-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 23 15:08:17.590932 dv-cinder-855013-3-smb devstack@keystone.service[81633]: spawned uWSGI worker 1 (pid: 81642, cores: 1) Sep 23 15:08:17.590932 dv-cinder-855013-3-smb devstack@keystone.service[81633]: spawned uWSGI worker 2 (pid: 81643, cores: 1) Sep 23 15:08:17.590932 dv-cinder-855013-3-smb devstack@keystone.service[81633]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 15:08:21.932224 dv-cinder-855013-3-smb devstack@keystone.service[81642]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:08:21.932224 dv-cinder-855013-3-smb devstack@keystone.service[81642]: from cryptography.utils import int_from_bytes Sep 23 15:08:21.933045 dv-cinder-855013-3-smb devstack@keystone.service[81642]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:08:21.933045 dv-cinder-855013-3-smb devstack@keystone.service[81642]: from cryptography.utils import int_from_bytes Sep 23 15:08:21.933474 dv-cinder-855013-3-smb devstack@keystone.service[81643]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:08:21.933474 dv-cinder-855013-3-smb devstack@keystone.service[81643]: from cryptography.utils import int_from_bytes Sep 23 15:08:21.934598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 15:08:21.934598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: from cryptography.utils import int_from_bytes Sep 23 15:08:21.988533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 15:08:21.988729 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 15:08:21.988848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 15:08:21.988946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] command line args: [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 15:08:21.989027 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 15:08:21.989106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] command line args: [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 15:08:21.989181 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 15:08:21.989325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ================================================================================ {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 15:08:21.989453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 15:08:21.989539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ================================================================================ {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 15:08:21.989611 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] admin_token = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.989788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] admin_token = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.989907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] config_dir = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.990022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.990102 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] config_dir = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.990205 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] config_source = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.990294 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.990386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] debug = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.990475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] config_source = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.990568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] debug = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.990651 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.990836 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.991772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.991877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.991946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.992005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.992067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.992130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.992193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.992261 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.992320 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.992382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.992471 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] log_config_append = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.992569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_config_append = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.992654 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.992720 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.992783 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] log_dir = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.992847 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_dir = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.992905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] log_file = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.992966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_file = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.993034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.993093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.993154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.993216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.993274 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.993336 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.993403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.993464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.993574 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.993682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.993798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.993909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.993992 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.994064 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.994262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.994456 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.994789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.994974 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.995152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.995322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.995499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.995668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.995843 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.996022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.996818 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.996966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.997138 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.997315 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.997490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.997692 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.997868 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.82/identity {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.998000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.82/identity {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.998127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] publish_errors = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.998270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] publish_errors = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.998394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.998518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.998633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.998763 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.998880 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.999026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.999149 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.999282 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.999406 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.999522 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.999642 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] standard_threads = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.999800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] standard_threads = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:21.999951 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:22.000094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:22.000229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:22.000376 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:22.000494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:22.000609 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:22.000723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] use_journal = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:22.000913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] use_journal = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:22.001033 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] use_json = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:22.001155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] use_json = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:22.001271 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] use_stderr = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:22.001392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] use_stderr = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:22.001513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] use_syslog = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:22.001637 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] use_syslog = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:22.001767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:22.001896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 15:08:22.002014 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.002134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.002250 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.002376 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.002497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.002609 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.002712 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.002814 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.002916 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.003095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.003198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.003294 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.003390 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.003510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.003613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.003718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.003822 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.003919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.004015 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.004111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.004111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.004300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.004398 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.004494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.004595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.004697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.004697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.004884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.004982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.005094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.005191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.005287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.005383 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.005490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.005594 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.005703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.015404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.015518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.015600 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.015748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.015823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.015893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.015962 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.016031 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.016105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.016187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.016263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.016334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.016403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.016472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.016549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.016621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.016690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.016765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.016840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.016910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.016991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.017061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.017130 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.017199 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.017280 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.017380 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.017462 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.017533 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.017603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.017672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.017777 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.017851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.017932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.018005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.018074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.018149 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.018252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.018332 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.018411 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.018482 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.018551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.018626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.018693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.018752 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.018817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.018882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.018942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.019000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.019057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.019115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.019178 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.019239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.019304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.019364 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.019422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.019480 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.019537 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.019681 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.019784 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.019939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.020057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.020149 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.020215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.020292 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.020364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.020431 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.020501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.020566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.020635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.020708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.020782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.020848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.020922 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.020993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.021064 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.021142 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.021214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.021280 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.021357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.021428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.021550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.021634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.021706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.021830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.021909 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.022041 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.022119 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.022249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.022373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.022451 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.022662 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.022790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.022871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.023002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.023080 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.023196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.023196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.023383 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.023459 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.023603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.023685 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.023758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.023829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.023905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.023977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.024107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.024189 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.024314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.024389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.024466 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.024537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.024619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.024699 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.024781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.024854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.024971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.025053 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.025126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.025196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.025275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.025347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.025418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.025494 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.025566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.025698 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.025815 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.025890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.025960 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.026031 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.026107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.026179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.026257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.026329 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.026399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.026470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.026546 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.026617 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.026696 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.026769 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.026839 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.026912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.027031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.027118 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.027191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.027268 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.027340 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.027410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.027479 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.027557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.027682 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.027759 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.027829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.027899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.027969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.028048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.028120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.028196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.028268 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.028338 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.028408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.028486 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.028558 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.028628 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.028699 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.028774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.028846 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.028923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.028996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.029072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.029144 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.029215 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.029285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.029363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.029435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.029506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.029623 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.029699 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.029815 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.029899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.external = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.030013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.external = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.030102 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.030177 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.030250 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.030322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.030399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.030472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.030550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.password = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.030629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.password = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.030702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.token = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.030773 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.token = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.030844 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.030914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.030997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.031071 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.031141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.031213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.031213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.031342 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.031421 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.031494 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.031565 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.031635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.031706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.031777 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.031855 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.031928 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.031999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.032069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.032147 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.032219 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.032303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.032377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.032449 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.032519 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.032590 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.032661 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.032802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.032877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.032948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.033020 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.033091 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.033162 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.033230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.033303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.033374 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.033445 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.033523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.033603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.033684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.033804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.033880 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.033952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.034023 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.034094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.034195 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.034276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.034348 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.034419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.034499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.034572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.034651 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.034725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.034861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.034939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.035010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.035081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.035161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.035241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.035315 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.035386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.035457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.035536 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.035610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.035681 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.035751 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.035829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.035902 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.035980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.036053 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.036123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.036194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.036265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.036336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.036414 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.036487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.036558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.036629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.036700 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.036770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.036852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.036927 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.036998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.037069 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.037139 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.037210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.037290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.037363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.037434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.037555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.037632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.037703 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.037802 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.037878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.037949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.038020 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.038091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.038162 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.038242 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.038316 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.038387 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.038459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.038530 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.038601 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.038681 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.038754 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.038826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.038898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.039013 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.039097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.039512 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.039601 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.039751 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.039838 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.039987 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.040109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.040330 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.040464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.040542 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.040613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.040734 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.040816 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.040979 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.041059 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.041222 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.041302 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.041477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.041556 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.041713 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.041856 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.041990 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.042080 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.042233 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.042312 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.042472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.042557 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.042723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.042801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.042959 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.043545 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.043766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.043854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.044008 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.044087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.044243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.044330 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.044510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.044595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.044718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.044796 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.044974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.045067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.045178 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.045257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.045419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.045499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.045673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.045828 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.045951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.046067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.046188 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.046303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.046425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.046555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.046799 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.046885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.047036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.047115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.047274 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.047432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.047517 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.047578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.047741 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.047821 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.047977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.048067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.048223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.048302 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.048490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.048598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.048722 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.048810 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.048972 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.049058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.049222 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.049343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.049475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.049592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.049718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.049871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.049997 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.050141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.050249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.052323 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.052431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.052557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.052639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.052711 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.052783 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.052863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.052937 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.053009 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.053080 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.053151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.053222 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.053302 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.053381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.053454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.053526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.053596 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.053596 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.053751 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.053828 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.053901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.053901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.054024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.054095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.054244 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.054320 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.054391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.054391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.054526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.054526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.054663 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.054736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.054807 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.054807 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.054935 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.054935 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.055066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.055138 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.055209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.055280 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.055351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.055436 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.055527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.055596 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.055658 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.055658 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.055781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.055898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.055985 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.056139 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.056218 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.056375 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.056453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.056617 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.056705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.056864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.056942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.057113 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.057191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.057355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.057442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.057593 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.057671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.057872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.057955 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.058110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.058206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.058353 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.058432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.058589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.058668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.059380 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.059470 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.059619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] role.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.059698 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.059855 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] role.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.059933 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] role.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.060089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.060168 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] role.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.060327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.060406 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.060574 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.060689 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.060821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.060901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.061069 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.061147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.061317 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.061394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.061563 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.061643 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.061834 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.061917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.062083 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.062161 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.062317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.062399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.062554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.062633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.062799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.062877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.063048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.063128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.063295 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.063375 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.063541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.063697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.063947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.064080 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.064205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.064333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.064457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.064582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.064713 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.064838 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.064970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.065095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.065218 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.065341 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.065473 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.065607 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.065751 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.065876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.066005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.066143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.066276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.066404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.066531 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.066668 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.066794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.066925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.066925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.067168 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.067305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.067434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.067561 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.067697 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.067825 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.067952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.068081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.068207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.068356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.068490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.068616 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] token.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.068740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.068863 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.068987 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.069120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.069253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.069378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.069502 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.069625 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.069858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.069985 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.070124 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.070251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.070417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.070544 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.070670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.070795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.070938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.071065 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.071193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.071318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.071444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.071569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.071703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.071828 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.071954 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.072080 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.072207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.072333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.072467 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.072592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.072764 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.072901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.073029 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.073164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.073301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.073426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.connection = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.073555 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.073773 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.073899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.connection = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.074023 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.074147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.074271 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.074396 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.074577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.074729 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.074855 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.074980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.075103 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.075229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.075362 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.075488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.075613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.075738 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.075738 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.075971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.076103 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.076229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.076353 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.076488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.076613 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.076738 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.076869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.076995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.077119 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.077244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.077367 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.077492 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.077623 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.077795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.077921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.078049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.078204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.078336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.078336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 15:08:22.078588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 15:08:22.078588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 15:08:22.107396 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.107655 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.112806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.112903 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.112903 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.112903 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.116351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.117763 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.144773 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.144994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.146106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.146339 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.202493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.203629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.255848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.256085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.258698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.258975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.419812 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.420199 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.420283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.420366 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.420462 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.420544 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.420624 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.420704 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.420783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.420868 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.420947 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.444550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.444705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.444798 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.444882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.444971 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.445054 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.445197 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.445336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.445424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.445514 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.445596 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.445727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.445845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.445968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.458726 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.458849 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.471094 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.471237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.471311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.471455 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.471541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.471682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.471770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.471902 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.471991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.472119 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.472208 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.472333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.472422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.472548 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 15:08:22.489460 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.489665 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 15:08:22.490076 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.490175 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.490259 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 15:08:22.490339 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 15:08:22.490533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.490645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.490793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.490876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 15:08:22.491054 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.491145 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.491309 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.491396 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.491611 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.491871 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.501610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.501908 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.502083 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.502176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.502367 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.502459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.502640 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.502921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.509497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.509839 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.512444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.512729 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.512817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.513012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.513093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.513290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.513377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.513572 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.513656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.513857 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.513951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.514128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.514225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.514399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.514479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.514669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.514755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.514941 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.515027 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.515205 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.515290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.515474 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.538682 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.539688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.540428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.540721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.541175 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.541465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.546095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.546377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.546657 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.546819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.547110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.547397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.553233 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.553505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.553809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.554103 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.559989 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.560285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.560448 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.560673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.560803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.560938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.561073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.561208 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.561340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.561472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.561598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.561834 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.562015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.562161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.562290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.562422 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.577989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.578271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.578493 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.578776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.582130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.582581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.585487 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.585812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.585961 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.586215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.590041 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.590593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.593228 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.593790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.596464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.596766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.596974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.597112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.597279 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.597416 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.597558 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.597709 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.597892 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.598004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.598199 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.598509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.614317 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.614616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.614888 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.615157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.615316 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.615659 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.615903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.616167 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.622571 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.623739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.624163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.625275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.625695 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.625998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.626813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.627087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.628791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.629080 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.629366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.629653 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.629839 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.630079 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.630173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.630396 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.630680 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.631073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.641297 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.641581 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.641891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.642177 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.642260 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.642510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.642600 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.642792 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.642875 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.643074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.643159 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.643457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.643746 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.644022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.658584 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.659644 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.661486 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.662559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.664697 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.665752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.666226 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.667288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.667706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.667991 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.668921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.669294 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.669575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.669995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.675292 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.676278 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.676748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.677720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.679718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.680117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.680410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.680616 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.680709 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.681007 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.681300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.681580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.689153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.689455 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.689819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.689945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.690250 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.690531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.696749 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.697037 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.697322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.697405 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 15:08:22.697602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.697685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.697902 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.697995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.698181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.698265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.698483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.698576 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.698754 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.698847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.699027 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.699110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.699338 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.699498 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.699619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.699700 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.699884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.699970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.700153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.700236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.700415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.700495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.700678 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.700959 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 15:08:22.735123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bb83d2b9c0 pid: 81642 (default app) Sep 23 15:08:22.735496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bb83d2b9c0 pid: 81643 (default app) Sep 23 15:08:22.738515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496c6ff-ac5d-4508-a2d0-1794f834500a None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:22.738806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496c6ff-ac5d-4508-a2d0-1794f834500a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:22.739081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496c6ff-ac5d-4508-a2d0-1794f834500a None None] PATH_INFO: `/v3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:22.743264 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1/1] 10.222.0.82 () {50 vars in 791 bytes} [Fri Sep 23 15:08:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:30.924297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30611e-6bab-4c14-b027-08d6f8bd6b9b None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:30.924859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30611e-6bab-4c14-b027-08d6f8bd6b9b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:30.924859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30611e-6bab-4c14-b027-08d6f8bd6b9b None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:30.929087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1/2] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:08:30.934986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d07447-62a5-46f6-8c3c-78f3c02de891 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:30.935514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d07447-62a5-46f6-8c3c-78f3c02de891 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:30.935615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d07447-62a5-46f6-8c3c-78f3c02de891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:31.010352 dv-cinder-855013-3-smb devstack@keystone.service[81642]: INFO dbcounter [None req-80d07447-62a5-46f6-8c3c-78f3c02de891 None None] Registered counter for database keystone Sep 23 15:08:31.032808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG oslo_db.sqlalchemy.engines [None req-80d07447-62a5-46f6-8c3c-78f3c02de891 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:08:31.039696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writer thread running {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:08:31.227785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG passlib.handlers.bcrypt [None req-80d07447-62a5-46f6-8c3c-78f3c02de891 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81642) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 23 15:08:31.228167 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG passlib.handlers.bcrypt [None req-80d07447-62a5-46f6-8c3c-78f3c02de891 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81642) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 23 15:08:31.287273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-80d07447-62a5-46f6-8c3c-78f3c02de891 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:31.288897 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-80d07447-62a5-46f6-8c3c-78f3c02de891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:31.426870 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 2/3] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 23 15:08:31.946930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30611e-6bab-4c14-b027-08d6f8bd6b9b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:32.017667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: INFO dbcounter [None req-5a30611e-6bab-4c14-b027-08d6f8bd6b9b None None] Registered counter for database keystone Sep 23 15:08:32.042935 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG oslo_db.sqlalchemy.engines [None req-5a30611e-6bab-4c14-b027-08d6f8bd6b9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 15:08:32.057284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writer thread running {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 15:08:32.180770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30611e-6bab-4c14-b027-08d6f8bd6b9b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:32.185477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef331c2-f134-421b-8e09-2c914b37f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:32.188085 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef331c2-f134-421b-8e09-2c914b37f461 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:32.188085 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef331c2-f134-421b-8e09-2c914b37f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:32.188085 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef331c2-f134-421b-8e09-2c914b37f461 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:32.196500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef331c2-f134-421b-8e09-2c914b37f461 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:32.249930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6ef331c2-f134-421b-8e09-2c914b37f461 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 23 15:08:32.250348 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef331c2-f134-421b-8e09-2c914b37f461 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:32.260985 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 2/4] 10.222.0.82 () {58 vars in 1324 bytes} [Fri Sep 23 15:08:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 15:08:32.267664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d07447-62a5-46f6-8c3c-78f3c02de891 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:32.285290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d07447-62a5-46f6-8c3c-78f3c02de891 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:32.289969 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e1828-978f-4265-8686-11ce3d340363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:32.291387 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e1828-978f-4265-8686-11ce3d340363 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:32.291667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e1828-978f-4265-8686-11ce3d340363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:32.291934 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e1828-978f-4265-8686-11ce3d340363 admin admin] PATH_INFO: `/v3/projects/9413a28bc00744258077edf9f566b1b7` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:32.294122 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e1828-978f-4265-8686-11ce3d340363 admin admin] RBAC: Authorizing `identity:get_project(project_id=9413a28bc00744258077edf9f566b1b7)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:32.347344 dv-cinder-855013-3-smb devstack@keystone.service[81642]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b52e1828-978f-4265-8686-11ce3d340363 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 23 15:08:32.347692 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e1828-978f-4265-8686-11ce3d340363 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:32.352370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 3/5] 10.222.0.82 () {56 vars in 1207 bytes} [Fri Sep 23 15:08:32 2022] GET /identity/v3/projects/9413a28bc00744258077edf9f566b1b7 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:08:34.551582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e3b5f-44d0-4b82-9f73-f8c957b8b7dc None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:34.552119 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e3b5f-44d0-4b82-9f73-f8c957b8b7dc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:34.552119 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e3b5f-44d0-4b82-9f73-f8c957b8b7dc None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:34.556233 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 3/6] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:34.562797 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b92f4f-ffdc-46c5-8fde-6e67e143bb30 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:34.563303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b92f4f-ffdc-46c5-8fde-6e67e143bb30 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:34.563394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b92f4f-ffdc-46c5-8fde-6e67e143bb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:34.583127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-45b92f4f-ffdc-46c5-8fde-6e67e143bb30 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:34.584657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-45b92f4f-ffdc-46c5-8fde-6e67e143bb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:34.592513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 4/7] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 23 15:08:34.859009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e3b5f-44d0-4b82-9f73-f8c957b8b7dc None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:34.871673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e3b5f-44d0-4b82-9f73-f8c957b8b7dc None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:34.876578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babea383-b6a2-45d3-938f-1441fa1afa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:34.877187 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea383-b6a2-45d3-938f-1441fa1afa44 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:34.877499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea383-b6a2-45d3-938f-1441fa1afa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:34.877796 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea383-b6a2-45d3-938f-1441fa1afa44 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:34.885556 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babea383-b6a2-45d3-938f-1441fa1afa44 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:34.887365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babea383-b6a2-45d3-938f-1441fa1afa44 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:34.896656 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 4/8] 10.222.0.82 () {58 vars in 1324 bytes} [Fri Sep 23 15:08:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 15:08:34.902909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b92f4f-ffdc-46c5-8fde-6e67e143bb30 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:34.911985 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b92f4f-ffdc-46c5-8fde-6e67e143bb30 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:34.916594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258a00b-d1ef-4908-95bb-f1c05aa69e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:34.917210 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258a00b-d1ef-4908-95bb-f1c05aa69e56 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:34.917487 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258a00b-d1ef-4908-95bb-f1c05aa69e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:34.917781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258a00b-d1ef-4908-95bb-f1c05aa69e56 admin admin] PATH_INFO: `/v3/users/ea51d4ae639b4d778ec8a8872aa6531d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:34.919083 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258a00b-d1ef-4908-95bb-f1c05aa69e56 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea51d4ae639b4d778ec8a8872aa6531d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:34.920884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258a00b-d1ef-4908-95bb-f1c05aa69e56 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:34.922407 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 5/9] 10.222.0.82 () {56 vars in 1198 bytes} [Fri Sep 23 15:08:34 2022] GET /identity/v3/users/ea51d4ae639b4d778ec8a8872aa6531d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:37.192501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547ce6-f66e-488a-8d17-c3283c90fe01 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:37.193052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547ce6-f66e-488a-8d17-c3283c90fe01 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:37.193174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547ce6-f66e-488a-8d17-c3283c90fe01 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:37.194541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 5/10] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:08:37.199299 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742f2b5-4242-4c8f-853b-3a44de84054b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:37.199769 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742f2b5-4242-4c8f-853b-3a44de84054b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:37.199856 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742f2b5-4242-4c8f-853b-3a44de84054b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:37.199937 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf96238-60e6-4b1a-911b-6f42b3da9ffd None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:37.200758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf96238-60e6-4b1a-911b-6f42b3da9ffd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:37.201164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf96238-60e6-4b1a-911b-6f42b3da9ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:37.201760 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 6/11] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:37.206661 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d93ebf-d615-4943-b02d-9709d4079b21 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:37.206949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d93ebf-d615-4943-b02d-9709d4079b21 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:37.207224 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d93ebf-d615-4943-b02d-9709d4079b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:37.225166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d0d93ebf-d615-4943-b02d-9709d4079b21 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:37.226300 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d0d93ebf-d615-4943-b02d-9709d4079b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:37.243523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG passlib.handlers.bcrypt [None req-1cf96238-60e6-4b1a-911b-6f42b3da9ffd None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81643) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 23 15:08:37.244115 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG passlib.handlers.bcrypt [None req-1cf96238-60e6-4b1a-911b-6f42b3da9ffd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81643) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 23 15:08:37.294231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1cf96238-60e6-4b1a-911b-6f42b3da9ffd None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:37.295838 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1cf96238-60e6-4b1a-911b-6f42b3da9ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:37.307678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 7/12] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:08:37.398533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 6/13] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:08:37.577164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d93ebf-d615-4943-b02d-9709d4079b21 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:37.600892 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:37.667861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf96238-60e6-4b1a-911b-6f42b3da9ffd None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:37.687792 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d93ebf-d615-4943-b02d-9709d4079b21 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:37.720948 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dfea4-8631-45db-a1c7-2296772b9b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:37.721572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dfea4-8631-45db-a1c7-2296772b9b9b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:37.721882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dfea4-8631-45db-a1c7-2296772b9b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:37.722154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dfea4-8631-45db-a1c7-2296772b9b9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:37.733900 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9dfea4-8631-45db-a1c7-2296772b9b9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:08:37.742509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-0f9dfea4-8631-45db-a1c7-2296772b9b9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:08:37.742509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:37.742509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:37.742509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:37.742509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:37.742509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:37.742509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:37.742509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:37.742509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:37.742509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:37.742509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:37.742509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:37.742509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:08:37.742509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:08:37.742509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:08:37.742509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:08:37.743612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:08:37.743612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:08:37.743612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:08:37.743612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:08:37.743612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:37.743612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:37.743612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:37.743612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:37.743612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:37.743612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:37.743612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:37.743612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:37.743612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:37.743612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:37.743612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:37.743612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:37.744538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:37.744538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:37.744538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:37.744538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:37.744538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:08:37.744538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:08:37.744538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:08:37.744538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:08:37.744538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:08:37.744538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:08:37.744538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:08:37.744538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:08:37.744538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 8/14] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:08:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:37.750398 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dfea4-8631-45db-a1c7-2296772b9b9b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:37.773485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf96238-60e6-4b1a-911b-6f42b3da9ffd None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:37.775887 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:37.812955 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc64c8b-e9b7-4002-8077-b1bcff72467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:37.813841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc64c8b-e9b7-4002-8077-b1bcff72467c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:37.814128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc64c8b-e9b7-4002-8077-b1bcff72467c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:37.814393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc64c8b-e9b7-4002-8077-b1bcff72467c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:37.832624 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:37.850999 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dfea4-8631-45db-a1c7-2296772b9b9b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:37.887095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193616ec-e338-419b-91b4-d54a52362b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:37.887734 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193616ec-e338-419b-91b4-d54a52362b41 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:37.887833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc64c8b-e9b7-4002-8077-b1bcff72467c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:37.888019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193616ec-e338-419b-91b4-d54a52362b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:37.888296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193616ec-e338-419b-91b4-d54a52362b41 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:37.888965 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193616ec-e338-419b-91b4-d54a52362b41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:37.889253 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc64c8b-e9b7-4002-8077-b1bcff72467c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:37.889345 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193616ec-e338-419b-91b4-d54a52362b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:37.890681 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193616ec-e338-419b-91b4-d54a52362b41 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:37.902809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 9/15] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:08:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:08:37.909094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193616ec-e338-419b-91b4-d54a52362b41 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:37.992025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 7/16] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:08:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 15:08:37.997562 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc64c8b-e9b7-4002-8077-b1bcff72467c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:38.000313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:38.011824 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193616ec-e338-419b-91b4-d54a52362b41 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:38.045786 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1a896-da85-45f7-a33b-7f364c72ca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:38.046423 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1a896-da85-45f7-a33b-7f364c72ca53 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:38.046701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1a896-da85-45f7-a33b-7f364c72ca53 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:38.046974 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1a896-da85-45f7-a33b-7f364c72ca53 None admin] PATH_INFO: `/v3/users/ea51d4ae639b4d778ec8a8872aa6531d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:38.048108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1a896-da85-45f7-a33b-7f364c72ca53 None admin] RBAC: Authorizing `identity:get_user(user_id=ea51d4ae639b4d778ec8a8872aa6531d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:38.049566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1a896-da85-45f7-a33b-7f364c72ca53 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:38.051155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 10/17] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:08:37 2022] GET /identity/v3/users/ea51d4ae639b4d778ec8a8872aa6531d => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:08:38.056786 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1a896-da85-45f7-a33b-7f364c72ca53 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:38.072202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:38.105724 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc64c8b-e9b7-4002-8077-b1bcff72467c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:38.141207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fc0eb-0936-4be5-838d-4c987862cb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:38.142089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fc0eb-0936-4be5-838d-4c987862cb46 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:38.142373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fc0eb-0936-4be5-838d-4c987862cb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:38.142643 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fc0eb-0936-4be5-838d-4c987862cb46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:38.161431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fc0eb-0936-4be5-838d-4c987862cb46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:38.162950 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fc0eb-0936-4be5-838d-4c987862cb46 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:38.164072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1a896-da85-45f7-a33b-7f364c72ca53 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:38.185706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-925fc0eb-0936-4be5-838d-4c987862cb46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:08:38.185706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:38.185706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:38.185706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:38.185706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:38.185706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:38.185706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:38.185706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:38.185706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:38.185706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:38.185706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:38.185706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:38.185706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:08:38.185706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:08:38.185706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:08:38.185706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:38.186766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:08:38.187615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:08:38.187615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:08:38.187615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:08:38.187615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 8/18] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:08:38.193682 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fc0eb-0936-4be5-838d-4c987862cb46 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:38.200741 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716618d-38b2-429e-8f97-cde8b7554b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:38.201376 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716618d-38b2-429e-8f97-cde8b7554b2c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:38.201657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716618d-38b2-429e-8f97-cde8b7554b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:38.201960 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716618d-38b2-429e-8f97-cde8b7554b2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:38.203126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716618d-38b2-429e-8f97-cde8b7554b2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:38.204602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716618d-38b2-429e-8f97-cde8b7554b2c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:38.206207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 11/19] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:08:38.212043 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716618d-38b2-429e-8f97-cde8b7554b2c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:38.259048 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:38.297806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:38.305650 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fc0eb-0936-4be5-838d-4c987862cb46 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:38.316221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716618d-38b2-429e-8f97-cde8b7554b2c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:38.339749 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a408f7b-609d-4858-b8d1-fd8d3de30e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:38.340363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a408f7b-609d-4858-b8d1-fd8d3de30e39 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:38.340643 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a408f7b-609d-4858-b8d1-fd8d3de30e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:38.341472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a408f7b-609d-4858-b8d1-fd8d3de30e39 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:38.342154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a408f7b-609d-4858-b8d1-fd8d3de30e39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:38.342469 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a408f7b-609d-4858-b8d1-fd8d3de30e39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:38.343865 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a408f7b-609d-4858-b8d1-fd8d3de30e39 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:38.352205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3085e3-9904-4d9b-a96d-552136099132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:38.352820 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3085e3-9904-4d9b-a96d-552136099132 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:38.353101 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3085e3-9904-4d9b-a96d-552136099132 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:38.353397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3085e3-9904-4d9b-a96d-552136099132 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:38.354169 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3085e3-9904-4d9b-a96d-552136099132 None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.domain.id=default, user.id=ea51d4ae639b4d778ec8a8872aa6531d) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:38.354481 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3085e3-9904-4d9b-a96d-552136099132 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:38.355991 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3085e3-9904-4d9b-a96d-552136099132 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:38.362030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 9/20] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:08:38.362700 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 12/21] 10.222.0.82 () {56 vars in 1322 bytes} [Fri Sep 23 15:08:38 2022] GET /identity/v3/role_assignments?user.id=ea51d4ae639b4d778ec8a8872aa6531d&scope.domain.id=default&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:08:40.773908 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b74b40-b306-4a06-acdc-97c1e91214b5 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:40.774434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b74b40-b306-4a06-acdc-97c1e91214b5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:40.774434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b74b40-b306-4a06-acdc-97c1e91214b5 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:40.775825 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 10/22] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:40.791861 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863422-a08d-4152-bb36-5aa101059cd0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:40.792389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863422-a08d-4152-bb36-5aa101059cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:40.792389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863422-a08d-4152-bb36-5aa101059cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:40.822777 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f0863422-a08d-4152-bb36-5aa101059cd0 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:40.823994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f0863422-a08d-4152-bb36-5aa101059cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:40.907578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 13/23] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:08:40.960429 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807810b-bf66-425e-ac56-8ebc243000a1 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:40.960723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807810b-bf66-425e-ac56-8ebc243000a1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:40.960989 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807810b-bf66-425e-ac56-8ebc243000a1 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:40.971920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 11/24] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:40 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:40.977614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131e029-d70b-4e2a-9063-a5c7fc8f8109 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:40.978201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131e029-d70b-4e2a-9063-a5c7fc8f8109 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:40.978693 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131e029-d70b-4e2a-9063-a5c7fc8f8109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:40.997849 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2131e029-d70b-4e2a-9063-a5c7fc8f8109 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:40.999348 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2131e029-d70b-4e2a-9063-a5c7fc8f8109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:41.076742 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 14/25] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:08:41.299934 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7a555-eec6-40c3-996f-3ae825c78f1e None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:41.300593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7a555-eec6-40c3-996f-3ae825c78f1e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:41.301156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7a555-eec6-40c3-996f-3ae825c78f1e None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:41.302726 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 12/26] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:41.308146 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a05cc-20ea-4dd4-a2c9-16ced6766485 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:41.308675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a05cc-20ea-4dd4-a2c9-16ced6766485 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:41.309138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a05cc-20ea-4dd4-a2c9-16ced6766485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:41.317768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:41.319471 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7a555-eec6-40c3-996f-3ae825c78f1e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:41.335477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cb8a05cc-20ea-4dd4-a2c9-16ced6766485 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:41.336451 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cb8a05cc-20ea-4dd4-a2c9-16ced6766485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:41.455319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 15/27] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:08:41.524997 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7a555-eec6-40c3-996f-3ae825c78f1e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:41.548436 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:41.573154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46045c-240d-495f-abe6-9579e4a4afe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:41.573846 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46045c-240d-495f-abe6-9579e4a4afe6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:41.574132 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46045c-240d-495f-abe6-9579e4a4afe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:41.574473 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46045c-240d-495f-abe6-9579e4a4afe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:41.587863 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46045c-240d-495f-abe6-9579e4a4afe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:41.589249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46045c-240d-495f-abe6-9579e4a4afe6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:41.594248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a05cc-20ea-4dd4-a2c9-16ced6766485 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:41.604378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-8e46045c-240d-495f-abe6-9579e4a4afe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:08:41.604378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:41.604378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:41.604378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:41.604378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:41.604378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:41.604378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:41.604378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:41.604378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:41.604378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:41.604378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:41.604378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:41.604378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:08:41.604378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:08:41.604378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:08:41.604378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:41.605409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:08:41.606238 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:08:41.606238 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:08:41.606238 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:08:41.606238 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 13/28] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:08:41.617886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46045c-240d-495f-abe6-9579e4a4afe6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:41.772543 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a05cc-20ea-4dd4-a2c9-16ced6766485 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:41.844190 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2207b9-f38c-4b8f-861f-2f65e47fb347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:41.844787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2207b9-f38c-4b8f-861f-2f65e47fb347 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:41.845038 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2207b9-f38c-4b8f-861f-2f65e47fb347 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:41.845282 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2207b9-f38c-4b8f-861f-2f65e47fb347 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:41.851295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:41.859168 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46045c-240d-495f-abe6-9579e4a4afe6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:41.867777 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2207b9-f38c-4b8f-861f-2f65e47fb347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:08:41.873639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-af2207b9-f38c-4b8f-861f-2f65e47fb347 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:08:41.873639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:41.873639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:41.873639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:41.873639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:41.873639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:41.873639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:41.873639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:41.873639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:41.873639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:41.873639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:41.873639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:41.873639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:08:41.873639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:08:41.873639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:08:41.873639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:08:41.874514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:08:41.874514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:08:41.874514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:08:41.874514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:08:41.874514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:41.874514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:41.874514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:41.874514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:41.874514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:41.874514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:41.874514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:41.874514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:41.874514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:41.874514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:41.874514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:41.874514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:41.875258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:41.875258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:41.875258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:41.875258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:41.875258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:08:41.875258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:08:41.875258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:08:41.875258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:08:41.875258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:08:41.875258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:08:41.875258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:08:41.875258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:08:41.880075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 16/29] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:08:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:08:41.881973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a994cd-374f-4e92-b2e5-7296edfb6061 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:41.882459 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a994cd-374f-4e92-b2e5-7296edfb6061 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:41.882929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a994cd-374f-4e92-b2e5-7296edfb6061 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:41.885195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 17/30] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:41.885930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a994cd-374f-4e92-b2e5-7296edfb6061 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:41.907253 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083c20e-2352-4091-b48e-94116239c2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:41.907990 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083c20e-2352-4091-b48e-94116239c2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:41.908270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083c20e-2352-4091-b48e-94116239c2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:41.908541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083c20e-2352-4091-b48e-94116239c2b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:41.909467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083c20e-2352-4091-b48e-94116239c2b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:41.909867 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083c20e-2352-4091-b48e-94116239c2b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:41.911462 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083c20e-2352-4091-b48e-94116239c2b7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:41.925056 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 14/31] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:08:41.925702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083c20e-2352-4091-b48e-94116239c2b7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:41.959050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:42.009117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a994cd-374f-4e92-b2e5-7296edfb6061 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:42.038712 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083c20e-2352-4091-b48e-94116239c2b7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:42.050688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de60d0b-ca74-4fef-afd0-7d630ddc718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:42.051621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de60d0b-ca74-4fef-afd0-7d630ddc718a None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:42.052205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de60d0b-ca74-4fef-afd0-7d630ddc718a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:42.052677 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de60d0b-ca74-4fef-afd0-7d630ddc718a None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:42.053557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de60d0b-ca74-4fef-afd0-7d630ddc718a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:42.055390 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de60d0b-ca74-4fef-afd0-7d630ddc718a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:42.077692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499b461-a727-4c15-a3dc-d8733a7d9553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:42.091240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499b461-a727-4c15-a3dc-d8733a7d9553 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:42.091240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499b461-a727-4c15-a3dc-d8733a7d9553 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:42.091240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499b461-a727-4c15-a3dc-d8733a7d9553 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:42.091240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499b461-a727-4c15-a3dc-d8733a7d9553 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:42.091240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499b461-a727-4c15-a3dc-d8733a7d9553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:42.091240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499b461-a727-4c15-a3dc-d8733a7d9553 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:42.100394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 15/32] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:08:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:42.100394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53627c36-3ea5-4219-9d9a-a6fec1f5f897 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:42.100394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53627c36-3ea5-4219-9d9a-a6fec1f5f897 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:42.100394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53627c36-3ea5-4219-9d9a-a6fec1f5f897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:42.124555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-53627c36-3ea5-4219-9d9a-a6fec1f5f897 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:42.125778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-53627c36-3ea5-4219-9d9a-a6fec1f5f897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:42.202405 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 16/33] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:08:42.203634 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53627c36-3ea5-4219-9d9a-a6fec1f5f897 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:42.228048 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:42.393123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 18/34] 10.222.0.82 () {60 vars in 1131 bytes} [Fri Sep 23 15:08:41 2022] POST /identity/v3/roles => generated 219 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:08:42.394082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de60d0b-ca74-4fef-afd0-7d630ddc718a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:42.396686 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53627c36-3ea5-4219-9d9a-a6fec1f5f897 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:42.477578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0358d9f-f3d0-443a-bd71-785606a8489f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:42.482513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0358d9f-f3d0-443a-bd71-785606a8489f None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:42.482824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0358d9f-f3d0-443a-bd71-785606a8489f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:42.483068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0358d9f-f3d0-443a-bd71-785606a8489f None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:42.484029 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0358d9f-f3d0-443a-bd71-785606a8489f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:42.485557 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0358d9f-f3d0-443a-bd71-785606a8489f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:42.518283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:42.576124 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de60d0b-ca74-4fef-afd0-7d630ddc718a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:42.621199 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fa9f1-4bb4-439d-aca2-40fe37fc3b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:42.621913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fa9f1-4bb4-439d-aca2-40fe37fc3b51 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:42.622181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fa9f1-4bb4-439d-aca2-40fe37fc3b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:42.622496 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fa9f1-4bb4-439d-aca2-40fe37fc3b51 None admin] PATH_INFO: `/v3/users/ea51d4ae639b4d778ec8a8872aa6531d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:42.623796 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fa9f1-4bb4-439d-aca2-40fe37fc3b51 None admin] RBAC: Authorizing `identity:get_user(user_id=ea51d4ae639b4d778ec8a8872aa6531d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:42.625381 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fa9f1-4bb4-439d-aca2-40fe37fc3b51 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:42.627191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 19/35] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:08:42 2022] GET /identity/v3/users/ea51d4ae639b4d778ec8a8872aa6531d => generated 247 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:42.629862 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2760ef5-2466-451b-8656-c87f71765504 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:42.629862 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2760ef5-2466-451b-8656-c87f71765504 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:42.629862 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2760ef5-2466-451b-8656-c87f71765504 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:42.630169 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 20/36] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:42.630849 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2760ef5-2466-451b-8656-c87f71765504 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:42.746229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2760ef5-2466-451b-8656-c87f71765504 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:42.768749 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:42.770750 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 17/37] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Sep 23 15:08:42 2022] POST /identity/v3/projects => generated 301 bytes in 567 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:08:42.771735 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0358d9f-f3d0-443a-bd71-785606a8489f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:42.786679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d173f-473f-4511-b1d2-cf91bb902a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:42.788003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d173f-473f-4511-b1d2-cf91bb902a9f None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:42.788527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d173f-473f-4511-b1d2-cf91bb902a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:42.789200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d173f-473f-4511-b1d2-cf91bb902a9f None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:42.790752 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d173f-473f-4511-b1d2-cf91bb902a9f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:42.793274 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d173f-473f-4511-b1d2-cf91bb902a9f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:42.853197 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:42.856133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 21/38] 10.222.0.82 () {60 vars in 1131 bytes} [Fri Sep 23 15:08:42 2022] POST /identity/v3/roles => generated 225 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:08:42.867538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04629-60ef-4e6d-b308-2396b4d95112 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:42.867924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04629-60ef-4e6d-b308-2396b4d95112 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:42.868218 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04629-60ef-4e6d-b308-2396b4d95112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:42.896635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0358d9f-f3d0-443a-bd71-785606a8489f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:42.903389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3cb04629-60ef-4e6d-b308-2396b4d95112 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:42.906385 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3cb04629-60ef-4e6d-b308-2396b4d95112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:42.948180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401a65b-e049-41a9-8397-63e79703c8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:42.948847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401a65b-e049-41a9-8397-63e79703c8ef None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:42.949128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401a65b-e049-41a9-8397-63e79703c8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:42.949404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401a65b-e049-41a9-8397-63e79703c8ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:42.951258 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401a65b-e049-41a9-8397-63e79703c8ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:42.953132 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401a65b-e049-41a9-8397-63e79703c8ef None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:42.956077 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 18/39] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:42.957437 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2afbd-343d-4634-8dcd-0ed13514d45e None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:42.957756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2afbd-343d-4634-8dcd-0ed13514d45e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:42.958032 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2afbd-343d-4634-8dcd-0ed13514d45e None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:42.959645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 19/40] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:42.964910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2afbd-343d-4634-8dcd-0ed13514d45e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:43.001088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 22/41] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:08:43.002905 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f65c5-1aa7-42c2-a90d-9f6beb4db2f8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:43.003365 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f65c5-1aa7-42c2-a90d-9f6beb4db2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:43.003894 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f65c5-1aa7-42c2-a90d-9f6beb4db2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:43.030167 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8a6f65c5-1aa7-42c2-a90d-9f6beb4db2f8 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:43.031610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8a6f65c5-1aa7-42c2-a90d-9f6beb4db2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:43.105651 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2afbd-343d-4634-8dcd-0ed13514d45e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:43.134089 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 23/42] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:08:43.154479 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf2372-94d9-481c-9fe1-2702c016fc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:43.155254 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf2372-94d9-481c-9fe1-2702c016fc40 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:43.155535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf2372-94d9-481c-9fe1-2702c016fc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:43.155809 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf2372-94d9-481c-9fe1-2702c016fc40 None admin] PATH_INFO: `/v3/domains/default/users/ea51d4ae639b4d778ec8a8872aa6531d/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:43.158298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf2372-94d9-481c-9fe1-2702c016fc40 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ea51d4ae639b4d778ec8a8872aa6531d, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:43.159897 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf2372-94d9-481c-9fe1-2702c016fc40 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:43.285907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:43.287557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f65c5-1aa7-42c2-a90d-9f6beb4db2f8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:43.289893 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 20/43] 10.222.0.82 () {58 vars in 1361 bytes} [Fri Sep 23 15:08:42 2022] PUT /identity/v3/domains/default/users/ea51d4ae639b4d778ec8a8872aa6531d/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:08:43.413545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf2372-94d9-481c-9fe1-2702c016fc40 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:43.452613 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:43.521016 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f65c5-1aa7-42c2-a90d-9f6beb4db2f8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:43.536627 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf2372-94d9-481c-9fe1-2702c016fc40 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:43.559085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d64e20-d344-4c51-af2a-d6e66c4843e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:43.559709 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d64e20-d344-4c51-af2a-d6e66c4843e3 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:43.560665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d64e20-d344-4c51-af2a-d6e66c4843e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:43.560844 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d64e20-d344-4c51-af2a-d6e66c4843e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:43.561557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d64e20-d344-4c51-af2a-d6e66c4843e3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:43.562999 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d64e20-d344-4c51-af2a-d6e66c4843e3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:43.574634 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715815a-171e-44eb-ac0b-629a89559912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:43.575318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715815a-171e-44eb-ac0b-629a89559912 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:43.575633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715815a-171e-44eb-ac0b-629a89559912 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:43.575907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715815a-171e-44eb-ac0b-629a89559912 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:43.577007 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715815a-171e-44eb-ac0b-629a89559912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:43.578531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715815a-171e-44eb-ac0b-629a89559912 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:43.582032 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 21/44] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:08:43.586263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715815a-171e-44eb-ac0b-629a89559912 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:43.652817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 24/45] 10.222.0.82 () {60 vars in 1131 bytes} [Fri Sep 23 15:08:43 2022] POST /identity/v3/roles => generated 223 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:08:43.669129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:43.707202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715815a-171e-44eb-ac0b-629a89559912 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:43.746708 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755413d4-21a0-44fe-b252-fe948f3a7603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:43.747339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755413d4-21a0-44fe-b252-fe948f3a7603 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:43.748212 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755413d4-21a0-44fe-b252-fe948f3a7603 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:43.748488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755413d4-21a0-44fe-b252-fe948f3a7603 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:43.749162 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755413d4-21a0-44fe-b252-fe948f3a7603 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:43.750810 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755413d4-21a0-44fe-b252-fe948f3a7603 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:43.845073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 22/46] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Sep 23 15:08:43 2022] POST /identity/v3/projects => generated 312 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:08:45.457728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e7a23-1c5f-49ca-bbb8-dff5f915dd3f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:45.458264 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e7a23-1c5f-49ca-bbb8-dff5f915dd3f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:45.458361 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e7a23-1c5f-49ca-bbb8-dff5f915dd3f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:45.459642 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 25/47] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:45.465022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b148a5-035e-4ec9-9fa4-0f6c6ac75597 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:45.465456 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b148a5-035e-4ec9-9fa4-0f6c6ac75597 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:45.465584 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b148a5-035e-4ec9-9fa4-0f6c6ac75597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:45.483941 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b9b148a5-035e-4ec9-9fa4-0f6c6ac75597 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:45.485461 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b9b148a5-035e-4ec9-9fa4-0f6c6ac75597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:45.553326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 23/48] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:08:45.821340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e7a23-1c5f-49ca-bbb8-dff5f915dd3f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:45.927481 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e7a23-1c5f-49ca-bbb8-dff5f915dd3f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:45.929029 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:45.962489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af6810-8109-4afb-87b8-ba8b3f0e5fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:45.963150 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af6810-8109-4afb-87b8-ba8b3f0e5fcf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:45.963418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af6810-8109-4afb-87b8-ba8b3f0e5fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:45.963697 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af6810-8109-4afb-87b8-ba8b3f0e5fcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:45.974594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af6810-8109-4afb-87b8-ba8b3f0e5fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:08:45.980015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-15af6810-8109-4afb-87b8-ba8b3f0e5fcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:08:45.980015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:45.980015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:45.980015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:45.980015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:45.980015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:45.980015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:45.980015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:45.980015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:45.980015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:45.980015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:45.980015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:45.980015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:08:45.980015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:08:45.980015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:08:45.980015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:08:45.984130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:08:45.984130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:08:45.984130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:08:45.984130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:08:45.984130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:45.984130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:45.984130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:45.984130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:45.984130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:45.984130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:45.984130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:45.984130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:45.984130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:45.984130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:45.984130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:45.984130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:45.984977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:45.984977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:45.984977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:45.984977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:45.984977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:08:45.984977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:08:45.984977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:08:45.984977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:08:45.984977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:08:45.984977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:08:45.984977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:08:45.984977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:08:45.984977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 26/49] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:08:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:45.987569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b148a5-035e-4ec9-9fa4-0f6c6ac75597 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:46.012489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa2aeb-0790-4cf9-9067-ce7e790c38e4 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:46.013333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa2aeb-0790-4cf9-9067-ce7e790c38e4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:46.013959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa2aeb-0790-4cf9-9067-ce7e790c38e4 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:46.015672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 27/50] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:08:46.020693 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff15235-adab-4a84-8da9-0c4239469812 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:46.020978 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff15235-adab-4a84-8da9-0c4239469812 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:46.021254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff15235-adab-4a84-8da9-0c4239469812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:46.038028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:46.039091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-dff15235-adab-4a84-8da9-0c4239469812 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:46.040298 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-dff15235-adab-4a84-8da9-0c4239469812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:46.088408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b148a5-035e-4ec9-9fa4-0f6c6ac75597 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:46.109752 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 28/51] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:08:46.122328 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02806f4-9768-47e1-bae0-ce2554836924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:46.122962 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02806f4-9768-47e1-bae0-ce2554836924 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:46.123242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02806f4-9768-47e1-bae0-ce2554836924 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:46.123510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02806f4-9768-47e1-bae0-ce2554836924 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:46.124166 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02806f4-9768-47e1-bae0-ce2554836924 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:46.124466 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02806f4-9768-47e1-bae0-ce2554836924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:46.125869 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02806f4-9768-47e1-bae0-ce2554836924 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:46.134931 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 24/52] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:08:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:46.140765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff15235-adab-4a84-8da9-0c4239469812 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:46.230842 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:46.240144 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff15235-adab-4a84-8da9-0c4239469812 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:46.273745 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd04a0-0aeb-42d8-9a59-c73a17bb1149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:46.274388 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd04a0-0aeb-42d8-9a59-c73a17bb1149 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:46.274670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd04a0-0aeb-42d8-9a59-c73a17bb1149 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:46.274949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd04a0-0aeb-42d8-9a59-c73a17bb1149 None admin] PATH_INFO: `/v3/users/ea51d4ae639b4d778ec8a8872aa6531d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:46.276169 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd04a0-0aeb-42d8-9a59-c73a17bb1149 None admin] RBAC: Authorizing `identity:get_user(user_id=ea51d4ae639b4d778ec8a8872aa6531d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:46.277640 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd04a0-0aeb-42d8-9a59-c73a17bb1149 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:46.280013 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 29/53] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:08:46 2022] GET /identity/v3/users/ea51d4ae639b4d778ec8a8872aa6531d => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:08:46.285442 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02806f4-9768-47e1-bae0-ce2554836924 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:46.401279 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd04a0-0aeb-42d8-9a59-c73a17bb1149 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:46.492785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02806f4-9768-47e1-bae0-ce2554836924 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:46.501359 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd04a0-0aeb-42d8-9a59-c73a17bb1149 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:46.506895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:46.528018 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5bec9-168e-4fe4-a730-19eaec5409f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:46.528662 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5bec9-168e-4fe4-a730-19eaec5409f7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:46.529089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5bec9-168e-4fe4-a730-19eaec5409f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:46.529358 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5bec9-168e-4fe4-a730-19eaec5409f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:46.530513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5bec9-168e-4fe4-a730-19eaec5409f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:46.532474 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5bec9-168e-4fe4-a730-19eaec5409f7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:46.534125 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 25/54] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:46.537838 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6c814-dead-4d0d-a8ad-ac1b656bf4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:46.538512 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6c814-dead-4d0d-a8ad-ac1b656bf4ba None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:46.538822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6c814-dead-4d0d-a8ad-ac1b656bf4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:46.539123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6c814-dead-4d0d-a8ad-ac1b656bf4ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:46.540069 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5bec9-168e-4fe4-a730-19eaec5409f7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:46.540315 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6c814-dead-4d0d-a8ad-ac1b656bf4ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:46.542066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6c814-dead-4d0d-a8ad-ac1b656bf4ba None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:46.545775 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 30/55] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:08:46.549262 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6c814-dead-4d0d-a8ad-ac1b656bf4ba None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:46.578422 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:46.640681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5bec9-168e-4fe4-a730-19eaec5409f7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:46.654858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6c814-dead-4d0d-a8ad-ac1b656bf4ba None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:46.674789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ae5d7-c962-4450-9ee2-5971f95f86ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:46.675410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ae5d7-c962-4450-9ee2-5971f95f86ce None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:46.675723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ae5d7-c962-4450-9ee2-5971f95f86ce None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:46.676006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ae5d7-c962-4450-9ee2-5971f95f86ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:46.676734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ae5d7-c962-4450-9ee2-5971f95f86ce None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.domain.id=default, user.id=ea51d4ae639b4d778ec8a8872aa6531d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:46.677055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ae5d7-c962-4450-9ee2-5971f95f86ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:46.678614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ae5d7-c962-4450-9ee2-5971f95f86ce None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:46.686943 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 26/56] 10.222.0.82 () {56 vars in 1322 bytes} [Fri Sep 23 15:08:46 2022] GET /identity/v3/role_assignments?user.id=ea51d4ae639b4d778ec8a8872aa6531d&scope.domain.id=default&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:08:46.688393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b242b-e9a3-4496-a528-bf81279a2c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:46.689016 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b242b-e9a3-4496-a528-bf81279a2c6f None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:46.689395 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b242b-e9a3-4496-a528-bf81279a2c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:46.689662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b242b-e9a3-4496-a528-bf81279a2c6f None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:46.690356 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b242b-e9a3-4496-a528-bf81279a2c6f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:46.691839 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b242b-e9a3-4496-a528-bf81279a2c6f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:46.815220 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 31/57] 10.222.0.82 () {60 vars in 1140 bytes} [Fri Sep 23 15:08:46 2022] POST /identity/v3/projects => generated 298 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:08:48.990314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a941bf-3005-45f6-abe5-170ca7dd344a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:48.990856 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a941bf-3005-45f6-abe5-170ca7dd344a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:48.990856 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a941bf-3005-45f6-abe5-170ca7dd344a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:48.992210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 27/58] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:48.998272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb3d9b-f1ba-49ea-a7ae-06c70acb92a4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:48.998724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb3d9b-f1ba-49ea-a7ae-06c70acb92a4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:48.998830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb3d9b-f1ba-49ea-a7ae-06c70acb92a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:49.017420 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-28bb3d9b-f1ba-49ea-a7ae-06c70acb92a4 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:49.018706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-28bb3d9b-f1ba-49ea-a7ae-06c70acb92a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:49.087643 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 32/59] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:08:49.361602 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a941bf-3005-45f6-abe5-170ca7dd344a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:49.406748 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:49.460384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a941bf-3005-45f6-abe5-170ca7dd344a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:49.493480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7ca4e-d66b-4af6-9868-ab36d724e76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:49.494154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7ca4e-d66b-4af6-9868-ab36d724e76f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:49.494440 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7ca4e-d66b-4af6-9868-ab36d724e76f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:49.494717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7ca4e-d66b-4af6-9868-ab36d724e76f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:49.495838 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7ca4e-d66b-4af6-9868-ab36d724e76f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:49.497276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7ca4e-d66b-4af6-9868-ab36d724e76f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:49.499472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 28/60] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:49.505149 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb3d9b-f1ba-49ea-a7ae-06c70acb92a4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:49.516409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:49.606144 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb3d9b-f1ba-49ea-a7ae-06c70acb92a4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:49.639893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcc729-0362-4466-b6f2-d4bcf9802a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:49.640453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcc729-0362-4466-b6f2-d4bcf9802a3f None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:49.640729 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcc729-0362-4466-b6f2-d4bcf9802a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:49.641001 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcc729-0362-4466-b6f2-d4bcf9802a3f None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:49.641641 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcc729-0362-4466-b6f2-d4bcf9802a3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:49.643108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcc729-0362-4466-b6f2-d4bcf9802a3f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:49.774617 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 33/61] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:08:49 2022] POST /identity/v3/users => generated 275 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:08:53.126812 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8be4b2-e1cc-44e9-975b-b90e68365f09 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:53.127435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8be4b2-e1cc-44e9-975b-b90e68365f09 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:53.127435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8be4b2-e1cc-44e9-975b-b90e68365f09 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:53.129154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 29/62] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:53.134813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e7edc-1091-4954-ae34-0d9797a22bc7 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:53.135323 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e7edc-1091-4954-ae34-0d9797a22bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:53.135404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e7edc-1091-4954-ae34-0d9797a22bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:53.158897 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-993e7edc-1091-4954-ae34-0d9797a22bc7 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:53.160108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-993e7edc-1091-4954-ae34-0d9797a22bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:53.254170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:53.257216 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f6673-07e6-4033-9105-49fce30ebeca None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:53.257958 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f6673-07e6-4033-9105-49fce30ebeca None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:53.258460 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f6673-07e6-4033-9105-49fce30ebeca None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:53.260866 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 30/63] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:53.263543 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 34/64] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:08:53.285228 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4974f04-7395-43ca-8f3d-1cf75cf8f8a0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:53.285900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4974f04-7395-43ca-8f3d-1cf75cf8f8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:53.286416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4974f04-7395-43ca-8f3d-1cf75cf8f8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:53.315667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b4974f04-7395-43ca-8f3d-1cf75cf8f8a0 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:53.317330 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b4974f04-7395-43ca-8f3d-1cf75cf8f8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:53.329565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110b7af-ca82-43ce-994a-c724af7c9125 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:53.330081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110b7af-ca82-43ce-994a-c724af7c9125 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:53.331176 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110b7af-ca82-43ce-994a-c724af7c9125 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:53.334529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 35/65] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:53.340986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890a89-5f2f-438c-b6f6-16f97004a63e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:53.341266 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890a89-5f2f-438c-b6f6-16f97004a63e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:53.341549 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890a89-5f2f-438c-b6f6-16f97004a63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:53.369182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cb890a89-5f2f-438c-b6f6-16f97004a63e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:53.370432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cb890a89-5f2f-438c-b6f6-16f97004a63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:53.452774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 31/66] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:08:53.496026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 36/67] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:08:53.681103 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7ec34-b5df-48ac-965d-bd2265e629a4 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:53.681288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7ec34-b5df-48ac-965d-bd2265e629a4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:53.681560 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7ec34-b5df-48ac-965d-bd2265e629a4 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:53.683379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 32/68] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:53.689479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50e748-b7d7-4ae0-9e87-ccf3ad822167 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:53.689819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50e748-b7d7-4ae0-9e87-ccf3ad822167 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:53.690248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50e748-b7d7-4ae0-9e87-ccf3ad822167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:53.702598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7ec34-b5df-48ac-965d-bd2265e629a4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:53.716246 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ae50e748-b7d7-4ae0-9e87-ccf3ad822167 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:53.718710 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ae50e748-b7d7-4ae0-9e87-ccf3ad822167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:53.770941 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:53.802470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 37/69] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:08:53.803437 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50e748-b7d7-4ae0-9e87-ccf3ad822167 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:53.840691 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7ec34-b5df-48ac-965d-bd2265e629a4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:53.872682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:53.882223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be0263-9b17-468c-9f69-c7f2c83c5cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:53.887819 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be0263-9b17-468c-9f69-c7f2c83c5cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:53.887819 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be0263-9b17-468c-9f69-c7f2c83c5cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:53.887819 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be0263-9b17-468c-9f69-c7f2c83c5cb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:53.897967 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be0263-9b17-468c-9f69-c7f2c83c5cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:08:53.904786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-51be0263-9b17-468c-9f69-c7f2c83c5cb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:08:53.904786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:53.904786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:53.904786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:53.904786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:53.904786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:53.904786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:53.904786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:53.904786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:53.904786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:53.904786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:53.904786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:53.904786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:08:53.904786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:08:53.904786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:08:53.904786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:08:53.905695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:08:53.905695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:08:53.905695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:08:53.905695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:08:53.905695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:53.905695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:53.905695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:53.905695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:53.905695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:53.905695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:53.905695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:53.905695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:53.905695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:53.905695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:53.905695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:53.905695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:53.906799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:53.906799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:53.906799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:53.906799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:53.906799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:08:53.906799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:08:53.906799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:08:53.906799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:08:53.906799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:08:53.906799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:08:53.906799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:08:53.906799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:08:53.906799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 33/70] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:08:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:53.907470 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca4443-18c6-4fa1-9087-67d8b8571dd0 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:53.907538 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca4443-18c6-4fa1-9087-67d8b8571dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:53.908039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca4443-18c6-4fa1-9087-67d8b8571dd0 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:53.909162 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 34/71] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:53.913291 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca4443-18c6-4fa1-9087-67d8b8571dd0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:53.929271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50e748-b7d7-4ae0-9e87-ccf3ad822167 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:53.972688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353409e6-f51e-4278-b21e-8d452a526c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:53.972688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353409e6-f51e-4278-b21e-8d452a526c87 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:53.972688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353409e6-f51e-4278-b21e-8d452a526c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:53.972688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353409e6-f51e-4278-b21e-8d452a526c87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:53.985515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353409e6-f51e-4278-b21e-8d452a526c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:08:53.990430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-353409e6-f51e-4278-b21e-8d452a526c87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:08:53.990430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:53.990430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:53.990430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:53.990430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:53.990430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:53.990430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:53.990430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:53.990430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:53.990430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:53.990430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:53.990430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:53.990430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:08:53.990430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:08:53.990430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:08:53.990430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:08:53.991276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:08:53.991276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:08:53.991276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:08:53.991276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:08:53.991276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:53.991276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:53.991276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:53.991276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:53.991276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:53.991276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:53.991276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:53.991276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:53.991276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:53.991276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:53.991276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:53.991276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:53.992461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:53.992461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:53.992461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:53.992461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:53.992461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:08:53.992461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:08:53.992461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:08:53.992461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:08:53.992461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:08:53.992461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:08:53.992461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:08:53.992461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:08:53.992461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 38/72] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:08:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:53.992461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353409e6-f51e-4278-b21e-8d452a526c87 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:54.036822 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca4443-18c6-4fa1-9087-67d8b8571dd0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:54.038887 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:54.080798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d1bdd-8d9c-471e-aa1f-523843cb6ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:54.081656 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d1bdd-8d9c-471e-aa1f-523843cb6ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:54.081975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d1bdd-8d9c-471e-aa1f-523843cb6ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:54.082328 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d1bdd-8d9c-471e-aa1f-523843cb6ec5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:54.092810 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d1bdd-8d9c-471e-aa1f-523843cb6ec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:08:54.097633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-1a0d1bdd-8d9c-471e-aa1f-523843cb6ec5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:08:54.097633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:54.097633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:54.097633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:54.097633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:54.097633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:54.097633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:54.097633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:54.097633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:54.097633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:54.097633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:54.097633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:54.097633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:08:54.097633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:08:54.097633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:08:54.097633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:08:54.098711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:08:54.098711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:08:54.098711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:08:54.098711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:08:54.098711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:54.098711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:54.098711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:54.098711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:54.098711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:54.098711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:54.098711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:54.098711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:54.098711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:54.098711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:54.098711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:54.098711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:54.099480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:54.099480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:54.099480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:54.099480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:54.099480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:08:54.099480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:08:54.099480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:08:54.099480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:08:54.099480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:08:54.099480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:08:54.099480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:08:54.099480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:08:54.099480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 35/73] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:08:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:54.100710 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891a30-b386-4c85-b0d0-fc4a89b3e165 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:54.101120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891a30-b386-4c85-b0d0-fc4a89b3e165 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:54.101757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891a30-b386-4c85-b0d0-fc4a89b3e165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:54.118533 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353409e6-f51e-4278-b21e-8d452a526c87 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:54.119040 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-95891a30-b386-4c85-b0d0-fc4a89b3e165 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:54.120239 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-95891a30-b386-4c85-b0d0-fc4a89b3e165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:54.135318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:54.153587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadb542-cdf7-429c-a57c-90ed0fc236eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:54.156347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadb542-cdf7-429c-a57c-90ed0fc236eb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:54.156347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadb542-cdf7-429c-a57c-90ed0fc236eb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:54.156347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadb542-cdf7-429c-a57c-90ed0fc236eb None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:54.156347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadb542-cdf7-429c-a57c-90ed0fc236eb None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:54.156347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadb542-cdf7-429c-a57c-90ed0fc236eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:54.157195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadb542-cdf7-429c-a57c-90ed0fc236eb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:54.165304 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 39/74] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:08:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:54.166209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadb542-cdf7-429c-a57c-90ed0fc236eb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:54.194402 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 36/75] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:08:54.202716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95891a30-b386-4c85-b0d0-fc4a89b3e165 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:54.268822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadb542-cdf7-429c-a57c-90ed0fc236eb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:54.299103 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:54.305015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13346a77-1411-497e-83f5-0a88a8c89632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:54.305724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13346a77-1411-497e-83f5-0a88a8c89632 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:54.306028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13346a77-1411-497e-83f5-0a88a8c89632 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:54.311452 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13346a77-1411-497e-83f5-0a88a8c89632 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:54.311452 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13346a77-1411-497e-83f5-0a88a8c89632 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:54.311452 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13346a77-1411-497e-83f5-0a88a8c89632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:54.311682 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95891a30-b386-4c85-b0d0-fc4a89b3e165 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:54.311757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13346a77-1411-497e-83f5-0a88a8c89632 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:54.317436 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 40/76] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:08:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:54.322800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13346a77-1411-497e-83f5-0a88a8c89632 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:54.345297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bcb70-ff90-4458-a67c-da6298af272a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:54.346699 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bcb70-ff90-4458-a67c-da6298af272a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:54.346816 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bcb70-ff90-4458-a67c-da6298af272a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:54.347105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bcb70-ff90-4458-a67c-da6298af272a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:54.358385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764bcb70-ff90-4458-a67c-da6298af272a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:08:54.364247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-764bcb70-ff90-4458-a67c-da6298af272a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:08:54.364247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:54.364247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:54.364247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:54.364247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:54.364247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:54.364247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:54.364247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:54.364247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:54.364247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:54.364247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:54.364247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:54.364247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:08:54.364247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:08:54.364247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:08:54.364247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:08:54.365109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:08:54.365109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:08:54.365109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:08:54.365109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:08:54.365109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:54.365109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:54.365109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:54.365109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:54.365109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:54.365109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:54.365109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:54.365109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:54.365109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:54.365109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:54.365109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:54.365109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:54.366284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:54.366284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:54.366284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:54.366284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:54.366284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:08:54.366284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:08:54.366284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:08:54.366284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:08:54.366284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:08:54.366284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:08:54.366284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:08:54.366284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:08:54.366284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 37/77] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:08:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:54.366284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bcb70-ff90-4458-a67c-da6298af272a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:54.372977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:54.434601 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13346a77-1411-497e-83f5-0a88a8c89632 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:54.470882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269275a-211a-453f-96f8-6e4c3dc25d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:54.471484 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269275a-211a-453f-96f8-6e4c3dc25d20 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:54.471765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269275a-211a-453f-96f8-6e4c3dc25d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:54.472037 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269275a-211a-453f-96f8-6e4c3dc25d20 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:54.472573 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bcb70-ff90-4458-a67c-da6298af272a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:54.472702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269275a-211a-453f-96f8-6e4c3dc25d20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:54.473047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269275a-211a-453f-96f8-6e4c3dc25d20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:54.474512 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269275a-211a-453f-96f8-6e4c3dc25d20 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:54.483562 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 41/78] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:08:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:54.484439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269275a-211a-453f-96f8-6e4c3dc25d20 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:54.506136 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cbc0d-0c7d-4c92-a341-4e2bace9fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:54.506770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cbc0d-0c7d-4c92-a341-4e2bace9fa3f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:54.507051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cbc0d-0c7d-4c92-a341-4e2bace9fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:54.507325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cbc0d-0c7d-4c92-a341-4e2bace9fa3f None admin] PATH_INFO: `/v3/users/782f736ae93442a9aea63bfca5ef7549` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:54.521715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cbc0d-0c7d-4c92-a341-4e2bace9fa3f None admin] RBAC: Authorizing `identity:get_user(user_id=782f736ae93442a9aea63bfca5ef7549)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:54.523154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cbc0d-0c7d-4c92-a341-4e2bace9fa3f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:54.524755 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 38/79] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:08:54 2022] GET /identity/v3/users/782f736ae93442a9aea63bfca5ef7549 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:54.525525 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cbc0d-0c7d-4c92-a341-4e2bace9fa3f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:54.538319 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:54.593886 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269275a-211a-453f-96f8-6e4c3dc25d20 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:54.595544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:54.626013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cbc0d-0c7d-4c92-a341-4e2bace9fa3f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:54.628134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ed76d-4f22-4524-9126-4cfa493833f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:54.628779 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ed76d-4f22-4524-9126-4cfa493833f7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:54.629061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ed76d-4f22-4524-9126-4cfa493833f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:54.629337 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ed76d-4f22-4524-9126-4cfa493833f7 None admin] PATH_INFO: `/v3/users/ea51d4ae639b4d778ec8a8872aa6531d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:54.630513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ed76d-4f22-4524-9126-4cfa493833f7 None admin] RBAC: Authorizing `identity:get_user(user_id=ea51d4ae639b4d778ec8a8872aa6531d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:54.632002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ed76d-4f22-4524-9126-4cfa493833f7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:54.633598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 42/80] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:08:54 2022] GET /identity/v3/users/ea51d4ae639b4d778ec8a8872aa6531d => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:54.634402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ed76d-4f22-4524-9126-4cfa493833f7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:54.660831 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92013a9-fade-4e58-a030-0b4a5fdae4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:54.661443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92013a9-fade-4e58-a030-0b4a5fdae4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:54.661728 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92013a9-fade-4e58-a030-0b4a5fdae4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:54.662031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92013a9-fade-4e58-a030-0b4a5fdae4a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:54.662694 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92013a9-fade-4e58-a030-0b4a5fdae4a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:54.663000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92013a9-fade-4e58-a030-0b4a5fdae4a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:54.664374 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92013a9-fade-4e58-a030-0b4a5fdae4a0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:54.673244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 39/81] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:08:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:54.674087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92013a9-fade-4e58-a030-0b4a5fdae4a0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:54.738828 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ed76d-4f22-4524-9126-4cfa493833f7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:54.743681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:54.772971 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1949c2c-ee6e-482b-a9a8-9b1221087cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:54.773537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1949c2c-ee6e-482b-a9a8-9b1221087cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:54.773762 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92013a9-fade-4e58-a030-0b4a5fdae4a0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:54.773868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1949c2c-ee6e-482b-a9a8-9b1221087cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:54.774207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1949c2c-ee6e-482b-a9a8-9b1221087cb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:54.775318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1949c2c-ee6e-482b-a9a8-9b1221087cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:54.776784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1949c2c-ee6e-482b-a9a8-9b1221087cb1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:54.778588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 43/82] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:54.779433 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1949c2c-ee6e-482b-a9a8-9b1221087cb1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:54.808431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515fc3b-eaae-4497-83c3-216faa498559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:54.809068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515fc3b-eaae-4497-83c3-216faa498559 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:54.809350 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515fc3b-eaae-4497-83c3-216faa498559 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:54.809628 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515fc3b-eaae-4497-83c3-216faa498559 None admin] PATH_INFO: `/v3/users/782f736ae93442a9aea63bfca5ef7549` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:54.810845 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515fc3b-eaae-4497-83c3-216faa498559 None admin] RBAC: Authorizing `identity:get_user(user_id=782f736ae93442a9aea63bfca5ef7549)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:54.812299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515fc3b-eaae-4497-83c3-216faa498559 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:54.813909 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 40/83] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:08:54 2022] GET /identity/v3/users/782f736ae93442a9aea63bfca5ef7549 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:54.818626 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515fc3b-eaae-4497-83c3-216faa498559 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:54.824703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:54.887070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1949c2c-ee6e-482b-a9a8-9b1221087cb1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:54.915621 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515fc3b-eaae-4497-83c3-216faa498559 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:54.921325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411837c6-0c90-4b4d-9ab3-fca878bb16ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:54.921963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411837c6-0c90-4b4d-9ab3-fca878bb16ec None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:54.922249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411837c6-0c90-4b4d-9ab3-fca878bb16ec None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:54.922529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411837c6-0c90-4b4d-9ab3-fca878bb16ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:54.950311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862be964-64ef-4b7f-b115-21466cc7a2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:54.950921 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862be964-64ef-4b7f-b115-21466cc7a2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:54.951201 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862be964-64ef-4b7f-b115-21466cc7a2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:54.951969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862be964-64ef-4b7f-b115-21466cc7a2a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:54.962855 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:54.990730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411837c6-0c90-4b4d-9ab3-fca878bb16ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:54.992229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411837c6-0c90-4b4d-9ab3-fca878bb16ec None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:55.022494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862be964-64ef-4b7f-b115-21466cc7a2a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:55.024030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862be964-64ef-4b7f-b115-21466cc7a2a1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:55.030350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:55.091111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 44/84] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:08:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:08:55.091791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411837c6-0c90-4b4d-9ab3-fca878bb16ec None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:55.126428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 41/85] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:08:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:08:55.127277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862be964-64ef-4b7f-b115-21466cc7a2a1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:55.171540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:55.191619 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411837c6-0c90-4b4d-9ab3-fca878bb16ec None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:55.226078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4e8a0-e34b-4d9b-8c30-e8b5acbcedd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:55.226822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4e8a0-e34b-4d9b-8c30-e8b5acbcedd4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:55.227106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4e8a0-e34b-4d9b-8c30-e8b5acbcedd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:55.227385 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4e8a0-e34b-4d9b-8c30-e8b5acbcedd4 None admin] PATH_INFO: `/v3/users/782f736ae93442a9aea63bfca5ef7549` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:55.228399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862be964-64ef-4b7f-b115-21466cc7a2a1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:55.228828 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4e8a0-e34b-4d9b-8c30-e8b5acbcedd4 None admin] RBAC: Authorizing `identity:get_user(user_id=782f736ae93442a9aea63bfca5ef7549)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:55.230055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4e8a0-e34b-4d9b-8c30-e8b5acbcedd4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:55.231663 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 45/86] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:08:55 2022] GET /identity/v3/users/782f736ae93442a9aea63bfca5ef7549 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:55.234642 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4e8a0-e34b-4d9b-8c30-e8b5acbcedd4 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:55.243399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:55.262288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627aee5-74be-4c85-8186-29263be469b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:55.262906 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627aee5-74be-4c85-8186-29263be469b9 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:55.263227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627aee5-74be-4c85-8186-29263be469b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:55.266188 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627aee5-74be-4c85-8186-29263be469b9 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:55.266188 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627aee5-74be-4c85-8186-29263be469b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:55.266188 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627aee5-74be-4c85-8186-29263be469b9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:55.335422 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4e8a0-e34b-4d9b-8c30-e8b5acbcedd4 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:55.368493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde34d20-9d3e-4bbb-8fb1-17556cc235a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:55.369105 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde34d20-9d3e-4bbb-8fb1-17556cc235a6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:55.369385 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde34d20-9d3e-4bbb-8fb1-17556cc235a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:55.369662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde34d20-9d3e-4bbb-8fb1-17556cc235a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:55.380768 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 42/87] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:08:55 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:08:55.381653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627aee5-74be-4c85-8186-29263be469b9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:55.447182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde34d20-9d3e-4bbb-8fb1-17556cc235a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:55.448704 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde34d20-9d3e-4bbb-8fb1-17556cc235a6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:55.457645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:55.511468 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:55.519466 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627aee5-74be-4c85-8186-29263be469b9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:55.560225 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721be39-a70b-4d7f-a331-ac2cc70dc535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:55.561441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721be39-a70b-4d7f-a331-ac2cc70dc535 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:55.561721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721be39-a70b-4d7f-a331-ac2cc70dc535 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:55.562017 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721be39-a70b-4d7f-a331-ac2cc70dc535 None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:55.563266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721be39-a70b-4d7f-a331-ac2cc70dc535 None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:55.564703 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721be39-a70b-4d7f-a331-ac2cc70dc535 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:55.565215 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 46/88] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:08:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:08:55.566012 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde34d20-9d3e-4bbb-8fb1-17556cc235a6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:55.570042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 43/89] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:08:55 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:55.570042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721be39-a70b-4d7f-a331-ac2cc70dc535 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:55.694503 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde34d20-9d3e-4bbb-8fb1-17556cc235a6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:55.697795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721be39-a70b-4d7f-a331-ac2cc70dc535 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:55.703656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:55.740758 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b6883-162a-4c9c-9da2-b1b841b43b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:55.742112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b6883-162a-4c9c-9da2-b1b841b43b7d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:55.742838 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b6883-162a-4c9c-9da2-b1b841b43b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:55.743668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b6883-162a-4c9c-9da2-b1b841b43b7d None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:55.744892 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b6883-162a-4c9c-9da2-b1b841b43b7d None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:55.746710 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c749c-c300-482c-93af-8e9549bc4021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:55.746862 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b6883-162a-4c9c-9da2-b1b841b43b7d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:55.746951 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c749c-c300-482c-93af-8e9549bc4021 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:55.747312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c749c-c300-482c-93af-8e9549bc4021 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:55.747649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c749c-c300-482c-93af-8e9549bc4021 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:55.749246 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 47/90] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:08:55 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:55.753869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b6883-162a-4c9c-9da2-b1b841b43b7d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:55.798372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:55.849879 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c749c-c300-482c-93af-8e9549bc4021 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:55.851495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c749c-c300-482c-93af-8e9549bc4021 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:55.881759 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b6883-162a-4c9c-9da2-b1b841b43b7d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:55.921211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63cc19-8ba0-4e0c-984d-baa37c79bedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:55.922152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63cc19-8ba0-4e0c-984d-baa37c79bedc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:55.922722 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63cc19-8ba0-4e0c-984d-baa37c79bedc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:55.923194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63cc19-8ba0-4e0c-984d-baa37c79bedc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:55.924138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63cc19-8ba0-4e0c-984d-baa37c79bedc None admin] RBAC: Adding query filter params (role.id=c18fbe0604b34383a2725a382d77d618, scope.project.id=2accefb496f94595afbc2ab6be270cae, user.id=782f736ae93442a9aea63bfca5ef7549) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:55.924657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63cc19-8ba0-4e0c-984d-baa37c79bedc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:55.926568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63cc19-8ba0-4e0c-984d-baa37c79bedc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:55.933111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 48/91] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:08:55 2022] GET /identity/v3/role_assignments?user.id=782f736ae93442a9aea63bfca5ef7549&scope.project.id=2accefb496f94595afbc2ab6be270cae&role.id=c18fbe0604b34383a2725a382d77d618 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:55.934269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63cc19-8ba0-4e0c-984d-baa37c79bedc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:56.016087 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:56.016280 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 44/92] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:08:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:08:56.017196 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c749c-c300-482c-93af-8e9549bc4021 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:56.102442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63cc19-8ba0-4e0c-984d-baa37c79bedc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:56.128064 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:56.171118 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd7e42-2d90-47aa-a42f-c14fc82382bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:56.171615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c749c-c300-482c-93af-8e9549bc4021 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:56.171769 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd7e42-2d90-47aa-a42f-c14fc82382bf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:56.172048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd7e42-2d90-47aa-a42f-c14fc82382bf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:56.172321 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd7e42-2d90-47aa-a42f-c14fc82382bf None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:56.173621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd7e42-2d90-47aa-a42f-c14fc82382bf None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:56.175584 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd7e42-2d90-47aa-a42f-c14fc82382bf None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:56.177096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 49/93] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:08:55 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:56.181782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd7e42-2d90-47aa-a42f-c14fc82382bf None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:56.213208 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945fca0-d5db-4cde-bf86-f2ef954ab35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:56.214283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945fca0-d5db-4cde-bf86-f2ef954ab35c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:56.215189 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945fca0-d5db-4cde-bf86-f2ef954ab35c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:56.215653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945fca0-d5db-4cde-bf86-f2ef954ab35c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:56.216553 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945fca0-d5db-4cde-bf86-f2ef954ab35c None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=2accefb496f94595afbc2ab6be270cae, user.id=ea51d4ae639b4d778ec8a8872aa6531d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:56.217097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945fca0-d5db-4cde-bf86-f2ef954ab35c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:56.219446 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945fca0-d5db-4cde-bf86-f2ef954ab35c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:56.226326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 45/94] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:08:56 2022] GET /identity/v3/role_assignments?user.id=ea51d4ae639b4d778ec8a8872aa6531d&scope.project.id=2accefb496f94595afbc2ab6be270cae&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:56.227647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945fca0-d5db-4cde-bf86-f2ef954ab35c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:56.392770 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd7e42-2d90-47aa-a42f-c14fc82382bf None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:56.406102 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:56.432978 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945fca0-d5db-4cde-bf86-f2ef954ab35c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:56.464479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6075aca-d1ea-49cc-8e56-c103c940b71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:56.465892 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6075aca-d1ea-49cc-8e56-c103c940b71e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:56.466396 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6075aca-d1ea-49cc-8e56-c103c940b71e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:56.467706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6075aca-d1ea-49cc-8e56-c103c940b71e None admin] PATH_INFO: `/v3/projects/31de0c6510ce4517953edd9ffe6cbf21` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:56.469372 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6075aca-d1ea-49cc-8e56-c103c940b71e None admin] RBAC: Authorizing `identity:get_project(project_id=31de0c6510ce4517953edd9ffe6cbf21)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:56.471824 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6075aca-d1ea-49cc-8e56-c103c940b71e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:56.474832 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 50/95] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:08:56 2022] GET /identity/v3/projects/31de0c6510ce4517953edd9ffe6cbf21 => generated 312 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:56.483133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6075aca-d1ea-49cc-8e56-c103c940b71e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:56.500043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:56.519275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e240d-af93-44c2-85cb-aed9ea8bc352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:56.519911 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e240d-af93-44c2-85cb-aed9ea8bc352 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:56.520245 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e240d-af93-44c2-85cb-aed9ea8bc352 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:56.520533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e240d-af93-44c2-85cb-aed9ea8bc352 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:56.521874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e240d-af93-44c2-85cb-aed9ea8bc352 None admin] RBAC: Adding query filter params (role.id=acaa0e7c8246470aa47504d9bc3ae56f, scope.project.id=2accefb496f94595afbc2ab6be270cae, user.id=782f736ae93442a9aea63bfca5ef7549) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:56.522257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e240d-af93-44c2-85cb-aed9ea8bc352 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:56.524198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e240d-af93-44c2-85cb-aed9ea8bc352 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:56.535560 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 46/96] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:08:56 2022] GET /identity/v3/role_assignments?user.id=782f736ae93442a9aea63bfca5ef7549&scope.project.id=2accefb496f94595afbc2ab6be270cae&role.id=acaa0e7c8246470aa47504d9bc3ae56f => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:56.634226 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6075aca-d1ea-49cc-8e56-c103c940b71e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:56.675493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044f716-9211-4409-9246-2f081037d44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:56.676138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044f716-9211-4409-9246-2f081037d44b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:56.676417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044f716-9211-4409-9246-2f081037d44b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:56.676687 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044f716-9211-4409-9246-2f081037d44b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:56.677453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044f716-9211-4409-9246-2f081037d44b None admin] RBAC: Adding query filter params (role.id=c18fbe0604b34383a2725a382d77d618, scope.project.id=31de0c6510ce4517953edd9ffe6cbf21, user.id=782f736ae93442a9aea63bfca5ef7549) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:56.677784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044f716-9211-4409-9246-2f081037d44b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:56.679342 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044f716-9211-4409-9246-2f081037d44b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:56.691271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 51/97] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:08:56 2022] GET /identity/v3/role_assignments?user.id=782f736ae93442a9aea63bfca5ef7549&scope.project.id=31de0c6510ce4517953edd9ffe6cbf21&role.id=c18fbe0604b34383a2725a382d77d618 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:58.150640 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e0449-c817-48a5-81ac-13527c1123af None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:58.151172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e0449-c817-48a5-81ac-13527c1123af None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:58.151172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e0449-c817-48a5-81ac-13527c1123af None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:58.152853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 47/98] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:58.158528 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f190-4964-4515-99af-e5cce5c15ca7 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:58.158954 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f190-4964-4515-99af-e5cce5c15ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:58.159143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f190-4964-4515-99af-e5cce5c15ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:58.178623 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0201f190-4964-4515-99af-e5cce5c15ca7 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:58.180136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0201f190-4964-4515-99af-e5cce5c15ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:58.180351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdc14b-31d5-4be9-8271-e17054848001 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:58.180603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdc14b-31d5-4be9-8271-e17054848001 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:58.180884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdc14b-31d5-4be9-8271-e17054848001 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:58.182294 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 48/99] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:08:58.189399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38dce9-d996-4ffa-a231-20d80bf02647 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:58.189700 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38dce9-d996-4ffa-a231-20d80bf02647 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:58.190003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38dce9-d996-4ffa-a231-20d80bf02647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:58.215322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ae38dce9-d996-4ffa-a231-20d80bf02647 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:58.216601 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ae38dce9-d996-4ffa-a231-20d80bf02647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:58.259004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:58.328493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 52/100] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:08:58.358307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 49/101] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:08:58.657009 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201f190-4964-4515-99af-e5cce5c15ca7 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:58.775578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201f190-4964-4515-99af-e5cce5c15ca7 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:58.825287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247679a8-69eb-4ba6-b0c4-31fd24c1748a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:58.825952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247679a8-69eb-4ba6-b0c4-31fd24c1748a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:58.826237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247679a8-69eb-4ba6-b0c4-31fd24c1748a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:58.826624 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247679a8-69eb-4ba6-b0c4-31fd24c1748a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:58.836524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38dce9-d996-4ffa-a231-20d80bf02647 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:58.853815 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247679a8-69eb-4ba6-b0c4-31fd24c1748a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:08:58.866120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-247679a8-69eb-4ba6-b0c4-31fd24c1748a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:08:58.866120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:08:58.866120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:08:58.866120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:08:58.866120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:08:58.866120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:08:58.866120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:08:58.866120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:08:58.866120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:08:58.866120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:08:58.866120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:08:58.866120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:08:58.866120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:08:58.866120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:08:58.866120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:08:58.866120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:08:58.867042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:08:58.867042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:08:58.867042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:08:58.867042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:08:58.867042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:08:58.867042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:08:58.867042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:08:58.867042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:08:58.867042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:08:58.867042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:08:58.867042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:08:58.867042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:08:58.867042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:08:58.867042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:08:58.867042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:08:58.867042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:08:58.867801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:08:58.867801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:08:58.867801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:08:58.867801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:08:58.867801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:08:58.867801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:08:58.867801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:08:58.867801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:08:58.867801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:08:58.867801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:08:58.867801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:08:58.867801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:08:58.867801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 53/102] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:08:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:08:58.874381 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247679a8-69eb-4ba6-b0c4-31fd24c1748a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:58.925508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:59.017286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247679a8-69eb-4ba6-b0c4-31fd24c1748a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:59.042017 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38dce9-d996-4ffa-a231-20d80bf02647 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:59.104780 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:59.114813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dc94b-1769-4691-825e-42f01528cc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:59.115449 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dc94b-1769-4691-825e-42f01528cc46 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:59.115840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dc94b-1769-4691-825e-42f01528cc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:59.116224 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dc94b-1769-4691-825e-42f01528cc46 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:59.116916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dc94b-1769-4691-825e-42f01528cc46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:08:59.123341 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dc94b-1769-4691-825e-42f01528cc46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:59.124016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743a648-230a-4929-906d-a0b8db77454a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:59.124016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743a648-230a-4929-906d-a0b8db77454a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:59.124182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dc94b-1769-4691-825e-42f01528cc46 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:59.124249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743a648-230a-4929-906d-a0b8db77454a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:59.124249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743a648-230a-4929-906d-a0b8db77454a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:59.124249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743a648-230a-4929-906d-a0b8db77454a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:59.124249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743a648-230a-4929-906d-a0b8db77454a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:59.124249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 50/103] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:08:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:59.125132 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a1e5f-bdf7-491b-8700-20e52fd227d0 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:59.125421 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a1e5f-bdf7-491b-8700-20e52fd227d0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:59.125683 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a1e5f-bdf7-491b-8700-20e52fd227d0 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:59.127020 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 51/104] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:08:59.132494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c8661-4927-4ab3-84d5-c868b019e1f6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:59.132861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c8661-4927-4ab3-84d5-c868b019e1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:59.133148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c8661-4927-4ab3-84d5-c868b019e1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:59.137344 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 54/105] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:08:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:59.138366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dc94b-1769-4691-825e-42f01528cc46 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:59.151935 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-996c8661-4927-4ab3-84d5-c868b019e1f6 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:59.153123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-996c8661-4927-4ab3-84d5-c868b019e1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:59.236560 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 52/106] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:08:59.237246 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c8661-4927-4ab3-84d5-c868b019e1f6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:59.336795 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:59.352201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dc94b-1769-4691-825e-42f01528cc46 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:59.415392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedcd3b-c126-42a3-bd31-d77fe852cc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:59.419488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedcd3b-c126-42a3-bd31-d77fe852cc53 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:59.420035 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedcd3b-c126-42a3-bd31-d77fe852cc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:59.421009 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedcd3b-c126-42a3-bd31-d77fe852cc53 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:59.421857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedcd3b-c126-42a3-bd31-d77fe852cc53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:59.423612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedcd3b-c126-42a3-bd31-d77fe852cc53 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:59.453001 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c8661-4927-4ab3-84d5-c868b019e1f6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:59.475921 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:59.496363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dec7d-5d73-416e-b523-3de1cf2cdf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:59.496363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dec7d-5d73-416e-b523-3de1cf2cdf52 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:59.496363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dec7d-5d73-416e-b523-3de1cf2cdf52 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:59.496676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dec7d-5d73-416e-b523-3de1cf2cdf52 None admin] PATH_INFO: `/v3/users/6581079242234b1ba0bb8355a6177a87` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:59.518429 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572dec7d-5d73-416e-b523-3de1cf2cdf52 None admin] RBAC: Authorizing `identity:get_user(user_id=6581079242234b1ba0bb8355a6177a87)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:59.519901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572dec7d-5d73-416e-b523-3de1cf2cdf52 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:59.521574 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 53/107] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:08:59 2022] GET /identity/v3/users/6581079242234b1ba0bb8355a6177a87 => generated 289 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:08:59.527240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dec7d-5d73-416e-b523-3de1cf2cdf52 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:59.536551 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 55/108] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Sep 23 15:08:59 2022] POST /identity/v3/projects => generated 302 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:08:59.555982 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21314ced-280f-49ad-bb7d-e307e00f29fb None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:59.560479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21314ced-280f-49ad-bb7d-e307e00f29fb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:59.560479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21314ced-280f-49ad-bb7d-e307e00f29fb None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:59.560479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 56/109] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:08:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:08:59.565075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26f84f-08fd-412e-9950-b14af221ca57 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:59.566168 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26f84f-08fd-412e-9950-b14af221ca57 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:59.566963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26f84f-08fd-412e-9950-b14af221ca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:59.601225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bf26f84f-08fd-412e-9950-b14af221ca57 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:08:59.603156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bf26f84f-08fd-412e-9950-b14af221ca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:08:59.736594 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dec7d-5d73-416e-b523-3de1cf2cdf52 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:08:59.743337 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 57/110] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:08:59.745381 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26f84f-08fd-412e-9950-b14af221ca57 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:08:59.799327 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d4c63-54fa-4556-a8ce-3947158ab666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:08:59.801111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d4c63-54fa-4556-a8ce-3947158ab666 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:08:59.802085 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d4c63-54fa-4556-a8ce-3947158ab666 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:08:59.803294 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d4c63-54fa-4556-a8ce-3947158ab666 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:08:59.885939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:59.892640 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:08:59.915802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d4c63-54fa-4556-a8ce-3947158ab666 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:08:59.917331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d4c63-54fa-4556-a8ce-3947158ab666 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:08:59.947574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26f84f-08fd-412e-9950-b14af221ca57 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:00.005786 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d56b48-c426-4af3-b313-15832b79c9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:00.006441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d56b48-c426-4af3-b313-15832b79c9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:00.006765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d56b48-c426-4af3-b313-15832b79c9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:00.007053 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d56b48-c426-4af3-b313-15832b79c9e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:00.019737 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d56b48-c426-4af3-b313-15832b79c9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:00.024757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c7d56b48-c426-4af3-b313-15832b79c9e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:00.024757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:00.024757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:00.024757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:00.024757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:00.024757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:00.024757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:00.024757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:00.024757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:00.024757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:00.024757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:00.024757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:00.024757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:00.024757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:00.024757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:00.024757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:00.025665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:00.025665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:00.025665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:00.025665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:00.025665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:00.025665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:00.025665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:00.025665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:00.025665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:00.025665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:00.025665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:00.025665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:00.025665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:00.025665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:00.025665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:00.025665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:00.026470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:00.026470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:00.026470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:00.026470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:00.026470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:00.026470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:00.026470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:00.026470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:00.026470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:00.026470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:00.026470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:00.026470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:00.026470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 58/111] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:08:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:00.032929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d56b48-c426-4af3-b313-15832b79c9e0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:00.052820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 54/112] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:08:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 15:09:00.058368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d4c63-54fa-4556-a8ce-3947158ab666 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:00.162152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:00.216274 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d56b48-c426-4af3-b313-15832b79c9e0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:00.227860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d4c63-54fa-4556-a8ce-3947158ab666 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:00.261002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:00.266449 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e6273-5814-48d5-80f9-b1cd7ebb2770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:00.266988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e6273-5814-48d5-80f9-b1cd7ebb2770 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:00.267542 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e6273-5814-48d5-80f9-b1cd7ebb2770 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:00.267834 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e6273-5814-48d5-80f9-b1cd7ebb2770 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:00.268509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e6273-5814-48d5-80f9-b1cd7ebb2770 None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:00.268821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e6273-5814-48d5-80f9-b1cd7ebb2770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:00.270260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e6273-5814-48d5-80f9-b1cd7ebb2770 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:00.281574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 59/113] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:00.282924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e6273-5814-48d5-80f9-b1cd7ebb2770 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:00.315941 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c75859-a960-4e71-82fa-03bcdcd07efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:00.316503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c75859-a960-4e71-82fa-03bcdcd07efe None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:00.316781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c75859-a960-4e71-82fa-03bcdcd07efe None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:00.317053 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c75859-a960-4e71-82fa-03bcdcd07efe None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:00.319512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c75859-a960-4e71-82fa-03bcdcd07efe None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:00.321120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c75859-a960-4e71-82fa-03bcdcd07efe None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:00.324580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 55/114] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:00 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:00.326721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c75859-a960-4e71-82fa-03bcdcd07efe None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:00.445992 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e6273-5814-48d5-80f9-b1cd7ebb2770 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:00.480890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4a347-f6b0-4ce2-9d7e-7df37807c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:00.481500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4a347-f6b0-4ce2-9d7e-7df37807c4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:00.481810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4a347-f6b0-4ce2-9d7e-7df37807c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:00.482094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4a347-f6b0-4ce2-9d7e-7df37807c4a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:00.486421 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c75859-a960-4e71-82fa-03bcdcd07efe None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:00.494201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4a347-f6b0-4ce2-9d7e-7df37807c4a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:00.500351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-cbe4a347-f6b0-4ce2-9d7e-7df37807c4a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:09:00.500351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:00.500351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:00.500351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:00.500351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:00.500351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:00.500351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:00.500351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:00.500351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:00.500351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:00.500351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:00.500351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:00.500351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:00.500351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:00.500351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:00.500351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:00.501200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:00.501200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:00.501200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:00.501200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:00.501200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:00.501200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:00.501200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:00.501200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:00.501200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:00.501200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:00.501200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:00.501200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:00.501200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:00.501200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:00.501200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:00.501200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:00.502003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:00.502003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:00.502003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:00.502003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:00.502003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:00.502003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:00.502003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:00.502003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:00.502003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:00.502003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:00.502003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:09:00.502003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:00.502003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 60/115] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:09:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:00.502629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4a347-f6b0-4ce2-9d7e-7df37807c4a2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:00.525486 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ee54c-876e-45fb-9e78-1f910ba84085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:00.526169 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ee54c-876e-45fb-9e78-1f910ba84085 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:00.526454 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ee54c-876e-45fb-9e78-1f910ba84085 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:00.526764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ee54c-876e-45fb-9e78-1f910ba84085 None admin] PATH_INFO: `/v3/users/782f736ae93442a9aea63bfca5ef7549` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:00.527925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ee54c-876e-45fb-9e78-1f910ba84085 None admin] RBAC: Authorizing `identity:get_user(user_id=782f736ae93442a9aea63bfca5ef7549)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:00.529457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ee54c-876e-45fb-9e78-1f910ba84085 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:00.531747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 56/116] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:00 2022] GET /identity/v3/users/782f736ae93442a9aea63bfca5ef7549 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:00.532805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44bb8e-b08f-4bd0-9216-9ee10f0b1036 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:00.533105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44bb8e-b08f-4bd0-9216-9ee10f0b1036 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:00.533384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44bb8e-b08f-4bd0-9216-9ee10f0b1036 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:00.537298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 57/117] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:00.537298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece6ee7-2864-41f7-80a2-5300637a238d None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:00.537298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece6ee7-2864-41f7-80a2-5300637a238d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:00.537298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece6ee7-2864-41f7-80a2-5300637a238d None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:00.537974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 58/118] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:00.539613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece6ee7-2864-41f7-80a2-5300637a238d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:00.559989 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:00.577960 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:00.623073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4a347-f6b0-4ce2-9d7e-7df37807c4a2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:00.659940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17e420-f66a-4d10-b396-abbd2b07a723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:00.660587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17e420-f66a-4d10-b396-abbd2b07a723 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:00.660874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17e420-f66a-4d10-b396-abbd2b07a723 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:00.661146 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17e420-f66a-4d10-b396-abbd2b07a723 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:00.661668 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece6ee7-2864-41f7-80a2-5300637a238d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:00.661910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17e420-f66a-4d10-b396-abbd2b07a723 None admin] RBAC: Adding query filter params (role.id=fe20f96b39034b82ae491a24ebbda3b4, scope.project.id=2accefb496f94595afbc2ab6be270cae, user.id=6581079242234b1ba0bb8355a6177a87) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:00.662221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17e420-f66a-4d10-b396-abbd2b07a723 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:00.663696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17e420-f66a-4d10-b396-abbd2b07a723 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:00.677769 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 61/119] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:09:00 2022] GET /identity/v3/role_assignments?user.id=6581079242234b1ba0bb8355a6177a87&scope.project.id=2accefb496f94595afbc2ab6be270cae&role.id=fe20f96b39034b82ae491a24ebbda3b4 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:00.677769 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17e420-f66a-4d10-b396-abbd2b07a723 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:00.712731 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ceb92-96fc-45a7-bc9c-a76ba8e1bc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:00.713372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ceb92-96fc-45a7-bc9c-a76ba8e1bc6d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:00.713655 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ceb92-96fc-45a7-bc9c-a76ba8e1bc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:00.713983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ceb92-96fc-45a7-bc9c-a76ba8e1bc6d None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:00.714786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ceb92-96fc-45a7-bc9c-a76ba8e1bc6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:00.715096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ceb92-96fc-45a7-bc9c-a76ba8e1bc6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:00.716722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ceb92-96fc-45a7-bc9c-a76ba8e1bc6d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:00.727186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 59/120] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:00.728553 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb574a-43db-4968-8638-457bd3374406 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:00.728852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb574a-43db-4968-8638-457bd3374406 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:00.729140 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb574a-43db-4968-8638-457bd3374406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:00.749366 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-77bb574a-43db-4968-8638-457bd3374406 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:00.750781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-77bb574a-43db-4968-8638-457bd3374406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:00.815956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17e420-f66a-4d10-b396-abbd2b07a723 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:00.834007 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 60/121] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:00.835809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:00.836552 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3898a6-d9e2-40e3-878e-1876543d2e56 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:00.837047 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3898a6-d9e2-40e3-878e-1876543d2e56 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:00.837570 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3898a6-d9e2-40e3-878e-1876543d2e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:00.851777 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:00.859123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7d3898a6-d9e2-40e3-878e-1876543d2e56 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:00.860874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7d3898a6-d9e2-40e3-878e-1876543d2e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:00.886578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e0dcd-2e37-41ea-8bf2-ad26ac025221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:00.887301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e0dcd-2e37-41ea-8bf2-ad26ac025221 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:00.887554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e0dcd-2e37-41ea-8bf2-ad26ac025221 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:00.887838 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e0dcd-2e37-41ea-8bf2-ad26ac025221 None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:00.889724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e0dcd-2e37-41ea-8bf2-ad26ac025221 None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:00.891434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e0dcd-2e37-41ea-8bf2-ad26ac025221 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:00.897762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 62/122] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:00 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:00.897762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e0dcd-2e37-41ea-8bf2-ad26ac025221 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:00.945467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 61/123] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:00.946790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3898a6-d9e2-40e3-878e-1876543d2e56 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:01.053109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3898a6-d9e2-40e3-878e-1876543d2e56 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:01.089283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c09974-6474-4a5a-ae7b-bfc2c64461cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:01.090382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09974-6474-4a5a-ae7b-bfc2c64461cc None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:01.090889 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09974-6474-4a5a-ae7b-bfc2c64461cc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:01.091363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09974-6474-4a5a-ae7b-bfc2c64461cc None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae/users/782f736ae93442a9aea63bfca5ef7549/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:01.094246 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c09974-6474-4a5a-ae7b-bfc2c64461cc None admin] RBAC: Authorizing `identity:create_grant(project_id=2accefb496f94595afbc2ab6be270cae, user_id=782f736ae93442a9aea63bfca5ef7549, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:01.095952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c09974-6474-4a5a-ae7b-bfc2c64461cc None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:01.097999 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e0dcd-2e37-41ea-8bf2-ad26ac025221 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:01.099861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:01.149057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d52b22-2f8d-4b33-9d29-570f4619d3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:01.149701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d52b22-2f8d-4b33-9d29-570f4619d3bf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:01.150027 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d52b22-2f8d-4b33-9d29-570f4619d3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:01.150301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d52b22-2f8d-4b33-9d29-570f4619d3bf None admin] PATH_INFO: `/v3/users/ea51d4ae639b4d778ec8a8872aa6531d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:01.154511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d52b22-2f8d-4b33-9d29-570f4619d3bf None admin] RBAC: Authorizing `identity:get_user(user_id=ea51d4ae639b4d778ec8a8872aa6531d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:01.156541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d52b22-2f8d-4b33-9d29-570f4619d3bf None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:01.158510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 63/124] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:00 2022] GET /identity/v3/users/ea51d4ae639b4d778ec8a8872aa6531d => generated 247 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:01.164132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d52b22-2f8d-4b33-9d29-570f4619d3bf None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:01.182986 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 62/125] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:09:00 2022] PUT /identity/v3/projects/2accefb496f94595afbc2ab6be270cae/users/782f736ae93442a9aea63bfca5ef7549/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:09:01.242243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:01.304258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d52b22-2f8d-4b33-9d29-570f4619d3bf None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:01.321258 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c09974-6474-4a5a-ae7b-bfc2c64461cc None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:01.356532 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f799f-0db0-4338-bc31-a8c397ad4b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:01.359613 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f799f-0db0-4338-bc31-a8c397ad4b6a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:01.364833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f799f-0db0-4338-bc31-a8c397ad4b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:01.364833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f799f-0db0-4338-bc31-a8c397ad4b6a None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:01.364833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f799f-0db0-4338-bc31-a8c397ad4b6a None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:01.366003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f799f-0db0-4338-bc31-a8c397ad4b6a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:01.370205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 64/126] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:01 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:01.371287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f799f-0db0-4338-bc31-a8c397ad4b6a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:01.521184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c09974-6474-4a5a-ae7b-bfc2c64461cc None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:01.521648 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f799f-0db0-4338-bc31-a8c397ad4b6a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:01.550477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:01.562855 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048eeac-413c-47eb-b46c-83c3d0b23764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:01.563804 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048eeac-413c-47eb-b46c-83c3d0b23764 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:01.564234 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048eeac-413c-47eb-b46c-83c3d0b23764 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:01.564532 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9add71-8d42-4d41-834d-8ba2fa510b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:01.564825 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048eeac-413c-47eb-b46c-83c3d0b23764 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:01.565446 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9add71-8d42-4d41-834d-8ba2fa510b1d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:01.565873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9add71-8d42-4d41-834d-8ba2fa510b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:01.566297 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9add71-8d42-4d41-834d-8ba2fa510b1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:01.576326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048eeac-413c-47eb-b46c-83c3d0b23764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:01.582158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-2048eeac-413c-47eb-b46c-83c3d0b23764 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:01.582158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:01.582158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:01.582158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:01.582158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:01.582158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:01.582158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:01.582158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:01.582158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:01.582158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:01.582158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:01.582158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:01.582158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:01.582158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:01.582158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:01.582158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:01.583111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:01.583111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:01.583111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:01.583111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:01.583111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:01.583111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:01.583111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:01.583111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:01.583111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:01.583111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:01.583111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:01.583111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:01.583111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:01.583111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:01.583111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:01.583111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:01.583876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:01.583876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:01.583876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:01.583876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:01.583876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:01.583876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:01.583876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:01.583876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:01.583876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:01.583876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:01.583876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:01.583876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:01.586625 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 63/127] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:09:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:09:01.592436 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048eeac-413c-47eb-b46c-83c3d0b23764 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:01.594895 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9add71-8d42-4d41-834d-8ba2fa510b1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:01.599957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-3c9add71-8d42-4d41-834d-8ba2fa510b1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:01.599957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:01.599957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:01.599957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:01.599957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:01.599957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:01.599957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:01.599957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:01.599957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:01.599957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:01.599957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:01.599957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:01.599957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:01.599957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:01.599957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:01.599957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:01.600859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:01.600859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:01.600859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:01.600859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:01.600859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:01.600859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:01.600859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:01.600859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:01.600859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:01.600859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:01.600859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:01.600859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:01.600859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:01.600859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:01.600859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:01.600859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:01.601657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:01.601657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:01.601657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:01.601657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:01.601657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:01.601657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:01.601657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:01.601657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:01.601657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:01.601657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:01.601657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:01.601657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:01.606094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 65/128] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:01.607035 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9add71-8d42-4d41-834d-8ba2fa510b1d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:01.700643 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:01.771661 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048eeac-413c-47eb-b46c-83c3d0b23764 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:01.803248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9add71-8d42-4d41-834d-8ba2fa510b1d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:01.823539 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f947a27-b984-4cbc-9054-e4f3733b187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:01.824300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947a27-b984-4cbc-9054-e4f3733b187a None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:01.824589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947a27-b984-4cbc-9054-e4f3733b187a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:01.824912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947a27-b984-4cbc-9054-e4f3733b187a None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae/users/ea51d4ae639b4d778ec8a8872aa6531d/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:01.829985 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f947a27-b984-4cbc-9054-e4f3733b187a None admin] RBAC: Authorizing `identity:create_grant(project_id=2accefb496f94595afbc2ab6be270cae, user_id=ea51d4ae639b4d778ec8a8872aa6531d, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:01.831533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f947a27-b984-4cbc-9054-e4f3733b187a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:01.860884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83895b2b-9ec0-4679-a730-f73379641ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:01.861476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83895b2b-9ec0-4679-a730-f73379641ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:01.861790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83895b2b-9ec0-4679-a730-f73379641ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:01.862134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83895b2b-9ec0-4679-a730-f73379641ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:01.862819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83895b2b-9ec0-4679-a730-f73379641ea1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:01.863129 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83895b2b-9ec0-4679-a730-f73379641ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:01.864569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83895b2b-9ec0-4679-a730-f73379641ea1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:01.875832 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 66/129] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:09:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:01.876812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83895b2b-9ec0-4679-a730-f73379641ea1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:01.931640 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:01.961793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 64/130] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:09:01 2022] PUT /identity/v3/projects/2accefb496f94595afbc2ab6be270cae/users/ea51d4ae639b4d778ec8a8872aa6531d/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:09:01.962970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f947a27-b984-4cbc-9054-e4f3733b187a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:02.019650 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83895b2b-9ec0-4679-a730-f73379641ea1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:02.082414 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa2af4-4dc5-4653-91ed-6fadab0a2349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:02.083158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa2af4-4dc5-4653-91ed-6fadab0a2349 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:02.083431 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa2af4-4dc5-4653-91ed-6fadab0a2349 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:02.083709 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa2af4-4dc5-4653-91ed-6fadab0a2349 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:02.084390 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa2af4-4dc5-4653-91ed-6fadab0a2349 None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:02.084699 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa2af4-4dc5-4653-91ed-6fadab0a2349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:02.086210 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa2af4-4dc5-4653-91ed-6fadab0a2349 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:02.101807 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 67/131] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:02.109702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa2af4-4dc5-4653-91ed-6fadab0a2349 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:02.199795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f947a27-b984-4cbc-9054-e4f3733b187a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:02.241363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:02.283929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fa61e-0058-4c01-972c-72c9ad1769b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:02.284812 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fa61e-0058-4c01-972c-72c9ad1769b6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:02.285099 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fa61e-0058-4c01-972c-72c9ad1769b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:02.285392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fa61e-0058-4c01-972c-72c9ad1769b6 None admin] PATH_INFO: `/v3/users/782f736ae93442a9aea63bfca5ef7549` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:02.286658 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fa61e-0058-4c01-972c-72c9ad1769b6 None admin] RBAC: Authorizing `identity:get_user(user_id=782f736ae93442a9aea63bfca5ef7549)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:02.288515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fa61e-0058-4c01-972c-72c9ad1769b6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:02.290562 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 65/132] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:01 2022] GET /identity/v3/users/782f736ae93442a9aea63bfca5ef7549 => generated 275 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:02.297095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fa61e-0058-4c01-972c-72c9ad1769b6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:02.306346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa2af4-4dc5-4653-91ed-6fadab0a2349 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:02.307946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:02.372061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea73d0-3ac5-4949-a2c5-9b826dedf988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:02.375605 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea73d0-3ac5-4949-a2c5-9b826dedf988 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:02.375897 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea73d0-3ac5-4949-a2c5-9b826dedf988 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:02.376181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea73d0-3ac5-4949-a2c5-9b826dedf988 None admin] PATH_INFO: `/v3/users/782f736ae93442a9aea63bfca5ef7549` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:02.378682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea73d0-3ac5-4949-a2c5-9b826dedf988 None admin] RBAC: Authorizing `identity:get_user(user_id=782f736ae93442a9aea63bfca5ef7549)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:02.381417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea73d0-3ac5-4949-a2c5-9b826dedf988 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:02.384635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 68/133] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:02 2022] GET /identity/v3/users/782f736ae93442a9aea63bfca5ef7549 => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:02.390217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea73d0-3ac5-4949-a2c5-9b826dedf988 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:02.462421 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fa61e-0058-4c01-972c-72c9ad1769b6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:02.503540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b338d27-aa0c-4871-ac3c-565487d17a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:02.504182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b338d27-aa0c-4871-ac3c-565487d17a7a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:02.504466 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b338d27-aa0c-4871-ac3c-565487d17a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:02.504744 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b338d27-aa0c-4871-ac3c-565487d17a7a None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:02.505909 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b338d27-aa0c-4871-ac3c-565487d17a7a None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:02.507373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b338d27-aa0c-4871-ac3c-565487d17a7a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:02.509132 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 66/134] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:02 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:02.515867 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee07bc4-6b57-4cb2-8b3b-60db3cf3f777 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:02.516158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee07bc4-6b57-4cb2-8b3b-60db3cf3f777 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:02.516439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee07bc4-6b57-4cb2-8b3b-60db3cf3f777 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:02.521774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 67/135] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:02.521774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee07bc4-6b57-4cb2-8b3b-60db3cf3f777 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:02.551099 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea73d0-3ac5-4949-a2c5-9b826dedf988 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:02.590572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f40fc-1f20-456f-8601-839a533e07e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:02.591458 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f40fc-1f20-456f-8601-839a533e07e0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:02.591834 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f40fc-1f20-456f-8601-839a533e07e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:02.592214 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f40fc-1f20-456f-8601-839a533e07e0 None admin] PATH_INFO: `/v3/projects/31de0c6510ce4517953edd9ffe6cbf21` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:02.593198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:02.593936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f40fc-1f20-456f-8601-839a533e07e0 None admin] RBAC: Authorizing `identity:get_project(project_id=31de0c6510ce4517953edd9ffe6cbf21)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:02.595371 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f40fc-1f20-456f-8601-839a533e07e0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:02.597300 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 69/136] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:02 2022] GET /identity/v3/projects/31de0c6510ce4517953edd9ffe6cbf21 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:02.598664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba0785-5648-48ef-bda5-9bbee09a919b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:02.599120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba0785-5648-48ef-bda5-9bbee09a919b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:02.599490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba0785-5648-48ef-bda5-9bbee09a919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:02.618506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-95ba0785-5648-48ef-bda5-9bbee09a919b None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:02.619910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-95ba0785-5648-48ef-bda5-9bbee09a919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:02.651241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee07bc4-6b57-4cb2-8b3b-60db3cf3f777 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:02.659322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:02.694005 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5627ff1-ef32-47a2-bc92-c0e340a46d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:02.695026 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5627ff1-ef32-47a2-bc92-c0e340a46d67 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:02.695314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5627ff1-ef32-47a2-bc92-c0e340a46d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:02.695661 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5627ff1-ef32-47a2-bc92-c0e340a46d67 None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae/users/782f736ae93442a9aea63bfca5ef7549/roles/acaa0e7c8246470aa47504d9bc3ae56f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:02.696666 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 70/137] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:02.697784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba0785-5648-48ef-bda5-9bbee09a919b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:02.706857 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5627ff1-ef32-47a2-bc92-c0e340a46d67 None admin] RBAC: Authorizing `identity:create_grant(project_id=2accefb496f94595afbc2ab6be270cae, user_id=782f736ae93442a9aea63bfca5ef7549, role_id=acaa0e7c8246470aa47504d9bc3ae56f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:02.710820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5627ff1-ef32-47a2-bc92-c0e340a46d67 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:02.810704 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba0785-5648-48ef-bda5-9bbee09a919b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:02.821803 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 68/138] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:09:02 2022] PUT /identity/v3/projects/2accefb496f94595afbc2ab6be270cae/users/782f736ae93442a9aea63bfca5ef7549/roles/acaa0e7c8246470aa47504d9bc3ae56f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:09:02.857928 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c286bc-5054-4e43-9638-53759135af5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:02.859099 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c286bc-5054-4e43-9638-53759135af5d None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:02.859556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c286bc-5054-4e43-9638-53759135af5d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:02.860072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c286bc-5054-4e43-9638-53759135af5d None admin] PATH_INFO: `/v3/projects/31de0c6510ce4517953edd9ffe6cbf21/users/782f736ae93442a9aea63bfca5ef7549/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:02.862402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c286bc-5054-4e43-9638-53759135af5d None admin] RBAC: Authorizing `identity:create_grant(project_id=31de0c6510ce4517953edd9ffe6cbf21, user_id=782f736ae93442a9aea63bfca5ef7549, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:02.864131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c286bc-5054-4e43-9638-53759135af5d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:02.948289 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 71/139] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:09:02 2022] PUT /identity/v3/projects/31de0c6510ce4517953edd9ffe6cbf21/users/782f736ae93442a9aea63bfca5ef7549/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:09:03.115052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5627ff1-ef32-47a2-bc92-c0e340a46d67 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:03.239047 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5627ff1-ef32-47a2-bc92-c0e340a46d67 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:03.260263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:03.293092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c7b0e-c901-45e8-9d18-e234c1470078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:03.294375 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c7b0e-c901-45e8-9d18-e234c1470078 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:03.294858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c7b0e-c901-45e8-9d18-e234c1470078 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:03.295329 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c7b0e-c901-45e8-9d18-e234c1470078 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:03.296702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c7b0e-c901-45e8-9d18-e234c1470078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:03.298482 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c7b0e-c901-45e8-9d18-e234c1470078 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:03.301918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 69/140] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:03.306236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c286bc-5054-4e43-9638-53759135af5d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:03.347373 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:03.452110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c286bc-5054-4e43-9638-53759135af5d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:03.457925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe52eb-f058-453a-9dcc-95dd5a8e9381 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:03.458218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe52eb-f058-453a-9dcc-95dd5a8e9381 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:03.458502 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe52eb-f058-453a-9dcc-95dd5a8e9381 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:03.460008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 70/141] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:03.471121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630ba0d-d7d2-4b7d-b916-48c39c0350f3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:03.471481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630ba0d-d7d2-4b7d-b916-48c39c0350f3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:03.471764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630ba0d-d7d2-4b7d-b916-48c39c0350f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:03.503804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a4cff-0984-40bd-b0d9-e18671718fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:03.504429 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a4cff-0984-40bd-b0d9-e18671718fc0 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:03.504710 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a4cff-0984-40bd-b0d9-e18671718fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:03.504983 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a4cff-0984-40bd-b0d9-e18671718fc0 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:03.505657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a4cff-0984-40bd-b0d9-e18671718fc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:03.507207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a4cff-0984-40bd-b0d9-e18671718fc0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:03.510721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d630ba0d-d7d2-4b7d-b916-48c39c0350f3 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:03.512113 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d630ba0d-d7d2-4b7d-b916-48c39c0350f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:03.638346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 71/142] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:03.656765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 72/143] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:09:03 2022] POST /identity/v3/users => generated 283 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:09:03.975128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630ba0d-d7d2-4b7d-b916-48c39c0350f3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:04.107697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630ba0d-d7d2-4b7d-b916-48c39c0350f3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:04.124489 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:04.154434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420cda7-c2b2-4626-bf22-0ab6d2ea3356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:04.155363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420cda7-c2b2-4626-bf22-0ab6d2ea3356 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:04.155785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420cda7-c2b2-4626-bf22-0ab6d2ea3356 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:04.156193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420cda7-c2b2-4626-bf22-0ab6d2ea3356 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:04.167642 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420cda7-c2b2-4626-bf22-0ab6d2ea3356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:04.173170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0420cda7-c2b2-4626-bf22-0ab6d2ea3356 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:09:04.173170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:04.173170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:04.173170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:04.173170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:04.173170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:04.173170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:04.173170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:04.173170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:04.173170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:04.173170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:04.173170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:04.173170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:04.173170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:04.173170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:04.173170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:04.174242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:04.174242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:04.174242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:04.174242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:04.174242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:04.174242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:04.174242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:04.174242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:04.174242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:04.174242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:04.174242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:04.174242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:04.174242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:04.174242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:04.174242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:04.174242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:04.175180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:04.175180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:04.175180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:04.175180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:04.175180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:04.175180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:04.175180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:04.175180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:04.175180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:04.175180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:04.175180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:09:04.175180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:04.181765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 72/144] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:04.187450 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a4cff-0984-40bd-b0d9-e18671718fc0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:04.318232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:04.337871 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a4cff-0984-40bd-b0d9-e18671718fc0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:04.375500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1140ae-6f3b-4df7-b677-408397173f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:04.376164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1140ae-6f3b-4df7-b677-408397173f9f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:04.376446 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1140ae-6f3b-4df7-b677-408397173f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:04.376723 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1140ae-6f3b-4df7-b677-408397173f9f None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:04.377402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1140ae-6f3b-4df7-b677-408397173f9f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:04.377710 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1140ae-6f3b-4df7-b677-408397173f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:04.379139 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1140ae-6f3b-4df7-b677-408397173f9f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:04.391920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 73/145] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:04.397920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420cda7-c2b2-4626-bf22-0ab6d2ea3356 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:04.470716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707306d-697d-4543-9901-a69750aac6ae None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:04.471050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707306d-697d-4543-9901-a69750aac6ae None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:04.471259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707306d-697d-4543-9901-a69750aac6ae None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:04.472615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 74/146] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:09:04.477821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177200a-e5c9-4e0b-abe0-d0280a4f2606 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:04.478110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177200a-e5c9-4e0b-abe0-d0280a4f2606 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:04.478386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177200a-e5c9-4e0b-abe0-d0280a4f2606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:04.498619 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1177200a-e5c9-4e0b-abe0-d0280a4f2606 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:04.500425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1177200a-e5c9-4e0b-abe0-d0280a4f2606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:04.577813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 75/147] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:09:04.605230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420cda7-c2b2-4626-bf22-0ab6d2ea3356 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:04.653266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c380d0-eac9-4137-bca9-e9c6be1e1a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:04.653973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c380d0-eac9-4137-bca9-e9c6be1e1a45 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:04.654263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c380d0-eac9-4137-bca9-e9c6be1e1a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:04.654541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c380d0-eac9-4137-bca9-e9c6be1e1a45 None admin] PATH_INFO: `/v3/users/6581079242234b1ba0bb8355a6177a87` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:04.655729 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c380d0-eac9-4137-bca9-e9c6be1e1a45 None admin] RBAC: Authorizing `identity:get_user(user_id=6581079242234b1ba0bb8355a6177a87)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:04.657184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c380d0-eac9-4137-bca9-e9c6be1e1a45 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:04.659107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 73/148] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:04 2022] GET /identity/v3/users/6581079242234b1ba0bb8355a6177a87 => generated 289 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:04.664473 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177200a-e5c9-4e0b-abe0-d0280a4f2606 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:04.757237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:04.778277 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177200a-e5c9-4e0b-abe0-d0280a4f2606 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:04.816588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdd71f-d2b3-4ece-9512-44b2c28e1cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:04.817285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdd71f-d2b3-4ece-9512-44b2c28e1cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:04.817616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdd71f-d2b3-4ece-9512-44b2c28e1cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:04.817930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdd71f-d2b3-4ece-9512-44b2c28e1cd4 None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:04.819079 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdd71f-d2b3-4ece-9512-44b2c28e1cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:04.820660 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdd71f-d2b3-4ece-9512-44b2c28e1cd4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:04.822595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 76/149] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:04 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:04.828578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c380d0-eac9-4137-bca9-e9c6be1e1a45 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:04.873232 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:04.937112 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c380d0-eac9-4137-bca9-e9c6be1e1a45 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:04.973807 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8d702-f430-4ba4-8c6b-5094318347cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:04.974568 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8d702-f430-4ba4-8c6b-5094318347cf None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:04.974850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8d702-f430-4ba4-8c6b-5094318347cf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:04.975124 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8d702-f430-4ba4-8c6b-5094318347cf None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae/users/6581079242234b1ba0bb8355a6177a87/roles/fe20f96b39034b82ae491a24ebbda3b4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:04.977146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8d702-f430-4ba4-8c6b-5094318347cf None admin] RBAC: Authorizing `identity:create_grant(project_id=2accefb496f94595afbc2ab6be270cae, user_id=6581079242234b1ba0bb8355a6177a87, role_id=fe20f96b39034b82ae491a24ebbda3b4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:04.978629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8d702-f430-4ba4-8c6b-5094318347cf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:05.062063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 74/150] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:09:04 2022] PUT /identity/v3/projects/2accefb496f94595afbc2ab6be270cae/users/6581079242234b1ba0bb8355a6177a87/roles/fe20f96b39034b82ae491a24ebbda3b4 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:09:05.124989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdd71f-d2b3-4ece-9512-44b2c28e1cd4 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:05.272547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdd71f-d2b3-4ece-9512-44b2c28e1cd4 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:05.326627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1b1c6-d633-41b7-addb-c26c84149ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:05.327847 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1b1c6-d633-41b7-addb-c26c84149ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:05.328124 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1b1c6-d633-41b7-addb-c26c84149ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:05.328395 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1b1c6-d633-41b7-addb-c26c84149ac6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:05.340865 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1b1c6-d633-41b7-addb-c26c84149ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:05.346320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-78e1b1c6-d633-41b7-addb-c26c84149ac6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:05.346320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:05.346320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:05.346320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:05.346320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:05.346320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:05.346320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:05.346320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:05.346320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:05.346320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:05.346320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:05.346320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:05.346320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:05.346320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:05.346320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:05.346320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:05.347164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:05.347164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:05.347164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:05.347164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:05.347164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:05.347164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:05.347164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:05.347164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:05.347164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:05.347164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:05.347164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:05.347164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:05.347164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:05.347164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:05.347164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:05.347164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:05.347929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:05.347929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:05.347929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:05.347929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:05.347929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:05.347929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:05.347929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:05.347929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:05.347929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:05.347929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:05.347929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:05.347929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:05.347929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 77/151] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:05.353399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8d702-f430-4ba4-8c6b-5094318347cf None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:05.453513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:05.457173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8d702-f430-4ba4-8c6b-5094318347cf None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:05.492509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2956c-9cb0-4d6a-96dc-b4531f2020ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:05.495487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2956c-9cb0-4d6a-96dc-b4531f2020ca None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:05.495487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2956c-9cb0-4d6a-96dc-b4531f2020ca None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:05.495487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2956c-9cb0-4d6a-96dc-b4531f2020ca None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:05.495487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2956c-9cb0-4d6a-96dc-b4531f2020ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:05.495487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2956c-9cb0-4d6a-96dc-b4531f2020ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:05.496114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2956c-9cb0-4d6a-96dc-b4531f2020ca None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:05.498672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ff0ba-598d-4a61-a582-94b0b9f4f350 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:05.499017 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ff0ba-598d-4a61-a582-94b0b9f4f350 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:05.499777 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ff0ba-598d-4a61-a582-94b0b9f4f350 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:05.501620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 78/152] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:09:05.508830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2706a71-5d52-4944-b7ac-5f3c1b1389c8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:05.509120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2706a71-5d52-4944-b7ac-5f3c1b1389c8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:05.509373 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2706a71-5d52-4944-b7ac-5f3c1b1389c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:05.511899 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 75/153] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:05.522012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2956c-9cb0-4d6a-96dc-b4531f2020ca None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:05.534424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d2706a71-5d52-4944-b7ac-5f3c1b1389c8 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:05.535647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d2706a71-5d52-4944-b7ac-5f3c1b1389c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:05.541316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:05.622947 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 79/154] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:09:05.692244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2956c-9cb0-4d6a-96dc-b4531f2020ca None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:05.728873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc84b-df12-472e-9ffe-2989ac17d429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:05.729511 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc84b-df12-472e-9ffe-2989ac17d429 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:05.729815 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc84b-df12-472e-9ffe-2989ac17d429 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:05.730094 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc84b-df12-472e-9ffe-2989ac17d429 None admin] PATH_INFO: `/v3/users/782f736ae93442a9aea63bfca5ef7549` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:05.734722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcc84b-df12-472e-9ffe-2989ac17d429 None admin] RBAC: Authorizing `identity:get_user(user_id=782f736ae93442a9aea63bfca5ef7549)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:05.736575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcc84b-df12-472e-9ffe-2989ac17d429 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:05.738573 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 76/155] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:05 2022] GET /identity/v3/users/782f736ae93442a9aea63bfca5ef7549 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:05.744438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2706a71-5d52-4944-b7ac-5f3c1b1389c8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:05.881886 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2706a71-5d52-4944-b7ac-5f3c1b1389c8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:05.918001 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e3265-b1d3-47e3-ad4e-5cb78730dda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:05.918873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e3265-b1d3-47e3-ad4e-5cb78730dda1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:05.919146 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e3265-b1d3-47e3-ad4e-5cb78730dda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:05.919418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e3265-b1d3-47e3-ad4e-5cb78730dda1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:05.928655 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:06.002768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e3265-b1d3-47e3-ad4e-5cb78730dda1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:06.004231 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e3265-b1d3-47e3-ad4e-5cb78730dda1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:06.124930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 80/156] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:06.130874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc84b-df12-472e-9ffe-2989ac17d429 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:06.194433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:06.240458 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e3265-b1d3-47e3-ad4e-5cb78730dda1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:06.297856 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc84b-df12-472e-9ffe-2989ac17d429 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:06.320068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:06.354460 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22517199-5582-4e67-9ca7-5f129a018155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:06.355111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22517199-5582-4e67-9ca7-5f129a018155 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:06.355391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22517199-5582-4e67-9ca7-5f129a018155 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:06.355735 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22517199-5582-4e67-9ca7-5f129a018155 None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:06.356851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22517199-5582-4e67-9ca7-5f129a018155 None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:06.359087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22517199-5582-4e67-9ca7-5f129a018155 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:06.360649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 77/157] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:06 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:06.367209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22517199-5582-4e67-9ca7-5f129a018155 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:06.433590 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e3265-b1d3-47e3-ad4e-5cb78730dda1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:06.495522 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd652e0-3850-470b-b0b6-d58ace02ef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:06.496530 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd652e0-3850-470b-b0b6-d58ace02ef99 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:06.497000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd652e0-3850-470b-b0b6-d58ace02ef99 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:06.497507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd652e0-3850-470b-b0b6-d58ace02ef99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:06.518854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd652e0-3850-470b-b0b6-d58ace02ef99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:06.524249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ddd652e0-3850-470b-b0b6-d58ace02ef99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:09:06.524249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:06.524249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:06.524249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:06.524249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:06.524249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:06.524249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:06.524249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:06.524249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:06.524249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:06.524249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:06.524249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:06.524249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:06.524249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:06.524249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:06.524249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:06.525183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:06.525183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:06.525183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:06.525183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:06.525183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:06.525183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:06.525183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:06.525183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:06.525183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:06.525183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:06.525183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:06.525183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:06.525183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:06.525183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:06.525183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:06.525183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:06.526073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:06.526073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:06.526073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:06.526073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:06.526073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:06.526073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:06.526073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:06.526073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:06.526073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:06.526073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:06.526073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:09:06.526073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:06.528720 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 81/158] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:09:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:06.534772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd652e0-3850-470b-b0b6-d58ace02ef99 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:06.574199 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:06.588210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22517199-5582-4e67-9ca7-5f129a018155 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:06.678383 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd62979-f97e-469b-8071-84fb9b84ecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:06.679011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd62979-f97e-469b-8071-84fb9b84ecc1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:06.679290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd62979-f97e-469b-8071-84fb9b84ecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:06.679562 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd62979-f97e-469b-8071-84fb9b84ecc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:06.680304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd62979-f97e-469b-8071-84fb9b84ecc1 None admin] RBAC: Adding query filter params (role.id=c18fbe0604b34383a2725a382d77d618, scope.project.id=2accefb496f94595afbc2ab6be270cae, user.id=782f736ae93442a9aea63bfca5ef7549) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:06.680612 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd62979-f97e-469b-8071-84fb9b84ecc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:06.682139 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd62979-f97e-469b-8071-84fb9b84ecc1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:06.695961 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 78/159] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:09:06 2022] GET /identity/v3/role_assignments?user.id=782f736ae93442a9aea63bfca5ef7549&scope.project.id=2accefb496f94595afbc2ab6be270cae&role.id=c18fbe0604b34383a2725a382d77d618 => generated 608 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:06.697791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:06.703132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd652e0-3850-470b-b0b6-d58ace02ef99 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:06.765370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7d0ee-2b6f-4d2e-9347-a70ad6a2a4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:06.766881 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7d0ee-2b6f-4d2e-9347-a70ad6a2a4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:06.767357 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7d0ee-2b6f-4d2e-9347-a70ad6a2a4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:06.767822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7d0ee-2b6f-4d2e-9347-a70ad6a2a4a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:06.768775 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7d0ee-2b6f-4d2e-9347-a70ad6a2a4a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:06.769285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7d0ee-2b6f-4d2e-9347-a70ad6a2a4a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:06.770966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7d0ee-2b6f-4d2e-9347-a70ad6a2a4a7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:06.786753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 82/160] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:06.792835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd62979-f97e-469b-8071-84fb9b84ecc1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:06.901877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777a016-6279-480f-a06a-7e666f62dbee None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:06.902531 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777a016-6279-480f-a06a-7e666f62dbee None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:06.903000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777a016-6279-480f-a06a-7e666f62dbee None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:06.904558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 83/161] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:06.919753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb730d63-8cf1-4003-ab50-140b25381e7b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:06.920172 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb730d63-8cf1-4003-ab50-140b25381e7b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:06.920544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb730d63-8cf1-4003-ab50-140b25381e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:06.951996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd62979-f97e-469b-8071-84fb9b84ecc1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:06.952325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-eb730d63-8cf1-4003-ab50-140b25381e7b None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:06.953614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-eb730d63-8cf1-4003-ab50-140b25381e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:07.041307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85b457-5d78-4d5c-aab2-0ce7be68ab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:07.042255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85b457-5d78-4d5c-aab2-0ce7be68ab14 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:07.042681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85b457-5d78-4d5c-aab2-0ce7be68ab14 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:07.043095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85b457-5d78-4d5c-aab2-0ce7be68ab14 None admin] PATH_INFO: `/v3/users/ea51d4ae639b4d778ec8a8872aa6531d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:07.044738 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85b457-5d78-4d5c-aab2-0ce7be68ab14 None admin] RBAC: Authorizing `identity:get_user(user_id=ea51d4ae639b4d778ec8a8872aa6531d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:07.046924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85b457-5d78-4d5c-aab2-0ce7be68ab14 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:07.048692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 79/162] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:06 2022] GET /identity/v3/users/ea51d4ae639b4d778ec8a8872aa6531d => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:07.050338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63ed59-4f96-40ed-ad29-d63fadcba3e6 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:07.050886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63ed59-4f96-40ed-ad29-d63fadcba3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:07.051374 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63ed59-4f96-40ed-ad29-d63fadcba3e6 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:07.052845 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 80/163] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:07.054193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63ed59-4f96-40ed-ad29-d63fadcba3e6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:07.090555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:07.103110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 84/164] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:09:07.104384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436f0e4-08e7-46ab-9b69-7cb7819d4de0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:07.104660 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436f0e4-08e7-46ab-9b69-7cb7819d4de0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:07.104937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436f0e4-08e7-46ab-9b69-7cb7819d4de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:07.146706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7436f0e4-08e7-46ab-9b69-7cb7819d4de0 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:07.147914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7436f0e4-08e7-46ab-9b69-7cb7819d4de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:07.203880 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63ed59-4f96-40ed-ad29-d63fadcba3e6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:07.264003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab895e3-0daa-477b-bfb1-300218b4508f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:07.265021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab895e3-0daa-477b-bfb1-300218b4508f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:07.265534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab895e3-0daa-477b-bfb1-300218b4508f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:07.266155 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab895e3-0daa-477b-bfb1-300218b4508f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:07.279116 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 85/165] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:07.373174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab895e3-0daa-477b-bfb1-300218b4508f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:07.375191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab895e3-0daa-477b-bfb1-300218b4508f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:07.407911 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:07.495933 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 81/166] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:07.501425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436f0e4-08e7-46ab-9b69-7cb7819d4de0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:07.538358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:07.654028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436f0e4-08e7-46ab-9b69-7cb7819d4de0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:07.700765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb8bf1-2551-4a3a-ab1e-6c0a668713f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:07.701401 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb8bf1-2551-4a3a-ab1e-6c0a668713f3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:07.701673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb8bf1-2551-4a3a-ab1e-6c0a668713f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:07.701968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb8bf1-2551-4a3a-ab1e-6c0a668713f3 None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:07.703638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb8bf1-2551-4a3a-ab1e-6c0a668713f3 None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:07.705093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb8bf1-2551-4a3a-ab1e-6c0a668713f3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:07.706748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 86/167] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:07 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:07.712786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab895e3-0daa-477b-bfb1-300218b4508f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:07.761517 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb8bf1-2551-4a3a-ab1e-6c0a668713f3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:07.897416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab895e3-0daa-477b-bfb1-300218b4508f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:07.921818 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:07.944377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:07.959178 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb8bf1-2551-4a3a-ab1e-6c0a668713f3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:07.978453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9a8a1-8981-4d98-a748-f87b9ec74879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:07.979402 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9a8a1-8981-4d98-a748-f87b9ec74879 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:07.979982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9a8a1-8981-4d98-a748-f87b9ec74879 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:07.980457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9a8a1-8981-4d98-a748-f87b9ec74879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:07.981389 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9a8a1-8981-4d98-a748-f87b9ec74879 None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=2accefb496f94595afbc2ab6be270cae, user.id=ea51d4ae639b4d778ec8a8872aa6531d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:07.982011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9a8a1-8981-4d98-a748-f87b9ec74879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:07.983705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9a8a1-8981-4d98-a748-f87b9ec74879 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:07.994324 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 82/168] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:09:07 2022] GET /identity/v3/role_assignments?user.id=ea51d4ae639b4d778ec8a8872aa6531d&scope.project.id=2accefb496f94595afbc2ab6be270cae&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:07.995829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9a8a1-8981-4d98-a748-f87b9ec74879 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:08.043618 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67da546-2950-4116-a700-757567c425a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:08.044447 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67da546-2950-4116-a700-757567c425a9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:08.044712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67da546-2950-4116-a700-757567c425a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:08.044985 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67da546-2950-4116-a700-757567c425a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:08.074524 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67da546-2950-4116-a700-757567c425a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:08.079504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-b67da546-2950-4116-a700-757567c425a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:08.079504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:08.079504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:08.079504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:08.079504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:08.079504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:08.079504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:08.079504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:08.079504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:08.079504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:08.079504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:08.079504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:08.079504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:08.079504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:08.079504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:08.079504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:08.080399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:08.080399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:08.080399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:08.080399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:08.080399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:08.080399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:08.080399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:08.080399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:08.080399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:08.080399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:08.080399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:08.080399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:08.080399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:08.080399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:08.080399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:08.080399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:08.081254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:08.081254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:08.081254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:08.081254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:08.081254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:08.081254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:08.081254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:08.081254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:08.081254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:08.081254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:08.081254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:08.081254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:08.081254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 87/169] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:08.088258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67da546-2950-4116-a700-757567c425a9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:08.177811 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9a8a1-8981-4d98-a748-f87b9ec74879 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:08.252320 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8e1fd-a1b0-4d27-8e5b-1a05b9df84a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:08.253343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8e1fd-a1b0-4d27-8e5b-1a05b9df84a1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:08.254340 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8e1fd-a1b0-4d27-8e5b-1a05b9df84a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:08.255168 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8e1fd-a1b0-4d27-8e5b-1a05b9df84a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:08.281753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8e1fd-a1b0-4d27-8e5b-1a05b9df84a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:08.288299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-76c8e1fd-a1b0-4d27-8e5b-1a05b9df84a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:08.288299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:08.288299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:08.288299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:08.288299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:08.288299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:08.288299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:08.288299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:08.288299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:08.288299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:08.288299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:08.288299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:08.288299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:08.288299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:08.288299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:08.288299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:08.289252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:08.289252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:08.289252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:08.289252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:08.289252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:08.289252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:08.289252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:08.289252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:08.289252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:08.289252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:08.289252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:08.289252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:08.289252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:08.289252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:08.289252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:08.289252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:08.290109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:08.290109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:08.290109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:08.290109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:08.290109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:08.290109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:08.290109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:08.290109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:08.290109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:08.290109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:08.290109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:08.290109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:08.294973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 83/170] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:09:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:08.302038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8e1fd-a1b0-4d27-8e5b-1a05b9df84a1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:08.344171 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67da546-2950-4116-a700-757567c425a9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:08.396941 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:08.410512 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed6f8b-adee-42fb-8bc7-f814d19f6126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:08.411142 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6f8b-adee-42fb-8bc7-f814d19f6126 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:08.411416 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6f8b-adee-42fb-8bc7-f814d19f6126 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:08.411682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6f8b-adee-42fb-8bc7-f814d19f6126 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:08.412354 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed6f8b-adee-42fb-8bc7-f814d19f6126 None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:08.412652 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed6f8b-adee-42fb-8bc7-f814d19f6126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:08.414077 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed6f8b-adee-42fb-8bc7-f814d19f6126 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:08.429402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 88/171] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:08.434862 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed6f8b-adee-42fb-8bc7-f814d19f6126 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:08.461259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:08.527269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8e1fd-a1b0-4d27-8e5b-1a05b9df84a1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:08.607362 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda84860-7b8b-4ee4-a16f-fdd7784ca670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:08.607906 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda84860-7b8b-4ee4-a16f-fdd7784ca670 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:08.608186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda84860-7b8b-4ee4-a16f-fdd7784ca670 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:08.610073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda84860-7b8b-4ee4-a16f-fdd7784ca670 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:08.610773 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda84860-7b8b-4ee4-a16f-fdd7784ca670 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:08.611081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda84860-7b8b-4ee4-a16f-fdd7784ca670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:08.612487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda84860-7b8b-4ee4-a16f-fdd7784ca670 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:08.618382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed6f8b-adee-42fb-8bc7-f814d19f6126 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:08.637274 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 84/172] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:09:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:08.643610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda84860-7b8b-4ee4-a16f-fdd7784ca670 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:08.690753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5ad1d-7f6e-4a73-b9fb-069006a4ca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:08.691404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5ad1d-7f6e-4a73-b9fb-069006a4ca82 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:08.691908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5ad1d-7f6e-4a73-b9fb-069006a4ca82 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:08.692187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5ad1d-7f6e-4a73-b9fb-069006a4ca82 None admin] PATH_INFO: `/v3/users/782f736ae93442a9aea63bfca5ef7549` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:08.694426 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5ad1d-7f6e-4a73-b9fb-069006a4ca82 None admin] RBAC: Authorizing `identity:get_user(user_id=782f736ae93442a9aea63bfca5ef7549)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:08.696774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5ad1d-7f6e-4a73-b9fb-069006a4ca82 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:08.698422 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 89/173] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:08 2022] GET /identity/v3/users/782f736ae93442a9aea63bfca5ef7549 => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:08.704809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5ad1d-7f6e-4a73-b9fb-069006a4ca82 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:08.814393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda84860-7b8b-4ee4-a16f-fdd7784ca670 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:08.837844 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:08.850100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:08.871363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb274f0-3d13-4296-90a4-2698f45874bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:08.871977 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb274f0-3d13-4296-90a4-2698f45874bb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:08.872257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb274f0-3d13-4296-90a4-2698f45874bb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:08.872528 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb274f0-3d13-4296-90a4-2698f45874bb None admin] PATH_INFO: `/v3/users/782f736ae93442a9aea63bfca5ef7549` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:08.876726 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5ad1d-7f6e-4a73-b9fb-069006a4ca82 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:08.877596 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb274f0-3d13-4296-90a4-2698f45874bb None admin] RBAC: Authorizing `identity:get_user(user_id=782f736ae93442a9aea63bfca5ef7549)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:08.879124 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb274f0-3d13-4296-90a4-2698f45874bb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:08.880974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 85/174] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:08 2022] GET /identity/v3/users/782f736ae93442a9aea63bfca5ef7549 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:08.889044 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f9b19-8742-45a2-b48a-88f9bc517250 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:08.889336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f9b19-8742-45a2-b48a-88f9bc517250 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:08.889613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f9b19-8742-45a2-b48a-88f9bc517250 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:08.891149 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 86/175] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:08.896912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f9b19-8742-45a2-b48a-88f9bc517250 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:08.945230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262130f-2300-48b3-94f2-4275105f7bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:08.945959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262130f-2300-48b3-94f2-4275105f7bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:08.946166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262130f-2300-48b3-94f2-4275105f7bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:08.946436 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262130f-2300-48b3-94f2-4275105f7bb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:09.088309 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262130f-2300-48b3-94f2-4275105f7bb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:09.090194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262130f-2300-48b3-94f2-4275105f7bb8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:09.105349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f9b19-8742-45a2-b48a-88f9bc517250 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:09.141464 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e41e53-93ae-47d1-947c-f549e1f46ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:09.142437 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e41e53-93ae-47d1-947c-f549e1f46ade None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:09.142933 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e41e53-93ae-47d1-947c-f549e1f46ade None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:09.143398 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e41e53-93ae-47d1-947c-f549e1f46ade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:09.175314 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:09.194337 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:09.199479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 90/176] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:09.205984 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373147c8-cfc8-4eb5-a0c4-7f0734d29862 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:09.205984 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373147c8-cfc8-4eb5-a0c4-7f0734d29862 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:09.205984 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373147c8-cfc8-4eb5-a0c4-7f0734d29862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:09.215368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e41e53-93ae-47d1-947c-f549e1f46ade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:09.216649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e41e53-93ae-47d1-947c-f549e1f46ade None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:09.222514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-373147c8-cfc8-4eb5-a0c4-7f0734d29862 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:09.224028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-373147c8-cfc8-4eb5-a0c4-7f0734d29862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:09.320568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 91/177] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:09.322347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d9af1-8606-436d-beb3-9d3a7a92e575 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:09.322633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d9af1-8606-436d-beb3-9d3a7a92e575 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:09.322908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d9af1-8606-436d-beb3-9d3a7a92e575 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:09.325019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 92/178] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:09.326262 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d9af1-8606-436d-beb3-9d3a7a92e575 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:09.345816 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 87/179] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:09.349172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae7577-77f1-4fdb-b8b6-1587ab57f1e3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:09.350783 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae7577-77f1-4fdb-b8b6-1587ab57f1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:09.351066 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae7577-77f1-4fdb-b8b6-1587ab57f1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:09.386930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6fae7577-77f1-4fdb-b8b6-1587ab57f1e3 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:09.388316 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6fae7577-77f1-4fdb-b8b6-1587ab57f1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:09.475563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d9af1-8606-436d-beb3-9d3a7a92e575 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:09.489506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:09.502566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 88/180] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:09.503320 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae7577-77f1-4fdb-b8b6-1587ab57f1e3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:09.526482 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:09.534925 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d307f19-78c5-4245-b3f6-17ed2c1d3a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:09.536110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d307f19-78c5-4245-b3f6-17ed2c1d3a32 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:09.536393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d307f19-78c5-4245-b3f6-17ed2c1d3a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:09.536984 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d307f19-78c5-4245-b3f6-17ed2c1d3a32 None admin] PATH_INFO: `/v3/projects/31de0c6510ce4517953edd9ffe6cbf21` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:09.538400 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d307f19-78c5-4245-b3f6-17ed2c1d3a32 None admin] RBAC: Authorizing `identity:get_project(project_id=31de0c6510ce4517953edd9ffe6cbf21)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:09.540847 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d307f19-78c5-4245-b3f6-17ed2c1d3a32 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:09.543406 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 93/181] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:09 2022] GET /identity/v3/projects/31de0c6510ce4517953edd9ffe6cbf21 => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:09.545298 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d91e0-ca8d-4c25-be7f-453d36c84e09 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:09.545634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d91e0-ca8d-4c25-be7f-453d36c84e09 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:09.546773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d91e0-ca8d-4c25-be7f-453d36c84e09 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:09.548074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 94/182] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:09.550151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a66311-39c2-4ba0-a455-f5cd290bec15 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:09.550444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a66311-39c2-4ba0-a455-f5cd290bec15 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:09.550725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a66311-39c2-4ba0-a455-f5cd290bec15 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:09.552142 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 95/183] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:09.558380 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a66311-39c2-4ba0-a455-f5cd290bec15 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:09.635303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae7577-77f1-4fdb-b8b6-1587ab57f1e3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:09.678456 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4505cf-64eb-41a4-816c-f1c3b2ef2d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:09.679149 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4505cf-64eb-41a4-816c-f1c3b2ef2d91 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:09.679433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4505cf-64eb-41a4-816c-f1c3b2ef2d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:09.679702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4505cf-64eb-41a4-816c-f1c3b2ef2d91 None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:09.680823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4505cf-64eb-41a4-816c-f1c3b2ef2d91 None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:09.682305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4505cf-64eb-41a4-816c-f1c3b2ef2d91 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:09.688839 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 89/184] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:09 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:09.688839 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d0ac6-67b5-4433-975e-3c39673edf92 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:09.688839 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d0ac6-67b5-4433-975e-3c39673edf92 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:09.688839 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d0ac6-67b5-4433-975e-3c39673edf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:09.694867 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a66311-39c2-4ba0-a455-f5cd290bec15 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:09.704711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-424d0ac6-67b5-4433-975e-3c39673edf92 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:09.705992 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-424d0ac6-67b5-4433-975e-3c39673edf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:09.731724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4690738-a9c2-40ba-8ac6-0300cc4055b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:09.732369 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4690738-a9c2-40ba-8ac6-0300cc4055b9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:09.732647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4690738-a9c2-40ba-8ac6-0300cc4055b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:09.732937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4690738-a9c2-40ba-8ac6-0300cc4055b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:09.733791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4690738-a9c2-40ba-8ac6-0300cc4055b9 None admin] RBAC: Adding query filter params (role.id=c18fbe0604b34383a2725a382d77d618, scope.project.id=31de0c6510ce4517953edd9ffe6cbf21, user.id=782f736ae93442a9aea63bfca5ef7549) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:09.734107 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4690738-a9c2-40ba-8ac6-0300cc4055b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:09.735645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4690738-a9c2-40ba-8ac6-0300cc4055b9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:09.741902 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 96/185] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:09:09 2022] GET /identity/v3/role_assignments?user.id=782f736ae93442a9aea63bfca5ef7549&scope.project.id=31de0c6510ce4517953edd9ffe6cbf21&role.id=c18fbe0604b34383a2725a382d77d618 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:09.743064 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8e45-37cd-4664-b872-fc267d431b63 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:09.743346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8e45-37cd-4664-b872-fc267d431b63 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:09.743620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8e45-37cd-4664-b872-fc267d431b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:09.770275 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b12f8e45-37cd-4664-b872-fc267d431b63 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:09.772542 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b12f8e45-37cd-4664-b872-fc267d431b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:09.792395 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 90/186] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:09.798835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d0ac6-67b5-4433-975e-3c39673edf92 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:09.807549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:09.833897 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:09.875322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 97/187] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:09.876201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f8e45-37cd-4664-b872-fc267d431b63 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:09.914621 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d0ac6-67b5-4433-975e-3c39673edf92 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:09.957840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147981b3-8625-442f-982c-d7941b5d46e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:09.958475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147981b3-8625-442f-982c-d7941b5d46e4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:09.958749 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147981b3-8625-442f-982c-d7941b5d46e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:09.959018 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147981b3-8625-442f-982c-d7941b5d46e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:09.986941 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147981b3-8625-442f-982c-d7941b5d46e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:09.991752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-147981b3-8625-442f-982c-d7941b5d46e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:09:09.991752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:09.991752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:09.991752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:09.991752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:09.991752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:09.991752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:09.991752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:09.991752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:09.991752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:09.991752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:09.991752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:09.991752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:09.991752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:09.991752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:09.991752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:09.992684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:09.992684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:09.992684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:09.992684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:09.992684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:09.992684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:09.992684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:09.992684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:09.992684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:09.992684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:09.992684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:09.992684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:09.992684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:09.992684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:09.992684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:09.992684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:09.993477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:09.993477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:09.993477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:09.993477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:09.993477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:09.993477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:09.993477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:09.993477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:09.993477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:09.993477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:09.993477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:09:09.993477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:09.993477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 91/188] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:09:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:09.994198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147981b3-8625-442f-982c-d7941b5d46e4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:10.034052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f8e45-37cd-4664-b872-fc267d431b63 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:10.071307 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039192ba-3e3c-47d8-83e1-e5c3a158ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:10.072305 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039192ba-3e3c-47d8-83e1-e5c3a158ca2d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:10.072780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039192ba-3e3c-47d8-83e1-e5c3a158ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:10.073299 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039192ba-3e3c-47d8-83e1-e5c3a158ca2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:10.074269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039192ba-3e3c-47d8-83e1-e5c3a158ca2d None admin] RBAC: Adding query filter params (role.id=acaa0e7c8246470aa47504d9bc3ae56f, scope.project.id=2accefb496f94595afbc2ab6be270cae, user.id=782f736ae93442a9aea63bfca5ef7549) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:10.074778 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039192ba-3e3c-47d8-83e1-e5c3a158ca2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:10.077393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039192ba-3e3c-47d8-83e1-e5c3a158ca2d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:10.084499 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 98/189] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:09:09 2022] GET /identity/v3/role_assignments?user.id=782f736ae93442a9aea63bfca5ef7549&scope.project.id=2accefb496f94595afbc2ab6be270cae&role.id=acaa0e7c8246470aa47504d9bc3ae56f => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:10.084694 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:10.090424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039192ba-3e3c-47d8-83e1-e5c3a158ca2d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:10.113632 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147981b3-8625-442f-982c-d7941b5d46e4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:10.144682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:10.162750 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c4ab3-36c6-470e-94b0-8438f259bd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:10.164551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c4ab3-36c6-470e-94b0-8438f259bd52 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:10.165022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c4ab3-36c6-470e-94b0-8438f259bd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:10.165437 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c4ab3-36c6-470e-94b0-8438f259bd52 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:10.181952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c4ab3-36c6-470e-94b0-8438f259bd52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:10.188687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-139c4ab3-36c6-470e-94b0-8438f259bd52 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:09:10.188687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:10.188687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:10.188687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:10.188687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:10.188687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:10.188687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:10.188687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:10.188687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:10.188687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:10.188687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:10.188687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:10.188687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:10.188687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:10.188687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:10.188687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:10.189847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:10.189847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:10.189847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:10.189847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:10.189847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:10.189847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:10.189847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:10.189847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:10.189847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:10.189847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:10.189847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:10.189847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:10.189847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:10.189847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:10.189847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:10.189847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:10.190832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:10.190832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:10.190832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:10.190832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:10.190832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:10.190832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:10.190832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:10.190832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:10.190832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:10.190832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:10.190832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:09:10.190832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:10.193926 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 92/190] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:10.200878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c4ab3-36c6-470e-94b0-8438f259bd52 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:10.236440 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039192ba-3e3c-47d8-83e1-e5c3a158ca2d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:10.273139 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6432d-9733-4c07-b248-2d171ab5db05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:10.273670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6432d-9733-4c07-b248-2d171ab5db05 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:10.273983 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6432d-9733-4c07-b248-2d171ab5db05 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:10.274255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6432d-9733-4c07-b248-2d171ab5db05 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:10.274925 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6432d-9733-4c07-b248-2d171ab5db05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:10.275231 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6432d-9733-4c07-b248-2d171ab5db05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:10.276627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6432d-9733-4c07-b248-2d171ab5db05 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:10.287891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 99/191] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:10.290589 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6432d-9733-4c07-b248-2d171ab5db05 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:10.314895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c4ab3-36c6-470e-94b0-8438f259bd52 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:10.349022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:10.357355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c063e-89ee-4ed5-99eb-52f02656a1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:10.357988 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c063e-89ee-4ed5-99eb-52f02656a1ac None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:10.358267 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c063e-89ee-4ed5-99eb-52f02656a1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:10.358590 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c063e-89ee-4ed5-99eb-52f02656a1ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:10.370310 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c063e-89ee-4ed5-99eb-52f02656a1ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:10.375172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-cd7c063e-89ee-4ed5-99eb-52f02656a1ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:10.375172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:10.375172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:10.375172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:10.375172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:10.375172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:10.375172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:10.375172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:10.375172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:10.375172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:10.375172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:10.375172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:10.375172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:10.375172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:10.375172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:10.375172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:10.376182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:10.376182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:10.376182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:10.376182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:10.376182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:10.376182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:10.376182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:10.376182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:10.376182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:10.376182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:10.376182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:10.376182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:10.376182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:10.376182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:10.376182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:10.376182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:10.377564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:10.377564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:10.377564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:10.377564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:10.377564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:10.377564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:10.377564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:10.377564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:10.377564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:10.377564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:10.377564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:10.377564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:10.377564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 93/192] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:09:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:10.377564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c063e-89ee-4ed5-99eb-52f02656a1ac None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:10.402963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:10.410040 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6432d-9733-4c07-b248-2d171ab5db05 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:10.443122 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f38ea-e588-40e5-a3c0-7f661b8205a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:10.443774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f38ea-e588-40e5-a3c0-7f661b8205a9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:10.444047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f38ea-e588-40e5-a3c0-7f661b8205a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:10.444320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f38ea-e588-40e5-a3c0-7f661b8205a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:10.445448 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f38ea-e588-40e5-a3c0-7f661b8205a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:10.446916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f38ea-e588-40e5-a3c0-7f661b8205a9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:10.448465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 100/193] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:10.449245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f38ea-e588-40e5-a3c0-7f661b8205a9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:10.477871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c063e-89ee-4ed5-99eb-52f02656a1ac None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:10.510534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97836082-8e84-411c-af47-a9ee53606082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:10.511138 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97836082-8e84-411c-af47-a9ee53606082 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:10.511411 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97836082-8e84-411c-af47-a9ee53606082 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:10.511678 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97836082-8e84-411c-af47-a9ee53606082 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:10.512338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97836082-8e84-411c-af47-a9ee53606082 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:10.512631 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97836082-8e84-411c-af47-a9ee53606082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:10.514034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97836082-8e84-411c-af47-a9ee53606082 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:10.522742 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 94/194] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:10.523713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97836082-8e84-411c-af47-a9ee53606082 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:10.550823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f38ea-e588-40e5-a3c0-7f661b8205a9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:10.578075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:10.584006 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fb822-2206-4980-a8ef-d6639952936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:10.584630 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fb822-2206-4980-a8ef-d6639952936e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:10.584903 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fb822-2206-4980-a8ef-d6639952936e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:10.585174 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fb822-2206-4980-a8ef-d6639952936e None admin] PATH_INFO: `/v3/users/5efeda74a6bc42858fc3b6ae91036d93` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:10.599050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4fb822-2206-4980-a8ef-d6639952936e None admin] RBAC: Authorizing `identity:get_user(user_id=5efeda74a6bc42858fc3b6ae91036d93)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:10.600494 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4fb822-2206-4980-a8ef-d6639952936e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:10.602138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 101/195] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:10 2022] GET /identity/v3/users/5efeda74a6bc42858fc3b6ae91036d93 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:10.602873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fb822-2206-4980-a8ef-d6639952936e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:10.626520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97836082-8e84-411c-af47-a9ee53606082 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:10.629541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:10.660585 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39773691-6c21-4757-aa8e-b95df28bc146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:10.661319 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39773691-6c21-4757-aa8e-b95df28bc146 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:10.661462 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39773691-6c21-4757-aa8e-b95df28bc146 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:10.661758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39773691-6c21-4757-aa8e-b95df28bc146 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:10.662411 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39773691-6c21-4757-aa8e-b95df28bc146 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:10.662708 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39773691-6c21-4757-aa8e-b95df28bc146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:10.664078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39773691-6c21-4757-aa8e-b95df28bc146 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:10.672012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 95/196] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:09:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:10.672795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39773691-6c21-4757-aa8e-b95df28bc146 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:10.706384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fb822-2206-4980-a8ef-d6639952936e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:10.739848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d7da0-799b-4480-b03f-f272841ddcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:10.740457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d7da0-799b-4480-b03f-f272841ddcc6 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:10.740732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d7da0-799b-4480-b03f-f272841ddcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:10.740996 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d7da0-799b-4480-b03f-f272841ddcc6 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:10.741651 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d7da0-799b-4480-b03f-f272841ddcc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:10.743162 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d7da0-799b-4480-b03f-f272841ddcc6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:10.771037 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39773691-6c21-4757-aa8e-b95df28bc146 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:10.784848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:10.803996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85337be-0c46-4e87-8f6f-461e1cbc2b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:10.804614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85337be-0c46-4e87-8f6f-461e1cbc2b36 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:10.804889 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85337be-0c46-4e87-8f6f-461e1cbc2b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:10.805157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85337be-0c46-4e87-8f6f-461e1cbc2b36 None admin] PATH_INFO: `/v3/users/6581079242234b1ba0bb8355a6177a87` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:10.806292 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85337be-0c46-4e87-8f6f-461e1cbc2b36 None admin] RBAC: Authorizing `identity:get_user(user_id=6581079242234b1ba0bb8355a6177a87)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:10.807723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85337be-0c46-4e87-8f6f-461e1cbc2b36 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:10.809307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 96/197] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:10 2022] GET /identity/v3/users/6581079242234b1ba0bb8355a6177a87 => generated 289 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:10.810086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85337be-0c46-4e87-8f6f-461e1cbc2b36 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:10.855859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 102/198] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:09:10 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:09:10.856731 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d7da0-799b-4480-b03f-f272841ddcc6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:10.936388 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85337be-0c46-4e87-8f6f-461e1cbc2b36 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:10.950742 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:10.983263 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d7da0-799b-4480-b03f-f272841ddcc6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:10.986966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407a26b-f241-4d2e-8338-126703611609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:10.987907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407a26b-f241-4d2e-8338-126703611609 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:10.988364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407a26b-f241-4d2e-8338-126703611609 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:10.988804 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407a26b-f241-4d2e-8338-126703611609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:11.022201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f5c98-acf5-4168-bbbf-7e931c88b665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:11.022872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f5c98-acf5-4168-bbbf-7e931c88b665 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:11.023156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f5c98-acf5-4168-bbbf-7e931c88b665 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:11.023427 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f5c98-acf5-4168-bbbf-7e931c88b665 None admin] PATH_INFO: `/v3/users/5efeda74a6bc42858fc3b6ae91036d93` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:11.024578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f5c98-acf5-4168-bbbf-7e931c88b665 None admin] RBAC: Authorizing `identity:get_user(user_id=5efeda74a6bc42858fc3b6ae91036d93)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:11.026787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f5c98-acf5-4168-bbbf-7e931c88b665 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:11.028793 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 103/199] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:10 2022] GET /identity/v3/users/5efeda74a6bc42858fc3b6ae91036d93 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:11.031451 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f5c98-acf5-4168-bbbf-7e931c88b665 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:11.047938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:11.072252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407a26b-f241-4d2e-8338-126703611609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:11.073749 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407a26b-f241-4d2e-8338-126703611609 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:11.155176 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f5c98-acf5-4168-bbbf-7e931c88b665 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:11.196375 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 97/200] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:11.197363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407a26b-f241-4d2e-8338-126703611609 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:11.201483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea3363-d116-4445-8436-4c7a0b7c86c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:11.204395 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea3363-d116-4445-8436-4c7a0b7c86c0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:11.204395 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea3363-d116-4445-8436-4c7a0b7c86c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:11.204395 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea3363-d116-4445-8436-4c7a0b7c86c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:11.224614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:11.286751 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea3363-d116-4445-8436-4c7a0b7c86c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:11.288484 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea3363-d116-4445-8436-4c7a0b7c86c0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:11.299757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:11.320117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407a26b-f241-4d2e-8338-126703611609 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:11.359946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c72981-569f-4212-ad1a-58fde668d5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:11.360718 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c72981-569f-4212-ad1a-58fde668d5af None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:11.361107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c72981-569f-4212-ad1a-58fde668d5af None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:11.361479 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c72981-569f-4212-ad1a-58fde668d5af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:11.457464 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c72981-569f-4212-ad1a-58fde668d5af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:11.458833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 104/201] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:11.459376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c72981-569f-4212-ad1a-58fde668d5af None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:11.459957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea3363-d116-4445-8436-4c7a0b7c86c0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:11.521598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:11.561801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:11.582658 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 98/202] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:11.587705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c72981-569f-4212-ad1a-58fde668d5af None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:11.606453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea3363-d116-4445-8436-4c7a0b7c86c0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:11.645618 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a7e2e-cd72-48ca-8d90-13ac63be2523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:11.646288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a7e2e-cd72-48ca-8d90-13ac63be2523 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:11.646677 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a7e2e-cd72-48ca-8d90-13ac63be2523 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:11.646958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a7e2e-cd72-48ca-8d90-13ac63be2523 None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:11.648098 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a7e2e-cd72-48ca-8d90-13ac63be2523 None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:11.649716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a7e2e-cd72-48ca-8d90-13ac63be2523 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:11.651966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 105/203] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:11 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:11.652817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a7e2e-cd72-48ca-8d90-13ac63be2523 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:11.696581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c72981-569f-4212-ad1a-58fde668d5af None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:11.732330 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee865d32-084c-4dbe-a971-a6ca8e33c2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:11.732975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee865d32-084c-4dbe-a971-a6ca8e33c2bf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:11.733366 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee865d32-084c-4dbe-a971-a6ca8e33c2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:11.733644 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee865d32-084c-4dbe-a971-a6ca8e33c2bf None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:11.735658 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee865d32-084c-4dbe-a971-a6ca8e33c2bf None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:11.737095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee865d32-084c-4dbe-a971-a6ca8e33c2bf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:11.738962 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 99/204] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:11 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:11.739650 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee865d32-084c-4dbe-a971-a6ca8e33c2bf None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:11.768933 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a7e2e-cd72-48ca-8d90-13ac63be2523 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:11.787109 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:11.797108 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:11.811413 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae72675-28b7-430c-a3dc-690f888e7dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:11.812517 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae72675-28b7-430c-a3dc-690f888e7dfc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:11.813019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae72675-28b7-430c-a3dc-690f888e7dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:11.813520 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae72675-28b7-430c-a3dc-690f888e7dfc None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:11.814936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae72675-28b7-430c-a3dc-690f888e7dfc None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:11.816732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae72675-28b7-430c-a3dc-690f888e7dfc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:11.818770 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 106/205] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:11 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:11.819918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae72675-28b7-430c-a3dc-690f888e7dfc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:11.853575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee865d32-084c-4dbe-a971-a6ca8e33c2bf None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:11.897095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7516c6f-7c73-42fc-81c6-fe81f8a3debe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:11.898171 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7516c6f-7c73-42fc-81c6-fe81f8a3debe None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:11.898171 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7516c6f-7c73-42fc-81c6-fe81f8a3debe None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:11.898379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7516c6f-7c73-42fc-81c6-fe81f8a3debe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:11.899136 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7516c6f-7c73-42fc-81c6-fe81f8a3debe None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651, user.id=5efeda74a6bc42858fc3b6ae91036d93) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:11.899445 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7516c6f-7c73-42fc-81c6-fe81f8a3debe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:11.900910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7516c6f-7c73-42fc-81c6-fe81f8a3debe None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:11.909467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 100/206] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:09:11 2022] GET /identity/v3/role_assignments?user.id=5efeda74a6bc42858fc3b6ae91036d93&scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:11.910437 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7516c6f-7c73-42fc-81c6-fe81f8a3debe None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:11.944163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae72675-28b7-430c-a3dc-690f888e7dfc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:11.987489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506d915-b76a-4111-a096-83681543d58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:11.988640 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506d915-b76a-4111-a096-83681543d58b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:11.989174 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506d915-b76a-4111-a096-83681543d58b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:11.989647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506d915-b76a-4111-a096-83681543d58b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:11.990635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506d915-b76a-4111-a096-83681543d58b None admin] RBAC: Adding query filter params (role.id=fe20f96b39034b82ae491a24ebbda3b4, scope.project.id=2accefb496f94595afbc2ab6be270cae, user.id=6581079242234b1ba0bb8355a6177a87) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:11.991151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506d915-b76a-4111-a096-83681543d58b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:11.992904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506d915-b76a-4111-a096-83681543d58b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:12.000689 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 107/207] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:09:11 2022] GET /identity/v3/role_assignments?user.id=6581079242234b1ba0bb8355a6177a87&scope.project.id=2accefb496f94595afbc2ab6be270cae&role.id=fe20f96b39034b82ae491a24ebbda3b4 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:12.057512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7516c6f-7c73-42fc-81c6-fe81f8a3debe None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:12.073961 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:12.110598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e13564-71a7-4af3-aba4-498ecb4092e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:12.111240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e13564-71a7-4af3-aba4-498ecb4092e6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:12.111521 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e13564-71a7-4af3-aba4-498ecb4092e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:12.111793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e13564-71a7-4af3-aba4-498ecb4092e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:12.112535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e13564-71a7-4af3-aba4-498ecb4092e6 None admin] RBAC: Adding query filter params (role.id=acaa0e7c8246470aa47504d9bc3ae56f, scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651, user.id=5efeda74a6bc42858fc3b6ae91036d93) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:12.112840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e13564-71a7-4af3-aba4-498ecb4092e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:12.114336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e13564-71a7-4af3-aba4-498ecb4092e6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:12.120988 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 101/208] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:09:11 2022] GET /identity/v3/role_assignments?user.id=5efeda74a6bc42858fc3b6ae91036d93&scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651&role.id=acaa0e7c8246470aa47504d9bc3ae56f => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:13.309065 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022ede6-6135-4b18-a6bf-9a02412ec0ea None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:13.310151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022ede6-6135-4b18-a6bf-9a02412ec0ea None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:13.310678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022ede6-6135-4b18-a6bf-9a02412ec0ea None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:13.312432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 108/209] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:13.318770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74096e-7455-46dc-b012-7947973524b8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:13.319739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74096e-7455-46dc-b012-7947973524b8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:13.320229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74096e-7455-46dc-b012-7947973524b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:13.341474 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0e74096e-7455-46dc-b012-7947973524b8 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:13.343074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0e74096e-7455-46dc-b012-7947973524b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:13.415489 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 102/210] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:13.434489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3607b1-410f-40d3-a254-32a60530861e None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:13.434778 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3607b1-410f-40d3-a254-32a60530861e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:13.435074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3607b1-410f-40d3-a254-32a60530861e None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:13.436696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 109/211] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:13.442028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20b05c-9569-40d5-a51a-9c0963554010 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:13.442546 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20b05c-9569-40d5-a51a-9c0963554010 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:13.443063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20b05c-9569-40d5-a51a-9c0963554010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:13.462474 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ac20b05c-9569-40d5-a51a-9c0963554010 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:13.464055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ac20b05c-9569-40d5-a51a-9c0963554010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:13.537715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 103/212] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:13.698775 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3607b1-410f-40d3-a254-32a60530861e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:13.748802 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:13.810961 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3607b1-410f-40d3-a254-32a60530861e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:13.815935 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20b05c-9569-40d5-a51a-9c0963554010 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:13.850013 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c9bf0-c72d-4965-826b-76fb76521c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:13.851042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c9bf0-c72d-4965-826b-76fb76521c9a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:13.851512 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c9bf0-c72d-4965-826b-76fb76521c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:13.851973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c9bf0-c72d-4965-826b-76fb76521c9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:13.861036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:13.865023 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c9bf0-c72d-4965-826b-76fb76521c9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:13.871295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-b03c9bf0-c72d-4965-826b-76fb76521c9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:13.871295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:13.871295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:13.871295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:13.871295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:13.871295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:13.871295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:13.871295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:13.871295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:13.871295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:13.871295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:13.871295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:13.871295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:13.871295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:13.871295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:13.871295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:13.874477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:13.874477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:13.874477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:13.874477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:13.874477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:13.874477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:13.874477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:13.874477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:13.874477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:13.874477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:13.874477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:13.874477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:13.874477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:13.874477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:13.874477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:13.874477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:13.875788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:13.875788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:13.875788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:13.875788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:13.875788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:13.875788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:13.875788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:13.875788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:13.875788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:13.875788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:13.875788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:13.875788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:13.875788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 110/213] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:13.880698 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c9bf0-c72d-4965-826b-76fb76521c9a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:13.934962 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20b05c-9569-40d5-a51a-9c0963554010 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:13.992595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8f7d4-da7f-461e-9431-c8ee138796d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:13.993635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8f7d4-da7f-461e-9431-c8ee138796d0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:13.994212 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8f7d4-da7f-461e-9431-c8ee138796d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:13.994672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8f7d4-da7f-461e-9431-c8ee138796d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:13.996284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8f7d4-da7f-461e-9431-c8ee138796d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:13.998507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8f7d4-da7f-461e-9431-c8ee138796d0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:14.005016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 104/214] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:14.006604 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8f7d4-da7f-461e-9431-c8ee138796d0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:14.006784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c9bf0-c72d-4965-826b-76fb76521c9a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:14.014043 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:14.042626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2582c-6e57-48c7-8c3f-58ac78ebd0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:14.043338 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2582c-6e57-48c7-8c3f-58ac78ebd0ae None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:14.043760 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2582c-6e57-48c7-8c3f-58ac78ebd0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:14.043949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2582c-6e57-48c7-8c3f-58ac78ebd0ae None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:14.044880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2582c-6e57-48c7-8c3f-58ac78ebd0ae None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:14.045185 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2582c-6e57-48c7-8c3f-58ac78ebd0ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:14.046655 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2582c-6e57-48c7-8c3f-58ac78ebd0ae None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:14.061306 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 111/215] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:14.063244 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2582c-6e57-48c7-8c3f-58ac78ebd0ae None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:14.120371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8f7d4-da7f-461e-9431-c8ee138796d0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:14.130278 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:14.161537 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97fa90-51e8-4421-8ea5-2f79ef7b965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:14.162244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97fa90-51e8-4421-8ea5-2f79ef7b965c None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:14.162614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97fa90-51e8-4421-8ea5-2f79ef7b965c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:14.162998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97fa90-51e8-4421-8ea5-2f79ef7b965c None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:14.163746 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97fa90-51e8-4421-8ea5-2f79ef7b965c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:14.165269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97fa90-51e8-4421-8ea5-2f79ef7b965c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:14.174376 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2582c-6e57-48c7-8c3f-58ac78ebd0ae None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:14.211603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8274e07-2e74-482d-9567-f1fcbdbbbcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:14.212203 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8274e07-2e74-482d-9567-f1fcbdbbbcac None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:14.212477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8274e07-2e74-482d-9567-f1fcbdbbbcac None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:14.212746 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8274e07-2e74-482d-9567-f1fcbdbbbcac None admin] PATH_INFO: `/v3/users/61d835d4d2a04485a0795ad90ce9ecde` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:14.228447 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8274e07-2e74-482d-9567-f1fcbdbbbcac None admin] RBAC: Authorizing `identity:get_user(user_id=61d835d4d2a04485a0795ad90ce9ecde)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:14.229881 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8274e07-2e74-482d-9567-f1fcbdbbbcac None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:14.231820 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 112/216] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:14 2022] GET /identity/v3/users/61d835d4d2a04485a0795ad90ce9ecde => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:14.237952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8274e07-2e74-482d-9567-f1fcbdbbbcac None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:14.265575 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:14.314492 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 105/217] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:09:14 2022] POST /identity/v3/users => generated 297 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:09:14.315969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da51f3-da2e-42d9-813f-d7b8cb8c8b88 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:14.316620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da51f3-da2e-42d9-813f-d7b8cb8c8b88 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:14.316620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da51f3-da2e-42d9-813f-d7b8cb8c8b88 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:14.318039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 106/218] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:14.326619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e527fac-3a45-4e94-960f-79b7b075fe50 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:14.327302 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e527fac-3a45-4e94-960f-79b7b075fe50 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:14.327302 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e527fac-3a45-4e94-960f-79b7b075fe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:14.353335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9e527fac-3a45-4e94-960f-79b7b075fe50 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:14.354655 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8274e07-2e74-482d-9567-f1fcbdbbbcac None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:14.355140 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9e527fac-3a45-4e94-960f-79b7b075fe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:14.407045 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8174b0-4283-43cb-afef-8cbfdec1400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:14.408028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8174b0-4283-43cb-afef-8cbfdec1400a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:14.408445 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8174b0-4283-43cb-afef-8cbfdec1400a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:14.408850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8174b0-4283-43cb-afef-8cbfdec1400a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:14.458162 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 107/219] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:09:14.475440 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afe218-6c14-4d97-9dfc-f10b5c23e0ab None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:14.475752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afe218-6c14-4d97-9dfc-f10b5c23e0ab None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:14.475997 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afe218-6c14-4d97-9dfc-f10b5c23e0ab None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:14.477668 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 108/220] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:09:14.483296 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1eb04a-6b64-4269-86ad-852074b9df84 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:14.483555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1eb04a-6b64-4269-86ad-852074b9df84 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:14.483774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1eb04a-6b64-4269-86ad-852074b9df84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:14.493332 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8174b0-4283-43cb-afef-8cbfdec1400a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:14.495029 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8174b0-4283-43cb-afef-8cbfdec1400a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:14.504320 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1b1eb04a-6b64-4269-86ad-852074b9df84 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:14.505519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1b1eb04a-6b64-4269-86ad-852074b9df84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:14.526836 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:14.605254 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 109/221] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:09:14.621019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 113/222] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:14.627189 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1eb04a-6b64-4269-86ad-852074b9df84 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:14.656652 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:14.735324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8174b0-4283-43cb-afef-8cbfdec1400a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:14.743348 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1eb04a-6b64-4269-86ad-852074b9df84 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:14.784232 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c776dcc-dae1-4d8d-8db8-c7127839cce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:14.785246 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c776dcc-dae1-4d8d-8db8-c7127839cce5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:14.785718 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c776dcc-dae1-4d8d-8db8-c7127839cce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:14.786238 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c776dcc-dae1-4d8d-8db8-c7127839cce5 None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:14.787649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c776dcc-dae1-4d8d-8db8-c7127839cce5 None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:14.789298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c776dcc-dae1-4d8d-8db8-c7127839cce5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:14.791190 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 110/223] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:14 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:14.798147 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c776dcc-dae1-4d8d-8db8-c7127839cce5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:14.872289 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8174b0-4283-43cb-afef-8cbfdec1400a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:14.910100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:14.912757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:14.919978 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c776dcc-dae1-4d8d-8db8-c7127839cce5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:14.925009 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d4ec5-6d93-40c8-945c-178bdae6def7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:14.925658 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d4ec5-6d93-40c8-945c-178bdae6def7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:14.925965 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d4ec5-6d93-40c8-945c-178bdae6def7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:14.926239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d4ec5-6d93-40c8-945c-178bdae6def7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:14.939987 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d4ec5-6d93-40c8-945c-178bdae6def7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:14.946573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-cf4d4ec5-6d93-40c8-945c-178bdae6def7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:09:14.946573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:14.946573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:14.946573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:14.946573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:14.946573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:14.946573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:14.946573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:14.946573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:14.946573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:14.946573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:14.946573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:14.946573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:14.946573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:14.946573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:14.946573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:14.947478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:14.947478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:14.947478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:14.947478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:14.947478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:14.947478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:14.947478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:14.947478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:14.947478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:14.947478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:14.947478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:14.947478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:14.947478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:14.947478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:14.947478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:14.947478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:14.948253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:14.948253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:14.948253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:14.948253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:14.948253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:14.948253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:14.948253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:14.948253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:14.948253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:14.948253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:14.948253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:09:14.948253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:14.948856 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 114/224] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:09:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:14.952661 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d4ec5-6d93-40c8-945c-178bdae6def7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:14.957782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d643f-d251-4bab-ac73-e35ffcaea48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:14.958487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d643f-d251-4bab-ac73-e35ffcaea48b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:14.958767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d643f-d251-4bab-ac73-e35ffcaea48b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:14.962847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d643f-d251-4bab-ac73-e35ffcaea48b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:14.962847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d643f-d251-4bab-ac73-e35ffcaea48b None admin] RBAC: Adding query filter params (role.id=c18fbe0604b34383a2725a382d77d618, scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651, user.id=61d835d4d2a04485a0795ad90ce9ecde) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:14.962847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d643f-d251-4bab-ac73-e35ffcaea48b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:14.962847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d643f-d251-4bab-ac73-e35ffcaea48b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:14.973802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 111/225] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:09:14 2022] GET /identity/v3/role_assignments?user.id=61d835d4d2a04485a0795ad90ce9ecde&scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651&role.id=c18fbe0604b34383a2725a382d77d618 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:14.973802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d643f-d251-4bab-ac73-e35ffcaea48b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:15.118534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d643f-d251-4bab-ac73-e35ffcaea48b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:15.184599 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d4ec5-6d93-40c8-945c-178bdae6def7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:15.188877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb040c-d5ae-459c-9517-485db113612d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:15.189507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb040c-d5ae-459c-9517-485db113612d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:15.189805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb040c-d5ae-459c-9517-485db113612d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:15.190078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb040c-d5ae-459c-9517-485db113612d None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:15.190830 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb040c-d5ae-459c-9517-485db113612d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:15.191132 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb040c-d5ae-459c-9517-485db113612d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:15.193445 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb040c-d5ae-459c-9517-485db113612d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:15.212173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 112/226] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:15.218349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb040c-d5ae-459c-9517-485db113612d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:15.247670 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:15.256565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3709e44-01a2-4d50-8aa8-ec8201f9ac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:15.257216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3709e44-01a2-4d50-8aa8-ec8201f9ac57 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:15.261825 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3709e44-01a2-4d50-8aa8-ec8201f9ac57 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:15.261825 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3709e44-01a2-4d50-8aa8-ec8201f9ac57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:15.282243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3709e44-01a2-4d50-8aa8-ec8201f9ac57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:15.288977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-f3709e44-01a2-4d50-8aa8-ec8201f9ac57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:15.288977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:15.288977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:15.288977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:15.288977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:15.288977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:15.288977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:15.288977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:15.288977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:15.288977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:15.288977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:15.288977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:15.288977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:15.288977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:15.288977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:15.288977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:15.289939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:15.289939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:15.289939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:15.289939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:15.289939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:15.289939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:15.289939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:15.289939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:15.289939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:15.289939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:15.289939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:15.289939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:15.289939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:15.289939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:15.289939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:15.289939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:15.292112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:15.292112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:15.292112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:15.292112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:15.292112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:15.292112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:15.292112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:15.292112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:15.292112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:15.292112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:15.292112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:15.292112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:15.292112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 115/227] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:09:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:15.300842 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3709e44-01a2-4d50-8aa8-ec8201f9ac57 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:15.396044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:15.398784 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb040c-d5ae-459c-9517-485db113612d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:15.473349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3356a-ba4d-4b4b-b441-7eff8495fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:15.474021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3356a-ba4d-4b4b-b441-7eff8495fff1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:15.474299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3356a-ba4d-4b4b-b441-7eff8495fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:15.474631 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3356a-ba4d-4b4b-b441-7eff8495fff1 None admin] PATH_INFO: `/v3/users/5efeda74a6bc42858fc3b6ae91036d93` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:15.475860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3356a-ba4d-4b4b-b441-7eff8495fff1 None admin] RBAC: Authorizing `identity:get_user(user_id=5efeda74a6bc42858fc3b6ae91036d93)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:15.477308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3356a-ba4d-4b4b-b441-7eff8495fff1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:15.479428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 113/228] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:15 2022] GET /identity/v3/users/5efeda74a6bc42858fc3b6ae91036d93 => generated 283 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:15.485603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3356a-ba4d-4b4b-b441-7eff8495fff1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:15.500785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3709e44-01a2-4d50-8aa8-ec8201f9ac57 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:15.565113 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f64ca-20cd-4ec3-ba42-e99979900795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:15.565745 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f64ca-20cd-4ec3-ba42-e99979900795 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:15.566024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f64ca-20cd-4ec3-ba42-e99979900795 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:15.566293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f64ca-20cd-4ec3-ba42-e99979900795 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:15.567047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f64ca-20cd-4ec3-ba42-e99979900795 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:15.567347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f64ca-20cd-4ec3-ba42-e99979900795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:15.568743 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f64ca-20cd-4ec3-ba42-e99979900795 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:15.583911 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 116/229] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:09:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:15.589763 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f64ca-20cd-4ec3-ba42-e99979900795 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:15.654652 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:15.687678 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3356a-ba4d-4b4b-b441-7eff8495fff1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:15.744451 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b80d4d-4442-430c-9951-8fd293b9b9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:15.745143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b80d4d-4442-430c-9951-8fd293b9b9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:15.745432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b80d4d-4442-430c-9951-8fd293b9b9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:15.745708 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b80d4d-4442-430c-9951-8fd293b9b9d8 None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:15.746923 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b80d4d-4442-430c-9951-8fd293b9b9d8 None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:15.748377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b80d4d-4442-430c-9951-8fd293b9b9d8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:15.750414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 114/230] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:15 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:15.755722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b80d4d-4442-430c-9951-8fd293b9b9d8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:15.759148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f64ca-20cd-4ec3-ba42-e99979900795 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:15.781559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:15.839056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f61f16-3e86-401f-96d3-3d6188f511f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:15.839703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f61f16-3e86-401f-96d3-3d6188f511f7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:15.839984 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f61f16-3e86-401f-96d3-3d6188f511f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:15.840261 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f61f16-3e86-401f-96d3-3d6188f511f7 None admin] PATH_INFO: `/v3/users/5efeda74a6bc42858fc3b6ae91036d93` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:15.841461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f61f16-3e86-401f-96d3-3d6188f511f7 None admin] RBAC: Authorizing `identity:get_user(user_id=5efeda74a6bc42858fc3b6ae91036d93)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:15.844676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f61f16-3e86-401f-96d3-3d6188f511f7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:15.849127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 117/231] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:15 2022] GET /identity/v3/users/5efeda74a6bc42858fc3b6ae91036d93 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:15.854721 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f61f16-3e86-401f-96d3-3d6188f511f7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:15.917372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b80d4d-4442-430c-9951-8fd293b9b9d8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:15.961543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4275882-e6f8-4dca-9b7b-2553996cb629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:15.962262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4275882-e6f8-4dca-9b7b-2553996cb629 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:15.962548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4275882-e6f8-4dca-9b7b-2553996cb629 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:15.962823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4275882-e6f8-4dca-9b7b-2553996cb629 None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651/users/5efeda74a6bc42858fc3b6ae91036d93/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:15.964941 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4275882-e6f8-4dca-9b7b-2553996cb629 None admin] RBAC: Authorizing `identity:create_grant(project_id=04ee7300c1d74f5bbe668c0fa5c4e651, user_id=5efeda74a6bc42858fc3b6ae91036d93, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:15.967186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4275882-e6f8-4dca-9b7b-2553996cb629 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:16.050951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f61f16-3e86-401f-96d3-3d6188f511f7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:16.063191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 115/232] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:09:15 2022] PUT /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651/users/5efeda74a6bc42858fc3b6ae91036d93/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:09:16.107178 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb5968-6a19-48a3-998a-dd35e0208893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:16.107848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb5968-6a19-48a3-998a-dd35e0208893 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:16.108129 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb5968-6a19-48a3-998a-dd35e0208893 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:16.108403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb5968-6a19-48a3-998a-dd35e0208893 None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:16.109709 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb5968-6a19-48a3-998a-dd35e0208893 None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:16.111258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb5968-6a19-48a3-998a-dd35e0208893 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:16.113449 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 118/233] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:15 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:16.119449 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4275882-e6f8-4dca-9b7b-2553996cb629 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:16.141329 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:16.259242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4275882-e6f8-4dca-9b7b-2553996cb629 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:16.307318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a37f74-b719-4b64-8259-36cc87428291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:16.308002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37f74-b719-4b64-8259-36cc87428291 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:16.308277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37f74-b719-4b64-8259-36cc87428291 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:16.308550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37f74-b719-4b64-8259-36cc87428291 None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651/users/5efeda74a6bc42858fc3b6ae91036d93/roles/acaa0e7c8246470aa47504d9bc3ae56f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:16.310879 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a37f74-b719-4b64-8259-36cc87428291 None admin] RBAC: Authorizing `identity:create_grant(project_id=04ee7300c1d74f5bbe668c0fa5c4e651, user_id=5efeda74a6bc42858fc3b6ae91036d93, role_id=acaa0e7c8246470aa47504d9bc3ae56f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:16.312870 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a37f74-b719-4b64-8259-36cc87428291 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:16.416699 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 116/234] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:09:16 2022] PUT /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651/users/5efeda74a6bc42858fc3b6ae91036d93/roles/acaa0e7c8246470aa47504d9bc3ae56f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:09:17.012421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae7a3e-678c-4276-8fe0-e7fcff1fec9f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:17.013074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae7a3e-678c-4276-8fe0-e7fcff1fec9f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:17.013074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae7a3e-678c-4276-8fe0-e7fcff1fec9f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:17.014508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 119/235] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:17.020042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e42f7-5d90-4cb5-b951-3a4aa207518a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:17.020323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e42f7-5d90-4cb5-b951-3a4aa207518a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:17.020593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e42f7-5d90-4cb5-b951-3a4aa207518a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:17.047480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b47e42f7-5d90-4cb5-b951-3a4aa207518a None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:17.048702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b47e42f7-5d90-4cb5-b951-3a4aa207518a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:17.136287 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 117/236] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:17.204217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0bd06-6431-4f62-b194-2d21c7f6c66e None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:17.204550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0bd06-6431-4f62-b194-2d21c7f6c66e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:17.204757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0bd06-6431-4f62-b194-2d21c7f6c66e None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:17.206169 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 120/237] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:17.225394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f582d-d392-42b9-b9c8-ce896a5bd50c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:17.225675 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f582d-d392-42b9-b9c8-ce896a5bd50c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:17.225909 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f582d-d392-42b9-b9c8-ce896a5bd50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:17.236685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:17.254736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9a5f582d-d392-42b9-b9c8-ce896a5bd50c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:17.256013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9a5f582d-d392-42b9-b9c8-ce896a5bd50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:17.355226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 118/238] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:17.446428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0bd06-6431-4f62-b194-2d21c7f6c66e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:17.511951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:17.585185 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0bd06-6431-4f62-b194-2d21c7f6c66e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:17.630731 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4517e5-007e-491b-a8e3-fd39daa1de19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:17.631393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4517e5-007e-491b-a8e3-fd39daa1de19 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:17.631662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4517e5-007e-491b-a8e3-fd39daa1de19 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:17.631934 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4517e5-007e-491b-a8e3-fd39daa1de19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:17.633175 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4517e5-007e-491b-a8e3-fd39daa1de19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:17.634714 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4517e5-007e-491b-a8e3-fd39daa1de19 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:17.636774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 121/239] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:17.643241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f582d-d392-42b9-b9c8-ce896a5bd50c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:17.699579 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4517e5-007e-491b-a8e3-fd39daa1de19 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:17.765549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f582d-d392-42b9-b9c8-ce896a5bd50c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:17.801095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:17.806201 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664b306-60b2-47fe-93aa-bcd2ed4c43a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:17.806804 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664b306-60b2-47fe-93aa-bcd2ed4c43a4 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:17.807098 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664b306-60b2-47fe-93aa-bcd2ed4c43a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:17.807496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664b306-60b2-47fe-93aa-bcd2ed4c43a4 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:17.808144 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664b306-60b2-47fe-93aa-bcd2ed4c43a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:17.810328 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664b306-60b2-47fe-93aa-bcd2ed4c43a4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:17.849713 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4517e5-007e-491b-a8e3-fd39daa1de19 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:17.863221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:17.884005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f30aca-be9e-400b-a51a-75904e44c9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:17.884624 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f30aca-be9e-400b-a51a-75904e44c9ce None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:17.884940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f30aca-be9e-400b-a51a-75904e44c9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:17.885161 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f30aca-be9e-400b-a51a-75904e44c9ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:17.896429 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f30aca-be9e-400b-a51a-75904e44c9ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:17.901508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-35f30aca-be9e-400b-a51a-75904e44c9ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:09:17.901508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:17.901508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:17.901508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:17.901508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:17.901508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:17.901508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:17.901508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:17.901508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:17.901508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:17.901508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:17.901508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:17.901508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:17.901508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:17.901508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:17.901508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:17.902410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:17.902410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:17.902410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:17.902410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:17.902410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:17.902410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:17.902410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:17.902410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:17.902410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:17.902410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:17.902410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:17.902410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:17.902410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:17.902410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:17.902410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:17.902410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:17.903195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:17.903195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:17.903195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:17.903195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:17.903195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:17.903195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:17.903195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:17.903195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:17.903195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:17.903195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:17.903195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:09:17.903195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:17.903195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 122/240] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:09:17.903858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a447b17-3a44-4e1d-b7b2-47816c6bd289 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:17.904645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a447b17-3a44-4e1d-b7b2-47816c6bd289 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:17.904645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a447b17-3a44-4e1d-b7b2-47816c6bd289 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:17.905809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 123/241] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:17.910875 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a447b17-3a44-4e1d-b7b2-47816c6bd289 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:17.915726 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 119/242] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:09:17 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:09:17.917295 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348198e4-ebaf-4fda-95c7-245afb75425e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:17.917849 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348198e4-ebaf-4fda-95c7-245afb75425e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:17.918360 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348198e4-ebaf-4fda-95c7-245afb75425e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:17.939845 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-348198e4-ebaf-4fda-95c7-245afb75425e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:17.941664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-348198e4-ebaf-4fda-95c7-245afb75425e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:18.099043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 120/243] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:18.123746 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a447b17-3a44-4e1d-b7b2-47816c6bd289 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:18.163018 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15383eb7-bf2b-4cea-9d9c-0419ddfb9ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:18.163993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15383eb7-bf2b-4cea-9d9c-0419ddfb9ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:18.164544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15383eb7-bf2b-4cea-9d9c-0419ddfb9ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:18.165034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15383eb7-bf2b-4cea-9d9c-0419ddfb9ac4 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:18.166055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15383eb7-bf2b-4cea-9d9c-0419ddfb9ac4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:18.166557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15383eb7-bf2b-4cea-9d9c-0419ddfb9ac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:18.168291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15383eb7-bf2b-4cea-9d9c-0419ddfb9ac4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:18.179557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 124/244] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:18.187132 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348198e4-ebaf-4fda-95c7-245afb75425e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:18.290321 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348198e4-ebaf-4fda-95c7-245afb75425e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:18.309999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:18.327649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05ee97-05b3-48b1-a837-160da268ae39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:18.328309 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05ee97-05b3-48b1-a837-160da268ae39 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:18.328581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05ee97-05b3-48b1-a837-160da268ae39 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:18.328849 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05ee97-05b3-48b1-a837-160da268ae39 None admin] PATH_INFO: `/v3/users/a09354953983401d8b78aa5d8371322a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:18.346705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05ee97-05b3-48b1-a837-160da268ae39 None admin] RBAC: Authorizing `identity:get_user(user_id=a09354953983401d8b78aa5d8371322a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:18.348706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05ee97-05b3-48b1-a837-160da268ae39 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:18.351229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 121/245] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:18 2022] GET /identity/v3/users/a09354953983401d8b78aa5d8371322a => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:18.358918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15383eb7-bf2b-4cea-9d9c-0419ddfb9ac4 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:18.397171 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:18.452514 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05ee97-05b3-48b1-a837-160da268ae39 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:18.477408 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15383eb7-bf2b-4cea-9d9c-0419ddfb9ac4 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:18.527781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1579c3-46f4-45b7-8ce5-9d24f62af1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:18.528410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1579c3-46f4-45b7-8ce5-9d24f62af1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:18.528691 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1579c3-46f4-45b7-8ce5-9d24f62af1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:18.528967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1579c3-46f4-45b7-8ce5-9d24f62af1d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:18.601218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05ee97-05b3-48b1-a837-160da268ae39 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:18.629380 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1579c3-46f4-45b7-8ce5-9d24f62af1d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:18.631100 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1579c3-46f4-45b7-8ce5-9d24f62af1d8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:18.650834 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab4e30-dd18-4eaa-9814-9d796cbeaaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:18.652586 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab4e30-dd18-4eaa-9814-9d796cbeaaa3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:18.653273 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab4e30-dd18-4eaa-9814-9d796cbeaaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:18.653692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab4e30-dd18-4eaa-9814-9d796cbeaaa3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:18.667381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab4e30-dd18-4eaa-9814-9d796cbeaaa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:18.674964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-f2ab4e30-dd18-4eaa-9814-9d796cbeaaa3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:18.674964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:18.674964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:18.674964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:18.674964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:18.674964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:18.674964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:18.674964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:18.674964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:18.674964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:18.674964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:18.674964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:18.674964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:18.674964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:18.674964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:18.674964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:18.675882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:18.675882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:18.675882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:18.675882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:18.675882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:18.675882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:18.675882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:18.675882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:18.675882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:18.675882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:18.675882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:18.675882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:18.675882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:18.675882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:18.675882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:18.675882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:18.676739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:18.676739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:18.676739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:18.676739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:18.676739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:18.676739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:18.676739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:18.676739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:18.676739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:18.676739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:18.676739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:18.676739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:18.684240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:18.684464 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 122/246] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:09:18.686613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab4e30-dd18-4eaa-9814-9d796cbeaaa3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:18.730199 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:18.764843 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 125/247] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:18.766861 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604115a7-dae1-488d-bc1e-16078d6468ed None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:18.767247 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604115a7-dae1-488d-bc1e-16078d6468ed None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:18.767604 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604115a7-dae1-488d-bc1e-16078d6468ed None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:18.769071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 126/248] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:18.774036 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604115a7-dae1-488d-bc1e-16078d6468ed None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:18.811750 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab4e30-dd18-4eaa-9814-9d796cbeaaa3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:18.855618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e04b42-2994-48cc-a90b-729e27b4905d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:18.856466 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e04b42-2994-48cc-a90b-729e27b4905d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:18.856889 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e04b42-2994-48cc-a90b-729e27b4905d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:18.857327 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e04b42-2994-48cc-a90b-729e27b4905d None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:18.858168 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e04b42-2994-48cc-a90b-729e27b4905d None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:18.858610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e04b42-2994-48cc-a90b-729e27b4905d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:18.860693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e04b42-2994-48cc-a90b-729e27b4905d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:18.875853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 123/249] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:18.877451 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3b11-9f1c-4156-b5f2-91d15b072247 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:18.877913 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3b11-9f1c-4156-b5f2-91d15b072247 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:18.878357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3b11-9f1c-4156-b5f2-91d15b072247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:18.890346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604115a7-dae1-488d-bc1e-16078d6468ed None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:18.901097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4f6b3b11-9f1c-4156-b5f2-91d15b072247 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:18.902676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4f6b3b11-9f1c-4156-b5f2-91d15b072247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:18.932104 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452cf6b-cf3d-46eb-80e9-2ffef92ff41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:18.932924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452cf6b-cf3d-46eb-80e9-2ffef92ff41a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:18.933427 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452cf6b-cf3d-46eb-80e9-2ffef92ff41a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:18.933642 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452cf6b-cf3d-46eb-80e9-2ffef92ff41a None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:18.935019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452cf6b-cf3d-46eb-80e9-2ffef92ff41a None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:18.936807 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452cf6b-cf3d-46eb-80e9-2ffef92ff41a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:18.939593 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 127/250] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:18 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:18.940489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452cf6b-cf3d-46eb-80e9-2ffef92ff41a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:18.944214 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:18.986182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 124/251] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:18.987509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b3b11-9f1c-4156-b5f2-91d15b072247 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:19.019915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:19.101752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b3b11-9f1c-4156-b5f2-91d15b072247 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:19.103879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452cf6b-cf3d-46eb-80e9-2ffef92ff41a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:19.138323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bda5d-c388-471b-8ec2-dd73414d038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:19.139234 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bda5d-c388-471b-8ec2-dd73414d038d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:19.139687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bda5d-c388-471b-8ec2-dd73414d038d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:19.140137 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bda5d-c388-471b-8ec2-dd73414d038d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:19.141298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7bda5d-c388-471b-8ec2-dd73414d038d None admin] RBAC: Adding query filter params (role.id=fe20f96b39034b82ae491a24ebbda3b4, scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651, user.id=a09354953983401d8b78aa5d8371322a) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:19.141833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7bda5d-c388-471b-8ec2-dd73414d038d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:19.143448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7bda5d-c388-471b-8ec2-dd73414d038d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:19.149453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 125/252] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:09:18 2022] GET /identity/v3/role_assignments?user.id=a09354953983401d8b78aa5d8371322a&scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651&role.id=fe20f96b39034b82ae491a24ebbda3b4 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:19.170629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c2098-6da0-48e5-bb61-979eba77bdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:19.172577 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c2098-6da0-48e5-bb61-979eba77bdab None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:19.173113 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c2098-6da0-48e5-bb61-979eba77bdab None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:19.173566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c2098-6da0-48e5-bb61-979eba77bdab None admin] PATH_INFO: `/v3/users/61d835d4d2a04485a0795ad90ce9ecde` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:19.179207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c2098-6da0-48e5-bb61-979eba77bdab None admin] RBAC: Authorizing `identity:get_user(user_id=61d835d4d2a04485a0795ad90ce9ecde)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:19.180941 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c2098-6da0-48e5-bb61-979eba77bdab None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:19.183101 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 128/253] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:18 2022] GET /identity/v3/users/61d835d4d2a04485a0795ad90ce9ecde => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:19.189197 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bda5d-c388-471b-8ec2-dd73414d038d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:19.226560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc0816-7e8c-47e6-a864-0415981e677b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:19.227128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc0816-7e8c-47e6-a864-0415981e677b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:19.227579 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc0816-7e8c-47e6-a864-0415981e677b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:19.229144 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 129/254] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:09:19.239754 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40b4a7-41da-44e4-acef-f98f5aaefe34 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:19.240311 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40b4a7-41da-44e4-acef-f98f5aaefe34 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:19.240813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40b4a7-41da-44e4-acef-f98f5aaefe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:19.271540 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-dd40b4a7-41da-44e4-acef-f98f5aaefe34 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:19.277057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-dd40b4a7-41da-44e4-acef-f98f5aaefe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:19.386131 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:19.413489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:19.420605 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 130/255] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:09:19.423709 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bda5d-c388-471b-8ec2-dd73414d038d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:19.465441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675b389-0f28-431c-a753-c37a9c7ae6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:19.466116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675b389-0f28-431c-a753-c37a9c7ae6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:19.466380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675b389-0f28-431c-a753-c37a9c7ae6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:19.466648 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675b389-0f28-431c-a753-c37a9c7ae6b1 None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:19.467767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675b389-0f28-431c-a753-c37a9c7ae6b1 None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:19.469899 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675b389-0f28-431c-a753-c37a9c7ae6b1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:19.471839 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 126/256] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:19 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:19.477761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40b4a7-41da-44e4-acef-f98f5aaefe34 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:19.507845 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675b389-0f28-431c-a753-c37a9c7ae6b1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:19.645319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40b4a7-41da-44e4-acef-f98f5aaefe34 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:19.701590 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675b389-0f28-431c-a753-c37a9c7ae6b1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:19.732316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee0a0e-e4fd-4b5c-9cbe-1c6fd7988519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:19.732997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee0a0e-e4fd-4b5c-9cbe-1c6fd7988519 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:19.733281 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee0a0e-e4fd-4b5c-9cbe-1c6fd7988519 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:19.733554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee0a0e-e4fd-4b5c-9cbe-1c6fd7988519 None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651/users/61d835d4d2a04485a0795ad90ce9ecde/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:19.737497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee0a0e-e4fd-4b5c-9cbe-1c6fd7988519 None admin] RBAC: Authorizing `identity:create_grant(project_id=04ee7300c1d74f5bbe668c0fa5c4e651, user_id=61d835d4d2a04485a0795ad90ce9ecde, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:19.739000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee0a0e-e4fd-4b5c-9cbe-1c6fd7988519 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:19.780677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7661599-f57b-4c0c-a4e4-6d277a8bf6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:19.781434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7661599-f57b-4c0c-a4e4-6d277a8bf6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:19.782252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7661599-f57b-4c0c-a4e4-6d277a8bf6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:19.782524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7661599-f57b-4c0c-a4e4-6d277a8bf6f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:19.802695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7661599-f57b-4c0c-a4e4-6d277a8bf6f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:19.808152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-d7661599-f57b-4c0c-a4e4-6d277a8bf6f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:09:19.808152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:19.808152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:19.808152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:19.808152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:19.808152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:19.808152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:19.808152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:19.808152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:19.808152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:19.808152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:19.808152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:19.808152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:19.808152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:19.808152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:19.808152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:19.809081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:19.809081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:19.809081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:19.809081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:19.809081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:19.809081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:19.809081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:19.809081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:19.809081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:19.809081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:19.809081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:19.809081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:19.809081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:19.809081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:19.809081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:19.809081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:19.816118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:19.816118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:19.816118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:19.816118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:19.816118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:19.816118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:19.816118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:19.816118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:19.816118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:19.816118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:19.816118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:09:19.816118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:19.816118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 127/257] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:09:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:09:19.816118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7661599-f57b-4c0c-a4e4-6d277a8bf6f7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:19.840272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 131/258] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:09:19 2022] PUT /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651/users/61d835d4d2a04485a0795ad90ce9ecde/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:09:19.841367 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee0a0e-e4fd-4b5c-9cbe-1c6fd7988519 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:19.862763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:19.954420 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:20.043401 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7661599-f57b-4c0c-a4e4-6d277a8bf6f7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:20.064549 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee0a0e-e4fd-4b5c-9cbe-1c6fd7988519 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:20.125859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b76c1-715c-4fba-add1-9840ed04ae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:20.126571 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b76c1-715c-4fba-add1-9840ed04ae16 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:20.126883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b76c1-715c-4fba-add1-9840ed04ae16 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:20.127160 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b76c1-715c-4fba-add1-9840ed04ae16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:20.136595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec17cd5-66eb-4e3b-83c4-41e2faa12170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:20.137236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec17cd5-66eb-4e3b-83c4-41e2faa12170 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:20.137514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec17cd5-66eb-4e3b-83c4-41e2faa12170 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:20.137806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec17cd5-66eb-4e3b-83c4-41e2faa12170 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:20.138505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec17cd5-66eb-4e3b-83c4-41e2faa12170 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:20.138810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec17cd5-66eb-4e3b-83c4-41e2faa12170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:20.140302 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec17cd5-66eb-4e3b-83c4-41e2faa12170 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:20.153062 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b76c1-715c-4fba-add1-9840ed04ae16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:20.163472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 132/259] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:20.163663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a63b76c1-715c-4fba-add1-9840ed04ae16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:20.163663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:20.163663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:20.163663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:20.163663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:20.163663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:20.163663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:20.163663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:20.163663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:20.163663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:20.163663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:20.163663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:20.163663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:20.163663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:20.163663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:20.163663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:20.164501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:20.164501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:20.164501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:20.164501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:20.164501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:20.164501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:20.164501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:20.164501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:20.164501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:20.164501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:20.164501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:20.164501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:20.164501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:20.164501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:20.164501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:20.164501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:20.165307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:20.165307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:20.165307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:20.165307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:20.165307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:20.165307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:20.165307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:20.165307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:20.165307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:20.165307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:20.165307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:20.165307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:20.165307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 128/260] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:09:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:20.171112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec17cd5-66eb-4e3b-83c4-41e2faa12170 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:20.173019 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b76c1-715c-4fba-add1-9840ed04ae16 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:20.298183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec17cd5-66eb-4e3b-83c4-41e2faa12170 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:20.329700 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:20.342653 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fd571-b15d-46f3-a1d9-e1de8a4455f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:20.344933 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd571-b15d-46f3-a1d9-e1de8a4455f9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:20.345609 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd571-b15d-46f3-a1d9-e1de8a4455f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:20.346246 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd571-b15d-46f3-a1d9-e1de8a4455f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:20.347120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fd571-b15d-46f3-a1d9-e1de8a4455f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:20.347732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fd571-b15d-46f3-a1d9-e1de8a4455f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:20.349317 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fd571-b15d-46f3-a1d9-e1de8a4455f9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:20.359779 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 133/261] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:09:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:20.371207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fd571-b15d-46f3-a1d9-e1de8a4455f9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:20.379207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:20.420565 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b76c1-715c-4fba-add1-9840ed04ae16 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:20.502578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28889e-e6d9-4155-b4a9-ba94b71093cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:20.503348 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28889e-e6d9-4155-b4a9-ba94b71093cd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:20.503691 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28889e-e6d9-4155-b4a9-ba94b71093cd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:20.504032 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28889e-e6d9-4155-b4a9-ba94b71093cd None admin] PATH_INFO: `/v3/users/5efeda74a6bc42858fc3b6ae91036d93` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:20.507902 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28889e-e6d9-4155-b4a9-ba94b71093cd None admin] RBAC: Authorizing `identity:get_user(user_id=5efeda74a6bc42858fc3b6ae91036d93)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:20.509438 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28889e-e6d9-4155-b4a9-ba94b71093cd None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:20.511206 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 129/262] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:20 2022] GET /identity/v3/users/5efeda74a6bc42858fc3b6ae91036d93 => generated 283 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:20.518279 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28889e-e6d9-4155-b4a9-ba94b71093cd None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:20.521681 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fd571-b15d-46f3-a1d9-e1de8a4455f9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:20.564676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe63b-af50-46af-b782-8c0682b74a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:20.565588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe63b-af50-46af-b782-8c0682b74a9c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:20.566062 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe63b-af50-46af-b782-8c0682b74a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:20.566767 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe63b-af50-46af-b782-8c0682b74a9c None admin] PATH_INFO: `/v3/users/5efeda74a6bc42858fc3b6ae91036d93` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:20.568372 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefe63b-af50-46af-b782-8c0682b74a9c None admin] RBAC: Authorizing `identity:get_user(user_id=5efeda74a6bc42858fc3b6ae91036d93)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:20.570786 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefe63b-af50-46af-b782-8c0682b74a9c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:20.573190 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 134/263] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:20 2022] GET /identity/v3/users/5efeda74a6bc42858fc3b6ae91036d93 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:20.582622 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe63b-af50-46af-b782-8c0682b74a9c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:20.649355 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:20.744129 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe63b-af50-46af-b782-8c0682b74a9c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:20.744636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28889e-e6d9-4155-b4a9-ba94b71093cd None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:20.806957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf67dc-9510-4d30-b59d-8762cee749ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:20.807883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf67dc-9510-4d30-b59d-8762cee749ee None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:20.808364 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf67dc-9510-4d30-b59d-8762cee749ee None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:20.808809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf67dc-9510-4d30-b59d-8762cee749ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:20.839830 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345917c-f90f-4ea5-881b-8f925aa5d7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:20.841702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345917c-f90f-4ea5-881b-8f925aa5d7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:20.842009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345917c-f90f-4ea5-881b-8f925aa5d7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:20.842286 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345917c-f90f-4ea5-881b-8f925aa5d7e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:20.894108 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:20.988426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345917c-f90f-4ea5-881b-8f925aa5d7e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:20.989927 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345917c-f90f-4ea5-881b-8f925aa5d7e7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:21.086588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf67dc-9510-4d30-b59d-8762cee749ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:21.088086 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf67dc-9510-4d30-b59d-8762cee749ee None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:21.136006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 130/264] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 15:09:21.142806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345917c-f90f-4ea5-881b-8f925aa5d7e7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:21.254222 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:21.292746 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345917c-f90f-4ea5-881b-8f925aa5d7e7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:21.309308 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:21.355427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b0cb6-33c5-4da4-af71-574c454ccc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:21.356086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b0cb6-33c5-4da4-af71-574c454ccc71 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:21.356367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b0cb6-33c5-4da4-af71-574c454ccc71 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:21.356641 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b0cb6-33c5-4da4-af71-574c454ccc71 None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:21.358795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b0cb6-33c5-4da4-af71-574c454ccc71 None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:21.361067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b0cb6-33c5-4da4-af71-574c454ccc71 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:21.363449 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 131/265] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:21 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:21.369524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b0cb6-33c5-4da4-af71-574c454ccc71 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:21.484094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 135/266] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 902 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:21.486140 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae50960-d6d6-443d-8baa-853cfb1a670f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:21.486438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae50960-d6d6-443d-8baa-853cfb1a670f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:21.486718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae50960-d6d6-443d-8baa-853cfb1a670f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:21.488128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 136/267] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:21.493447 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae50960-d6d6-443d-8baa-853cfb1a670f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:21.583430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b0cb6-33c5-4da4-af71-574c454ccc71 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:21.602617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:21.625598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493b151-9c49-43ad-ab58-4bf148b1f754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:21.626277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493b151-9c49-43ad-ab58-4bf148b1f754 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:21.626556 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493b151-9c49-43ad-ab58-4bf148b1f754 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:21.626823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493b151-9c49-43ad-ab58-4bf148b1f754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:21.627547 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493b151-9c49-43ad-ab58-4bf148b1f754 None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651, user.id=5efeda74a6bc42858fc3b6ae91036d93) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:21.627847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493b151-9c49-43ad-ab58-4bf148b1f754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:21.629823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493b151-9c49-43ad-ab58-4bf148b1f754 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:21.642009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 132/268] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:09:21 2022] GET /identity/v3/role_assignments?user.id=5efeda74a6bc42858fc3b6ae91036d93&scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:21.643147 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd6642-a231-40c3-8c67-3ce0176ce369 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:21.643501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd6642-a231-40c3-8c67-3ce0176ce369 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:21.643777 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd6642-a231-40c3-8c67-3ce0176ce369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:21.677685 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae50960-d6d6-443d-8baa-853cfb1a670f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:21.684417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d9dd6642-a231-40c3-8c67-3ce0176ce369 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:21.685671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d9dd6642-a231-40c3-8c67-3ce0176ce369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:21.753000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f94825-4bcc-4a13-a216-6cf1a3765bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:21.753561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f94825-4bcc-4a13-a216-6cf1a3765bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:21.753866 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f94825-4bcc-4a13-a216-6cf1a3765bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:21.754138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f94825-4bcc-4a13-a216-6cf1a3765bd7 None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:21.756965 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f94825-4bcc-4a13-a216-6cf1a3765bd7 None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:21.758503 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f94825-4bcc-4a13-a216-6cf1a3765bd7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:21.760287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 137/269] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:21 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:21.767551 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f94825-4bcc-4a13-a216-6cf1a3765bd7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:21.810125 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:21.831585 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 133/270] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:21.878597 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c617e1-6b1a-4745-98fc-47dcf777aefc None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:21.878904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c617e1-6b1a-4745-98fc-47dcf777aefc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:21.879145 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c617e1-6b1a-4745-98fc-47dcf777aefc None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:21.880584 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 134/271] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:09:21.886280 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f82fe0-7ec1-45f1-ba4a-87070355914a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:21.886590 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f82fe0-7ec1-45f1-ba4a-87070355914a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:21.886826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f82fe0-7ec1-45f1-ba4a-87070355914a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:21.925487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-35f82fe0-7ec1-45f1-ba4a-87070355914a None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:21.926727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-35f82fe0-7ec1-45f1-ba4a-87070355914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:21.979861 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f94825-4bcc-4a13-a216-6cf1a3765bd7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:22.051077 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 135/272] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:22.062644 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385fed7-2c05-4d57-bea5-7c6b7222c7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:22.063777 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385fed7-2c05-4d57-bea5-7c6b7222c7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:22.064049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385fed7-2c05-4d57-bea5-7c6b7222c7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:22.064316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385fed7-2c05-4d57-bea5-7c6b7222c7b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:22.065043 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385fed7-2c05-4d57-bea5-7c6b7222c7b4 None admin] RBAC: Adding query filter params (role.id=acaa0e7c8246470aa47504d9bc3ae56f, scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651, user.id=5efeda74a6bc42858fc3b6ae91036d93) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:22.065346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385fed7-2c05-4d57-bea5-7c6b7222c7b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:22.066892 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385fed7-2c05-4d57-bea5-7c6b7222c7b4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:22.073566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 138/273] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:09:21 2022] GET /identity/v3/role_assignments?user.id=5efeda74a6bc42858fc3b6ae91036d93&scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651&role.id=acaa0e7c8246470aa47504d9bc3ae56f => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:22.222430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f82fe0-7ec1-45f1-ba4a-87070355914a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:22.236764 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a1755-e55a-4bc1-91ca-4a84a5ebd685 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:22.237091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a1755-e55a-4bc1-91ca-4a84a5ebd685 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:22.237310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a1755-e55a-4bc1-91ca-4a84a5ebd685 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:22.238706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 139/274] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:22.244638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb43e4-5540-4dae-a961-59a21df0e527 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:22.245337 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb43e4-5540-4dae-a961-59a21df0e527 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:22.245853 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb43e4-5540-4dae-a961-59a21df0e527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:22.275969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:22.278347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4ecb43e4-5540-4dae-a961-59a21df0e527 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:22.279806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4ecb43e4-5540-4dae-a961-59a21df0e527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:22.347717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f82fe0-7ec1-45f1-ba4a-87070355914a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:22.397401 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4406878-e491-481b-986c-efc9241750c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:22.398089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4406878-e491-481b-986c-efc9241750c5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:22.398535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4406878-e491-481b-986c-efc9241750c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:22.398847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4406878-e491-481b-986c-efc9241750c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:22.399840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 140/275] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:22.400478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb43e4-5540-4dae-a961-59a21df0e527 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:22.415235 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4406878-e491-481b-986c-efc9241750c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e4406878-e491-481b-986c-efc9241750c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:22.420097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:22.421229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:22.421229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:22.421229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:22.421229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:22.421229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:22.421229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:22.421229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:22.421229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:22.421229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:22.421229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:22.421229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:22.421229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:22.421229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:22.421229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:22.421229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:22.421229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:22.422929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:22.422929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:22.422929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:22.422929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:22.422929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:22.422929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:22.422929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:22.422929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:22.422929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:22.422929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:22.422929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:22.422929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:22.422929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 136/276] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:22.428173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4406878-e491-481b-986c-efc9241750c5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:22.434115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:22.536096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb43e4-5540-4dae-a961-59a21df0e527 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:22.552471 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:22.556007 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4406878-e491-481b-986c-efc9241750c5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:22.575166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163bc38-5a62-4426-90ba-d07e453c2abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:22.576181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163bc38-5a62-4426-90ba-d07e453c2abf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:22.576676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163bc38-5a62-4426-90ba-d07e453c2abf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:22.577136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163bc38-5a62-4426-90ba-d07e453c2abf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:22.578517 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163bc38-5a62-4426-90ba-d07e453c2abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:22.580160 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163bc38-5a62-4426-90ba-d07e453c2abf None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:22.582028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 141/277] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:22.588643 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163bc38-5a62-4426-90ba-d07e453c2abf None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:22.594619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cce3b-8dc8-44a2-9a76-10dae14492d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:22.595237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cce3b-8dc8-44a2-9a76-10dae14492d5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:22.595518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cce3b-8dc8-44a2-9a76-10dae14492d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:22.595791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cce3b-8dc8-44a2-9a76-10dae14492d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:22.596468 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cce3b-8dc8-44a2-9a76-10dae14492d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:22.596770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cce3b-8dc8-44a2-9a76-10dae14492d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:22.598327 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cce3b-8dc8-44a2-9a76-10dae14492d5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:22.608238 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 137/278] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:22.615972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cce3b-8dc8-44a2-9a76-10dae14492d5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:22.704638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:22.714564 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163bc38-5a62-4426-90ba-d07e453c2abf None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:22.747109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cce3b-8dc8-44a2-9a76-10dae14492d5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:22.750985 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fbcc7-7c74-4445-bb08-c346add72462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:22.751790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fbcc7-7c74-4445-bb08-c346add72462 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:22.752239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fbcc7-7c74-4445-bb08-c346add72462 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:22.752752 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fbcc7-7c74-4445-bb08-c346add72462 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:22.753576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fbcc7-7c74-4445-bb08-c346add72462 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:22.755240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fbcc7-7c74-4445-bb08-c346add72462 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:22.783513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf435d-3ac5-469b-a30e-214125b70378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:22.784143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf435d-3ac5-469b-a30e-214125b70378 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:22.784426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf435d-3ac5-469b-a30e-214125b70378 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:22.784700 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf435d-3ac5-469b-a30e-214125b70378 None admin] PATH_INFO: `/v3/users/749b79a3162f4887b3de20b370121146` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:22.798981 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf435d-3ac5-469b-a30e-214125b70378 None admin] RBAC: Authorizing `identity:get_user(user_id=749b79a3162f4887b3de20b370121146)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:22.800442 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf435d-3ac5-469b-a30e-214125b70378 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:22.802096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 138/279] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:22 2022] GET /identity/v3/users/749b79a3162f4887b3de20b370121146 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:22.802891 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf435d-3ac5-469b-a30e-214125b70378 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:22.827914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:22.873889 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 142/280] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:09:22 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:09:22.875116 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fbcc7-7c74-4445-bb08-c346add72462 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:22.922701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf435d-3ac5-469b-a30e-214125b70378 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:22.979952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2ab19-bdfe-4e06-82bb-29dbe4c67839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:22.981000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2ab19-bdfe-4e06-82bb-29dbe4c67839 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:22.981639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2ab19-bdfe-4e06-82bb-29dbe4c67839 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:22.982483 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2ab19-bdfe-4e06-82bb-29dbe4c67839 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:22.996735 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2ab19-bdfe-4e06-82bb-29dbe4c67839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:23.003719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c4a2ab19-bdfe-4e06-82bb-29dbe4c67839 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:09:23.003719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:23.003719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:23.003719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:23.003719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:23.003719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:23.003719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:23.003719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:23.003719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:23.003719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:23.003719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:23.003719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:23.003719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:23.003719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:23.003719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:23.003719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:23.004840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:23.004840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:23.004840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:23.004840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:23.004840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:23.004840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:23.004840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:23.004840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:23.004840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:23.004840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:23.004840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:23.004840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:23.004840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:23.004840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:23.004840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:23.004840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:23.005653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:23.005653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:23.005653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:23.005653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:23.005653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:23.005653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:23.005653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:23.005653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:23.005653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:23.005653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:23.005653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:09:23.005653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:23.008212 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 139/281] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:23.014928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2ab19-bdfe-4e06-82bb-29dbe4c67839 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:23.026386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fbcc7-7c74-4445-bb08-c346add72462 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:23.069662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac812a2-6f02-4b3b-af4e-7c6b8694cd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:23.070645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac812a2-6f02-4b3b-af4e-7c6b8694cd9c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:23.070936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac812a2-6f02-4b3b-af4e-7c6b8694cd9c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:23.071365 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac812a2-6f02-4b3b-af4e-7c6b8694cd9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:23.072098 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac812a2-6f02-4b3b-af4e-7c6b8694cd9c None admin] RBAC: Adding query filter params (role.id=c18fbe0604b34383a2725a382d77d618, user.id=749b79a3162f4887b3de20b370121146, scope.system=all) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:23.072407 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac812a2-6f02-4b3b-af4e-7c6b8694cd9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:23.073888 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac812a2-6f02-4b3b-af4e-7c6b8694cd9c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:23.079783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 143/282] 10.222.0.82 () {56 vars in 1308 bytes} [Fri Sep 23 15:09:22 2022] GET /identity/v3/role_assignments?user.id=749b79a3162f4887b3de20b370121146&scope.system=all&role.id=c18fbe0604b34383a2725a382d77d618 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:23.080978 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fe33d-197b-4977-b23e-6e20e290d14d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:23.081260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fe33d-197b-4977-b23e-6e20e290d14d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:23.081530 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fe33d-197b-4977-b23e-6e20e290d14d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:23.082943 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 144/283] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:23.088505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c281b-aace-4b53-9586-0327364e8488 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:23.088794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c281b-aace-4b53-9586-0327364e8488 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:23.089069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c281b-aace-4b53-9586-0327364e8488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:23.096261 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:23.110325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a84c281b-aace-4b53-9586-0327364e8488 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:23.112337 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a84c281b-aace-4b53-9586-0327364e8488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:23.120113 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:23.142749 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2ab19-bdfe-4e06-82bb-29dbe4c67839 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:23.197165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc861f74-b0d2-4f03-8eaf-846debc5986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:23.197878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc861f74-b0d2-4f03-8eaf-846debc5986f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:23.198117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc861f74-b0d2-4f03-8eaf-846debc5986f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:23.198384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc861f74-b0d2-4f03-8eaf-846debc5986f None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:23.200064 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc861f74-b0d2-4f03-8eaf-846debc5986f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:23.200064 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc861f74-b0d2-4f03-8eaf-846debc5986f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:23.200773 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc861f74-b0d2-4f03-8eaf-846debc5986f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:23.208316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 145/284] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:09:23.217389 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 140/285] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:23.223767 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c281b-aace-4b53-9586-0327364e8488 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:23.338470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c281b-aace-4b53-9586-0327364e8488 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:23.369163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:23.374127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecc600-3bae-48be-a4dd-89ede006f83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:23.374754 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecc600-3bae-48be-a4dd-89ede006f83c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:23.375032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecc600-3bae-48be-a4dd-89ede006f83c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:23.375813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecc600-3bae-48be-a4dd-89ede006f83c None admin] PATH_INFO: `/v3/users/a09354953983401d8b78aa5d8371322a` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:23.377001 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecc600-3bae-48be-a4dd-89ede006f83c None admin] RBAC: Authorizing `identity:get_user(user_id=a09354953983401d8b78aa5d8371322a)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:23.378478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecc600-3bae-48be-a4dd-89ede006f83c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:23.380367 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 146/286] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:23 2022] GET /identity/v3/users/a09354953983401d8b78aa5d8371322a => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:23.385700 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc861f74-b0d2-4f03-8eaf-846debc5986f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:23.505693 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecc600-3bae-48be-a4dd-89ede006f83c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:23.530651 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc861f74-b0d2-4f03-8eaf-846debc5986f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:23.593428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f5d32-b01c-459d-aaeb-49281e0f1b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:23.594135 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f5d32-b01c-459d-aaeb-49281e0f1b7f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:23.594415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f5d32-b01c-459d-aaeb-49281e0f1b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:23.594684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f5d32-b01c-459d-aaeb-49281e0f1b7f None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:23.596044 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f5d32-b01c-459d-aaeb-49281e0f1b7f None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:23.598171 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f5d32-b01c-459d-aaeb-49281e0f1b7f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:23.600099 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 141/287] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:23 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:23.607301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f5d32-b01c-459d-aaeb-49281e0f1b7f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:23.633590 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:23.658751 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecc600-3bae-48be-a4dd-89ede006f83c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:23.697932 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac755f67-c8fe-412e-8036-5e201b1933fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:23.701758 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac755f67-c8fe-412e-8036-5e201b1933fb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:23.701758 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac755f67-c8fe-412e-8036-5e201b1933fb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:23.701758 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac755f67-c8fe-412e-8036-5e201b1933fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:23.711052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac755f67-c8fe-412e-8036-5e201b1933fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:23.717597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ac755f67-c8fe-412e-8036-5e201b1933fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:23.717597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:23.717597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:23.717597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:23.717597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:23.717597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:23.717597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:23.717597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:23.717597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:23.717597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:23.717597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:23.717597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:23.717597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:23.717597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:23.717597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:23.717597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:23.718664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:23.718664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:23.718664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:23.718664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:23.718664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:23.718664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:23.718664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:23.718664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:23.718664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:23.718664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:23.718664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:23.718664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:23.718664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:23.718664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:23.718664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:23.718664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:23.719647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:23.719647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:23.719647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:23.719647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:23.719647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:23.719647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:23.719647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:23.719647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:23.719647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:23.719647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:23.719647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:23.719647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:23.719647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 147/288] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:23.727200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac755f67-c8fe-412e-8036-5e201b1933fb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:23.831641 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f5d32-b01c-459d-aaeb-49281e0f1b7f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:23.850041 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:23.902715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7493b78-df25-4f14-a25e-300995baf377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:23.903904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7493b78-df25-4f14-a25e-300995baf377 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:23.904399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7493b78-df25-4f14-a25e-300995baf377 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:23.904892 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7493b78-df25-4f14-a25e-300995baf377 None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651/users/a09354953983401d8b78aa5d8371322a/roles/fe20f96b39034b82ae491a24ebbda3b4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:23.908714 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7493b78-df25-4f14-a25e-300995baf377 None admin] RBAC: Authorizing `identity:create_grant(project_id=04ee7300c1d74f5bbe668c0fa5c4e651, user_id=a09354953983401d8b78aa5d8371322a, role_id=fe20f96b39034b82ae491a24ebbda3b4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:23.910521 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7493b78-df25-4f14-a25e-300995baf377 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:23.924488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac755f67-c8fe-412e-8036-5e201b1933fb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:23.961004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e19dfd-4383-4a84-828b-f53782f0b730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:23.962144 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e19dfd-4383-4a84-828b-f53782f0b730 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:23.962666 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e19dfd-4383-4a84-828b-f53782f0b730 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:23.963168 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e19dfd-4383-4a84-828b-f53782f0b730 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:23.964046 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e19dfd-4383-4a84-828b-f53782f0b730 None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:23.964619 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e19dfd-4383-4a84-828b-f53782f0b730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:23.966446 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e19dfd-4383-4a84-828b-f53782f0b730 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:23.983758 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 148/289] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:23.985109 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e19dfd-4383-4a84-828b-f53782f0b730 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:24.094016 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e19dfd-4383-4a84-828b-f53782f0b730 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:24.119605 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:24.131626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460bde3-d9be-40ed-afff-a6a342c8adde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:24.132265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460bde3-d9be-40ed-afff-a6a342c8adde None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:24.132539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460bde3-d9be-40ed-afff-a6a342c8adde None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:24.132813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460bde3-d9be-40ed-afff-a6a342c8adde None admin] PATH_INFO: `/v3/users/61d835d4d2a04485a0795ad90ce9ecde` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:24.133978 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460bde3-d9be-40ed-afff-a6a342c8adde None admin] RBAC: Authorizing `identity:get_user(user_id=61d835d4d2a04485a0795ad90ce9ecde)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:24.135428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460bde3-d9be-40ed-afff-a6a342c8adde None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:24.137404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 149/290] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:23 2022] GET /identity/v3/users/61d835d4d2a04485a0795ad90ce9ecde => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:24.143500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460bde3-d9be-40ed-afff-a6a342c8adde None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:24.186931 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 142/291] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:09:23 2022] PUT /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651/users/a09354953983401d8b78aa5d8371322a/roles/fe20f96b39034b82ae491a24ebbda3b4 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:09:24.253046 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460bde3-d9be-40ed-afff-a6a342c8adde None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:24.289242 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facea42d-2b3c-4b4c-92cd-8943d71c851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:24.289890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facea42d-2b3c-4b4c-92cd-8943d71c851f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:24.290170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facea42d-2b3c-4b4c-92cd-8943d71c851f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:24.290445 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facea42d-2b3c-4b4c-92cd-8943d71c851f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:24.357259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:24.369057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facea42d-2b3c-4b4c-92cd-8943d71c851f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:24.370581 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facea42d-2b3c-4b4c-92cd-8943d71c851f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:24.496993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 150/292] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:24.503023 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7493b78-df25-4f14-a25e-300995baf377 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:24.581998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:24.622176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7493b78-df25-4f14-a25e-300995baf377 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:24.669438 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f88e4-68ee-4f50-9d2b-ceb9f23b6d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:24.670483 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f88e4-68ee-4f50-9d2b-ceb9f23b6d10 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:24.671219 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f88e4-68ee-4f50-9d2b-ceb9f23b6d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:24.671725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f88e4-68ee-4f50-9d2b-ceb9f23b6d10 None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:24.674417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f88e4-68ee-4f50-9d2b-ceb9f23b6d10 None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:24.676097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f88e4-68ee-4f50-9d2b-ceb9f23b6d10 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:24.678009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 143/293] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:24 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:24.683793 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facea42d-2b3c-4b4c-92cd-8943d71c851f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:24.839825 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:24.851059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facea42d-2b3c-4b4c-92cd-8943d71c851f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:24.894328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58e779-aa77-481c-9950-ed5397692746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:24.895286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58e779-aa77-481c-9950-ed5397692746 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:24.895822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58e779-aa77-481c-9950-ed5397692746 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:24.896474 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58e779-aa77-481c-9950-ed5397692746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:24.897430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58e779-aa77-481c-9950-ed5397692746 None admin] RBAC: Adding query filter params (role.id=c18fbe0604b34383a2725a382d77d618, scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651, user.id=61d835d4d2a04485a0795ad90ce9ecde) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:24.898094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58e779-aa77-481c-9950-ed5397692746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:24.899823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58e779-aa77-481c-9950-ed5397692746 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:24.910826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 151/294] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:09:24 2022] GET /identity/v3/role_assignments?user.id=61d835d4d2a04485a0795ad90ce9ecde&scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651&role.id=c18fbe0604b34383a2725a382d77d618 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:25.654632 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21befa-8172-42df-8d47-8be6e3ae7917 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:25.655691 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21befa-8172-42df-8d47-8be6e3ae7917 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:25.656187 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21befa-8172-42df-8d47-8be6e3ae7917 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:25.658304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 144/295] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:25.664036 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ab603-3039-4a30-980b-078b6160ef7b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:25.664581 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ab603-3039-4a30-980b-078b6160ef7b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:25.665074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ab603-3039-4a30-980b-078b6160ef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:25.684975 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c51ab603-3039-4a30-980b-078b6160ef7b None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:25.686967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c51ab603-3039-4a30-980b-078b6160ef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:25.706576 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a626c0-eed0-4fe4-92e2-915d00f55e43 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:25.706897 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a626c0-eed0-4fe4-92e2-915d00f55e43 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:25.707123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a626c0-eed0-4fe4-92e2-915d00f55e43 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:25.708836 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 145/296] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:09:25.714453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a2cfa-029d-4f50-a83b-8ae008a2af27 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:25.714735 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a2cfa-029d-4f50-a83b-8ae008a2af27 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:25.715011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a2cfa-029d-4f50-a83b-8ae008a2af27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:25.734189 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9d1a2cfa-029d-4f50-a83b-8ae008a2af27 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:25.736008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9d1a2cfa-029d-4f50-a83b-8ae008a2af27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:25.766751 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 152/297] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:25.775452 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3023bd-7e1d-4cd9-8b29-d7311ef4b5a5 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:25.775894 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3023bd-7e1d-4cd9-8b29-d7311ef4b5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:25.776336 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3023bd-7e1d-4cd9-8b29-d7311ef4b5a5 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:25.782752 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 153/298] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:25.785960 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53811-08e4-4b23-9d0e-efdd2afb25de None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:25.786245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53811-08e4-4b23-9d0e-efdd2afb25de None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:25.786524 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53811-08e4-4b23-9d0e-efdd2afb25de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:25.805420 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8fe53811-08e4-4b23-9d0e-efdd2afb25de None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:25.806645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8fe53811-08e4-4b23-9d0e-efdd2afb25de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:25.818386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 146/299] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:09:25.880184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 154/300] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:26.063665 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a2cfa-029d-4f50-a83b-8ae008a2af27 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:26.089890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53811-08e4-4b23-9d0e-efdd2afb25de None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:26.106607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:26.144396 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:26.189784 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a2cfa-029d-4f50-a83b-8ae008a2af27 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:26.200657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53811-08e4-4b23-9d0e-efdd2afb25de None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:26.230802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1344a-33f1-402f-88da-7a1b72b578c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:26.231364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1344a-33f1-402f-88da-7a1b72b578c7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:26.231646 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1344a-33f1-402f-88da-7a1b72b578c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:26.231959 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1344a-33f1-402f-88da-7a1b72b578c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:26.237971 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88791585-c7a6-46df-80f2-055d6b1ed1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:26.239045 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88791585-c7a6-46df-80f2-055d6b1ed1bc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:26.239536 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88791585-c7a6-46df-80f2-055d6b1ed1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:26.239958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88791585-c7a6-46df-80f2-055d6b1ed1bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:26.243396 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1344a-33f1-402f-88da-7a1b72b578c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:26.248342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3dd1344a-33f1-402f-88da-7a1b72b578c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:26.248342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:26.248342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:26.248342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:26.248342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:26.248342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:26.248342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:26.248342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:26.248342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:26.248342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:26.248342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:26.248342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:26.248342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:26.248342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:26.248342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:26.248342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:26.249335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:26.249335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:26.249335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:26.249335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:26.249335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:26.249335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:26.249335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:26.249335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:26.249335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:26.249335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:26.249335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:26.249335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:26.249335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:26.249335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:26.249335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:26.249335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:26.250227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:26.250227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:26.250227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:26.250227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:26.250227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:26.250227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:26.250227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:26.250227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:26.250227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:26.250227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:26.250227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:26.250227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:26.250227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 147/301] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:26.251485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1344a-33f1-402f-88da-7a1b72b578c7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:26.255839 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88791585-c7a6-46df-80f2-055d6b1ed1bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:26.261085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-88791585-c7a6-46df-80f2-055d6b1ed1bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:09:26.261085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:26.261085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:26.261085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:26.261085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:26.261085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:26.261085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:26.261085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:26.261085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:26.261085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:26.261085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:26.261085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:26.261085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:26.261085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:26.261085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:26.261085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:26.261997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:26.261997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:26.261997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:26.261997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:26.261997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:26.261997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:26.261997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:26.261997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:26.261997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:26.261997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:26.261997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:26.261997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:26.261997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:26.261997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:26.261997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:26.261997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:26.262816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:26.262816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:26.262816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:26.262816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:26.262816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:26.262816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:26.262816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:26.262816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:26.262816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:26.262816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:26.262816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:09:26.262816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:26.263439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 155/302] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:09:26.264307 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88791585-c7a6-46df-80f2-055d6b1ed1bc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:26.346521 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:26.371372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1344a-33f1-402f-88da-7a1b72b578c7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:26.376001 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88791585-c7a6-46df-80f2-055d6b1ed1bc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:26.399610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:26.409290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705aba1-f574-4de4-b8c6-7b41d73500a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:26.409955 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705aba1-f574-4de4-b8c6-7b41d73500a4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:26.410232 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705aba1-f574-4de4-b8c6-7b41d73500a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:26.420438 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705aba1-f574-4de4-b8c6-7b41d73500a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:26.420438 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705aba1-f574-4de4-b8c6-7b41d73500a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:26.420631 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb0578-78bd-4ea6-a647-3fe027f643a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:26.420718 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705aba1-f574-4de4-b8c6-7b41d73500a4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:26.420785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb0578-78bd-4ea6-a647-3fe027f643a1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:26.420785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb0578-78bd-4ea6-a647-3fe027f643a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:26.420785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb0578-78bd-4ea6-a647-3fe027f643a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:26.420785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb0578-78bd-4ea6-a647-3fe027f643a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:26.421298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 148/303] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:26.421370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb0578-78bd-4ea6-a647-3fe027f643a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:26.421446 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705aba1-f574-4de4-b8c6-7b41d73500a4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:26.421532 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb0578-78bd-4ea6-a647-3fe027f643a1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:26.430658 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 156/304] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:26.430658 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb0578-78bd-4ea6-a647-3fe027f643a1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:26.526330 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705aba1-f574-4de4-b8c6-7b41d73500a4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:26.543769 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb0578-78bd-4ea6-a647-3fe027f643a1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:26.566393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78504c-203d-487e-937f-9ab7b12a9e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:26.567003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78504c-203d-487e-937f-9ab7b12a9e99 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:26.567278 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78504c-203d-487e-937f-9ab7b12a9e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:26.567548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78504c-203d-487e-937f-9ab7b12a9e99 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:26.568209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78504c-203d-487e-937f-9ab7b12a9e99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:26.568511 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78504c-203d-487e-937f-9ab7b12a9e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:26.570101 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78504c-203d-487e-937f-9ab7b12a9e99 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:26.583435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 149/305] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:26.583435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78504c-203d-487e-937f-9ab7b12a9e99 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:26.585935 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44c318-3b5c-4471-8d5b-aa601aec5a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:26.586563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44c318-3b5c-4471-8d5b-aa601aec5a19 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:26.586846 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44c318-3b5c-4471-8d5b-aa601aec5a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:26.587123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44c318-3b5c-4471-8d5b-aa601aec5a19 None admin] PATH_INFO: `/v3/groups` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:26.587757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44c318-3b5c-4471-8d5b-aa601aec5a19 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:26.589204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44c318-3b5c-4471-8d5b-aa601aec5a19 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:26.595750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:26.644024 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:26.669998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 157/306] 10.222.0.82 () {60 vars in 1134 bytes} [Fri Sep 23 15:09:26 2022] POST /identity/v3/groups => generated 229 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:09:26.671363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44c318-3b5c-4471-8d5b-aa601aec5a19 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:26.710166 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78504c-203d-487e-937f-9ab7b12a9e99 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:26.765461 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e3f7f-e831-4884-b688-3ad2799e738d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:26.766156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e3f7f-e831-4884-b688-3ad2799e738d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:26.766952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e3f7f-e831-4884-b688-3ad2799e738d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:26.767223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e3f7f-e831-4884-b688-3ad2799e738d None admin] PATH_INFO: `/v3/users/749b79a3162f4887b3de20b370121146` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:26.769719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e3f7f-e831-4884-b688-3ad2799e738d None admin] RBAC: Authorizing `identity:get_user(user_id=749b79a3162f4887b3de20b370121146)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:26.771317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e3f7f-e831-4884-b688-3ad2799e738d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:26.773506 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 150/307] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:26 2022] GET /identity/v3/users/749b79a3162f4887b3de20b370121146 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:26.781344 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e3f7f-e831-4884-b688-3ad2799e738d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:26.811838 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44c318-3b5c-4471-8d5b-aa601aec5a19 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:26.852587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873ea88-1e5a-4504-bdde-6f02ebaeeb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:26.853343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873ea88-1e5a-4504-bdde-6f02ebaeeb41 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:26.853631 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873ea88-1e5a-4504-bdde-6f02ebaeeb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:26.853937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873ea88-1e5a-4504-bdde-6f02ebaeeb41 None admin] PATH_INFO: `/v3/users/4d47a2eada9b492fb6da47a2154ef4ab` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:26.870870 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873ea88-1e5a-4504-bdde-6f02ebaeeb41 None admin] RBAC: Authorizing `identity:get_user(user_id=4d47a2eada9b492fb6da47a2154ef4ab)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:26.873225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873ea88-1e5a-4504-bdde-6f02ebaeeb41 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:26.874959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 158/308] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:26 2022] GET /identity/v3/users/4d47a2eada9b492fb6da47a2154ef4ab => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:26.881132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873ea88-1e5a-4504-bdde-6f02ebaeeb41 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:26.906242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e3f7f-e831-4884-b688-3ad2799e738d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:26.942050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:26.943567 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:26.955008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d4b1e-296a-4ad2-8c49-93ee4924f3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:26.955656 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d4b1e-296a-4ad2-8c49-93ee4924f3ea None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:26.955960 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d4b1e-296a-4ad2-8c49-93ee4924f3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:26.956229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d4b1e-296a-4ad2-8c49-93ee4924f3ea None admin] PATH_INFO: `/v3/system/users/749b79a3162f4887b3de20b370121146/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:26.957715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d4b1e-296a-4ad2-8c49-93ee4924f3ea None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=749b79a3162f4887b3de20b370121146, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:26.959484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d4b1e-296a-4ad2-8c49-93ee4924f3ea None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:26.994946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873ea88-1e5a-4504-bdde-6f02ebaeeb41 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:27.031446 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ab5ce-f50d-4b3a-bc35-bd22c3aaf3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:27.032021 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ab5ce-f50d-4b3a-bc35-bd22c3aaf3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:27.032327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ab5ce-f50d-4b3a-bc35-bd22c3aaf3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:27.032584 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ab5ce-f50d-4b3a-bc35-bd22c3aaf3c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:27.033300 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ab5ce-f50d-4b3a-bc35-bd22c3aaf3c5 None admin] RBAC: Adding query filter params (role.id=fe20f96b39034b82ae491a24ebbda3b4, user.id=4d47a2eada9b492fb6da47a2154ef4ab, scope.system=all) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:27.033609 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ab5ce-f50d-4b3a-bc35-bd22c3aaf3c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:27.035052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ab5ce-f50d-4b3a-bc35-bd22c3aaf3c5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:27.040215 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 159/309] 10.222.0.82 () {56 vars in 1308 bytes} [Fri Sep 23 15:09:26 2022] GET /identity/v3/role_assignments?user.id=4d47a2eada9b492fb6da47a2154ef4ab&scope.system=all&role.id=fe20f96b39034b82ae491a24ebbda3b4 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:27.041365 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d302c5-5637-4d39-86ea-02e7f8b92931 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:27.041644 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d302c5-5637-4d39-86ea-02e7f8b92931 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:27.041942 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d302c5-5637-4d39-86ea-02e7f8b92931 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:27.043317 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 160/310] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:27.049422 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebe704-077b-4e46-983c-9d7f93c4896c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:27.049698 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebe704-077b-4e46-983c-9d7f93c4896c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:27.050035 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebe704-077b-4e46-983c-9d7f93c4896c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:27.070900 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-36ebe704-077b-4e46-983c-9d7f93c4896c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:27.072119 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-36ebe704-077b-4e46-983c-9d7f93c4896c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:27.083733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 151/311] 10.222.0.82 () {58 vars in 1334 bytes} [Fri Sep 23 15:09:26 2022] PUT /identity/v3/system/users/749b79a3162f4887b3de20b370121146/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:09:27.162989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 161/312] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:09:27.435493 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d4b1e-296a-4ad2-8c49-93ee4924f3ea None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:27.542888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d4b1e-296a-4ad2-8c49-93ee4924f3ea None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:27.579928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c5324-3424-42e9-88c3-2e0479595c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:27.580942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c5324-3424-42e9-88c3-2e0479595c4a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:27.581446 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c5324-3424-42e9-88c3-2e0479595c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:27.581978 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c5324-3424-42e9-88c3-2e0479595c4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:27.593107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c5324-3424-42e9-88c3-2e0479595c4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:27.598761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-125c5324-3424-42e9-88c3-2e0479595c4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:09:27.598761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:27.598761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:27.598761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:27.598761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:27.598761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:27.598761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:27.598761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:27.598761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:27.598761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:27.598761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:27.598761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:27.598761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:27.598761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:27.598761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:27.598761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:27.599721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:27.599721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:27.599721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:27.599721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:27.599721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:27.599721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:27.599721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:27.599721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:27.599721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:27.599721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:27.599721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:27.599721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:27.599721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:27.599721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:27.599721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:27.599721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:27.600520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:27.600520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:27.600520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:27.600520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:27.600520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:27.600520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:27.600520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:27.600520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:27.600520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:27.600520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:27.600520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:09:27.600520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:27.602850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 152/313] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:27.608973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebe704-077b-4e46-983c-9d7f93c4896c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:27.662538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:27.716908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebe704-077b-4e46-983c-9d7f93c4896c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:27.752818 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944aedcd-fff1-4d9a-8ae1-68ae3c9f9e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:27.753816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aedcd-fff1-4d9a-8ae1-68ae3c9f9e7a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:27.754323 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aedcd-fff1-4d9a-8ae1-68ae3c9f9e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:27.754805 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944aedcd-fff1-4d9a-8ae1-68ae3c9f9e7a None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:27.755686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944aedcd-fff1-4d9a-8ae1-68ae3c9f9e7a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:27.756187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944aedcd-fff1-4d9a-8ae1-68ae3c9f9e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:27.757782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944aedcd-fff1-4d9a-8ae1-68ae3c9f9e7a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:27.772527 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c5324-3424-42e9-88c3-2e0479595c4a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:27.774306 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 162/314] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:27.826237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:27.878726 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c5324-3424-42e9-88c3-2e0479595c4a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:27.914259 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddae6f-dca6-4c8a-8f84-5b51ae09f98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:27.914904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddae6f-dca6-4c8a-8f84-5b51ae09f98d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:27.915182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddae6f-dca6-4c8a-8f84-5b51ae09f98d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:27.915459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddae6f-dca6-4c8a-8f84-5b51ae09f98d None admin] PATH_INFO: `/v3/users/a09354953983401d8b78aa5d8371322a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:27.916601 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddae6f-dca6-4c8a-8f84-5b51ae09f98d None admin] RBAC: Authorizing `identity:get_user(user_id=a09354953983401d8b78aa5d8371322a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:27.918105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddae6f-dca6-4c8a-8f84-5b51ae09f98d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:27.920256 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 153/315] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:27 2022] GET /identity/v3/users/a09354953983401d8b78aa5d8371322a => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:27.926397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944aedcd-fff1-4d9a-8ae1-68ae3c9f9e7a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:28.033312 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944aedcd-fff1-4d9a-8ae1-68ae3c9f9e7a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:28.044649 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:28.071853 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656abd1-86bc-459e-8b69-0f6694dc0c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:28.072491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656abd1-86bc-459e-8b69-0f6694dc0c05 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:28.072808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656abd1-86bc-459e-8b69-0f6694dc0c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:28.073117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656abd1-86bc-459e-8b69-0f6694dc0c05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:28.143871 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656abd1-86bc-459e-8b69-0f6694dc0c05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:28.145458 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656abd1-86bc-459e-8b69-0f6694dc0c05 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:28.247860 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 163/316] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:28.253392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddae6f-dca6-4c8a-8f84-5b51ae09f98d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:28.359736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddae6f-dca6-4c8a-8f84-5b51ae09f98d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:28.378132 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:28.395676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fa914-7457-4c53-82fd-2c37073054c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:28.396319 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fa914-7457-4c53-82fd-2c37073054c9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:28.396602 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fa914-7457-4c53-82fd-2c37073054c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:28.396877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fa914-7457-4c53-82fd-2c37073054c9 None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:28.398029 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fa914-7457-4c53-82fd-2c37073054c9 None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:28.399494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fa914-7457-4c53-82fd-2c37073054c9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:28.401451 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 154/317] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:28 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:28.407986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656abd1-86bc-459e-8b69-0f6694dc0c05 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:28.420542 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:28.510884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656abd1-86bc-459e-8b69-0f6694dc0c05 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:28.549010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4e001-5845-4ba3-aa96-2e7db1444a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:28.549614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4e001-5845-4ba3-aa96-2e7db1444a08 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:28.549920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4e001-5845-4ba3-aa96-2e7db1444a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:28.550189 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4e001-5845-4ba3-aa96-2e7db1444a08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:28.550907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4e001-5845-4ba3-aa96-2e7db1444a08 None admin] RBAC: Adding query filter params (role.id=fe20f96b39034b82ae491a24ebbda3b4, scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651, user.id=a09354953983401d8b78aa5d8371322a) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:28.551212 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4e001-5845-4ba3-aa96-2e7db1444a08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:28.552656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4e001-5845-4ba3-aa96-2e7db1444a08 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:28.559237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 164/318] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:09:28 2022] GET /identity/v3/role_assignments?user.id=a09354953983401d8b78aa5d8371322a&scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651&role.id=fe20f96b39034b82ae491a24ebbda3b4 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:29.016804 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82c04e-399d-4c22-ae9d-03379a23f334 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:29.017444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82c04e-399d-4c22-ae9d-03379a23f334 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:29.017444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82c04e-399d-4c22-ae9d-03379a23f334 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:29.018732 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 155/319] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:29.024539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919862b9-f4b9-4ca1-9e10-d2e98f334fb8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:29.025000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919862b9-f4b9-4ca1-9e10-d2e98f334fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:29.025080 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919862b9-f4b9-4ca1-9e10-d2e98f334fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:29.043560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-919862b9-f4b9-4ca1-9e10-d2e98f334fb8 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:29.044851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-919862b9-f4b9-4ca1-9e10-d2e98f334fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:29.116367 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 165/320] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:29.233594 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886b5a4-f788-4ba6-bc71-102edd8672c6 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:29.233969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886b5a4-f788-4ba6-bc71-102edd8672c6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:29.234096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886b5a4-f788-4ba6-bc71-102edd8672c6 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:29.236160 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 156/321] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:29.241553 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475acbc-e0f6-435a-80c1-a58c459dd062 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:29.241926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475acbc-e0f6-435a-80c1-a58c459dd062 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:29.242126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475acbc-e0f6-435a-80c1-a58c459dd062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:29.250657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:29.262373 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8475acbc-e0f6-435a-80c1-a58c459dd062 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:29.263776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8475acbc-e0f6-435a-80c1-a58c459dd062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:29.333513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 166/322] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:29.367680 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58388b-96d7-467d-966f-b49af5be0108 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:29.368034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58388b-96d7-467d-966f-b49af5be0108 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:29.368223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58388b-96d7-467d-966f-b49af5be0108 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:29.369724 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 157/323] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:29.374723 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997ce9a-2173-4f97-a178-553811e3d227 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:29.375014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997ce9a-2173-4f97-a178-553811e3d227 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:29.375288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997ce9a-2173-4f97-a178-553811e3d227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:29.393447 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2997ce9a-2173-4f97-a178-553811e3d227 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:29.394652 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2997ce9a-2173-4f97-a178-553811e3d227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:29.408704 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58388b-96d7-467d-966f-b49af5be0108 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:29.470174 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 167/324] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:29.517275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58388b-96d7-467d-966f-b49af5be0108 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:29.554550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98406759-a9b8-49f6-90d7-ecbbc52ebb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:29.555185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98406759-a9b8-49f6-90d7-ecbbc52ebb25 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:29.555467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98406759-a9b8-49f6-90d7-ecbbc52ebb25 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:29.555792 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98406759-a9b8-49f6-90d7-ecbbc52ebb25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:29.556929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98406759-a9b8-49f6-90d7-ecbbc52ebb25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:29.560129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98406759-a9b8-49f6-90d7-ecbbc52ebb25 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:29.560777 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 158/325] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:29.566278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997ce9a-2173-4f97-a178-553811e3d227 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:29.603082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98406759-a9b8-49f6-90d7-ecbbc52ebb25 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:29.631363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:29.668251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:29.673328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997ce9a-2173-4f97-a178-553811e3d227 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:29.709813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3197a-7847-4a5e-9113-aad4df6447f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:29.710411 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3197a-7847-4a5e-9113-aad4df6447f8 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:29.710685 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3197a-7847-4a5e-9113-aad4df6447f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:29.710950 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3197a-7847-4a5e-9113-aad4df6447f8 None admin] PATH_INFO: `/v3/groups` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:29.711580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3197a-7847-4a5e-9113-aad4df6447f8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:29.713046 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3197a-7847-4a5e-9113-aad4df6447f8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:29.718560 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98406759-a9b8-49f6-90d7-ecbbc52ebb25 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:29.754275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b4cbf-f5b0-4522-a698-744cc3ba9750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:29.754912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b4cbf-f5b0-4522-a698-744cc3ba9750 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:29.755194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b4cbf-f5b0-4522-a698-744cc3ba9750 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:29.755469 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b4cbf-f5b0-4522-a698-744cc3ba9750 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:29.765961 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b4cbf-f5b0-4522-a698-744cc3ba9750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:29.771824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-616b4cbf-f5b0-4522-a698-744cc3ba9750 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:09:29.771824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:29.771824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:29.771824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:29.771824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:29.771824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:29.771824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:29.771824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:29.771824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:29.771824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:29.771824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:29.771824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:29.771824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:29.771824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:29.771824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:29.771824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:29.772881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:29.772881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:29.772881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:29.772881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:29.772881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:29.772881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:29.772881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:29.772881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:29.772881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:29.772881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:29.772881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:29.772881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:29.772881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:29.772881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:29.772881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:29.772881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:29.773861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:29.773861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:29.773861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:29.773861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:29.773861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:29.773861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:29.773861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:29.773861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:29.773861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:29.773861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:29.773861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:09:29.773861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:29.773861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 159/326] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:09:29.775395 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b4cbf-f5b0-4522-a698-744cc3ba9750 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:29.805808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 168/327] 10.222.0.82 () {60 vars in 1134 bytes} [Fri Sep 23 15:09:29 2022] POST /identity/v3/groups => generated 226 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:09:29.806637 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3197a-7847-4a5e-9113-aad4df6447f8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:29.889116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b4cbf-f5b0-4522-a698-744cc3ba9750 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:29.907771 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:29.930277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb31ec-be6f-47f9-9d4a-f4b09c9cf2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:29.931066 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb31ec-be6f-47f9-9d4a-f4b09c9cf2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:29.931465 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb31ec-be6f-47f9-9d4a-f4b09c9cf2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:29.931833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb31ec-be6f-47f9-9d4a-f4b09c9cf2e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:29.936973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3197a-7847-4a5e-9113-aad4df6447f8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:29.944104 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb31ec-be6f-47f9-9d4a-f4b09c9cf2e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:29.949534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-28cb31ec-be6f-47f9-9d4a-f4b09c9cf2e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:29.949534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:29.949534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:29.949534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:29.949534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:29.949534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:29.949534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:29.949534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:29.949534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:29.949534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:29.949534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:29.949534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:29.949534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:29.949534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:29.949534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:29.949534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:29.950713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:29.950713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:29.950713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:29.950713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:29.950713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:29.950713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:29.950713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:29.950713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:29.950713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:29.950713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:29.950713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:29.950713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:29.950713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:29.950713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:29.950713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:29.950713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:29.951737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:29.951737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:29.951737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:29.951737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:29.951737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:29.951737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:29.951737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:29.951737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:29.951737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:29.951737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:29.951737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:29.951737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:29.953435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 160/328] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:29.960001 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb31ec-be6f-47f9-9d4a-f4b09c9cf2e5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:29.975756 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:29.989289 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e488b-9f59-4420-bfbb-199870b2c249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:29.989874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e488b-9f59-4420-bfbb-199870b2c249 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:29.990813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e488b-9f59-4420-bfbb-199870b2c249 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:29.990813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e488b-9f59-4420-bfbb-199870b2c249 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:29.991071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e488b-9f59-4420-bfbb-199870b2c249 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:29.991368 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e488b-9f59-4420-bfbb-199870b2c249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:29.992754 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e488b-9f59-4420-bfbb-199870b2c249 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:30.005411 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 169/329] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:30.010794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e488b-9f59-4420-bfbb-199870b2c249 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:30.083913 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb31ec-be6f-47f9-9d4a-f4b09c9cf2e5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:30.129868 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32a125-3771-4963-9b05-281852237d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:30.130253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e488b-9f59-4420-bfbb-199870b2c249 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:30.131349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32a125-3771-4963-9b05-281852237d81 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:30.131629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32a125-3771-4963-9b05-281852237d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:30.131902 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32a125-3771-4963-9b05-281852237d81 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:30.132576 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32a125-3771-4963-9b05-281852237d81 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:30.132881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32a125-3771-4963-9b05-281852237d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:30.134494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32a125-3771-4963-9b05-281852237d81 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:30.145185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 161/330] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:30.151073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32a125-3771-4963-9b05-281852237d81 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:30.174271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55292a-cb74-40d8-9f45-ca76119d86f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:30.175477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55292a-cb74-40d8-9f45-ca76119d86f4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:30.175905 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55292a-cb74-40d8-9f45-ca76119d86f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:30.176180 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55292a-cb74-40d8-9f45-ca76119d86f4 None admin] PATH_INFO: `/v3/users/4d47a2eada9b492fb6da47a2154ef4ab` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:30.177815 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55292a-cb74-40d8-9f45-ca76119d86f4 None admin] RBAC: Authorizing `identity:get_user(user_id=4d47a2eada9b492fb6da47a2154ef4ab)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:30.179323 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55292a-cb74-40d8-9f45-ca76119d86f4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:30.181645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 170/331] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:30 2022] GET /identity/v3/users/4d47a2eada9b492fb6da47a2154ef4ab => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:30.189290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55292a-cb74-40d8-9f45-ca76119d86f4 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:30.205473 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:30.260211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:30.277985 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32a125-3771-4963-9b05-281852237d81 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:30.321831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55292a-cb74-40d8-9f45-ca76119d86f4 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:30.323039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca0882-4d4f-4dd0-a61d-e9916abc4807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:30.323877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca0882-4d4f-4dd0-a61d-e9916abc4807 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:30.324349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca0882-4d4f-4dd0-a61d-e9916abc4807 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:30.324840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca0882-4d4f-4dd0-a61d-e9916abc4807 None admin] PATH_INFO: `/v3/users/749b79a3162f4887b3de20b370121146` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:30.326029 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca0882-4d4f-4dd0-a61d-e9916abc4807 None admin] RBAC: Authorizing `identity:get_user(user_id=749b79a3162f4887b3de20b370121146)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:30.329612 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca0882-4d4f-4dd0-a61d-e9916abc4807 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:30.331081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 162/332] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:30 2022] GET /identity/v3/users/749b79a3162f4887b3de20b370121146 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:30.338601 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca0882-4d4f-4dd0-a61d-e9916abc4807 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:30.369089 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9783ad1-9240-4dd6-8bcc-677a024bc141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:30.370411 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9783ad1-9240-4dd6-8bcc-677a024bc141 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:30.371356 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9783ad1-9240-4dd6-8bcc-677a024bc141 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:30.371994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9783ad1-9240-4dd6-8bcc-677a024bc141 None admin] PATH_INFO: `/v3/system/users/4d47a2eada9b492fb6da47a2154ef4ab/roles/fe20f96b39034b82ae491a24ebbda3b4` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:30.374431 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9783ad1-9240-4dd6-8bcc-677a024bc141 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4d47a2eada9b492fb6da47a2154ef4ab, role_id=fe20f96b39034b82ae491a24ebbda3b4)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:30.377096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9783ad1-9240-4dd6-8bcc-677a024bc141 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:30.447169 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 171/333] 10.222.0.82 () {58 vars in 1334 bytes} [Fri Sep 23 15:09:30 2022] PUT /identity/v3/system/users/4d47a2eada9b492fb6da47a2154ef4ab/roles/fe20f96b39034b82ae491a24ebbda3b4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:09:30.457365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca0882-4d4f-4dd0-a61d-e9916abc4807 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:30.460296 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:30.499433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8240a73-4810-4e53-804a-95f322fc0b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:30.500077 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8240a73-4810-4e53-804a-95f322fc0b3f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:30.500357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8240a73-4810-4e53-804a-95f322fc0b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:30.500632 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8240a73-4810-4e53-804a-95f322fc0b3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:30.501711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8240a73-4810-4e53-804a-95f322fc0b3f None admin] RBAC: Adding query filter params (role.id=c18fbe0604b34383a2725a382d77d618, user.id=749b79a3162f4887b3de20b370121146, scope.system=all) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:30.502121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8240a73-4810-4e53-804a-95f322fc0b3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:30.503613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8240a73-4810-4e53-804a-95f322fc0b3f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:30.518323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 163/334] 10.222.0.82 () {56 vars in 1308 bytes} [Fri Sep 23 15:09:30 2022] GET /identity/v3/role_assignments?user.id=749b79a3162f4887b3de20b370121146&scope.system=all&role.id=c18fbe0604b34383a2725a382d77d618 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:32.290330 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134af373-4237-46db-9ec6-0863ab7b0b7c None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:32.290855 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134af373-4237-46db-9ec6-0863ab7b0b7c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:32.291081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134af373-4237-46db-9ec6-0863ab7b0b7c None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:32.292847 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 172/335] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:32.299015 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0abb2b-8b34-4fee-b7ac-09361266f5cb None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:32.299484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0abb2b-8b34-4fee-b7ac-09361266f5cb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:32.299557 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0abb2b-8b34-4fee-b7ac-09361266f5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:32.318673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2c0abb2b-8b34-4fee-b7ac-09361266f5cb None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:32.319890 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2c0abb2b-8b34-4fee-b7ac-09361266f5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:32.403302 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 164/336] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:09:32.950793 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134af373-4237-46db-9ec6-0863ab7b0b7c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:33.088529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134af373-4237-46db-9ec6-0863ab7b0b7c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:33.110567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:33.136550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bae936-e879-4ec4-8f48-e6e8894e3ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:33.137313 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bae936-e879-4ec4-8f48-e6e8894e3ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:33.137595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bae936-e879-4ec4-8f48-e6e8894e3ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:33.137897 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bae936-e879-4ec4-8f48-e6e8894e3ea0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:33.152804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bae936-e879-4ec4-8f48-e6e8894e3ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:33.158899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d7bae936-e879-4ec4-8f48-e6e8894e3ea0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:33.158899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:33.158899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:33.158899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:33.158899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:33.158899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:33.158899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:33.158899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:33.158899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:33.158899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:33.158899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:33.158899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:33.158899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:33.158899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:33.158899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:33.158899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:33.161310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:33.161310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:33.161310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:33.161310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:33.161310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:33.161310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:33.161310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:33.161310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:33.161310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:33.161310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:33.161310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:33.161310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:33.161310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:33.161310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:33.161310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:33.161310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:33.162137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:33.162137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:33.162137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:33.162137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:33.162137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:33.162137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:33.162137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:33.162137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:33.162137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:33.162137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:33.162137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:33.162137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:33.162137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 173/337] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:33.166481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0abb2b-8b34-4fee-b7ac-09361266f5cb None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:33.281428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:33.296143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0abb2b-8b34-4fee-b7ac-09361266f5cb None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:33.335116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c41331-4838-47de-ba18-5ebbdf5e9759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:33.335772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c41331-4838-47de-ba18-5ebbdf5e9759 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:33.336015 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c41331-4838-47de-ba18-5ebbdf5e9759 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:33.336268 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c41331-4838-47de-ba18-5ebbdf5e9759 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:33.336944 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c41331-4838-47de-ba18-5ebbdf5e9759 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:33.337244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c41331-4838-47de-ba18-5ebbdf5e9759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:33.338686 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c41331-4838-47de-ba18-5ebbdf5e9759 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:33.354505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 165/338] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:33.360348 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bae936-e879-4ec4-8f48-e6e8894e3ea0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:33.467333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e88e8-34d9-464c-8595-324182997491 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:33.467684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e88e8-34d9-464c-8595-324182997491 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:33.467891 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e88e8-34d9-464c-8595-324182997491 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:33.469478 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 166/339] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:33.487743 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bae936-e879-4ec4-8f48-e6e8894e3ea0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:33.493472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d69639-25f2-43bb-be09-d53d90f56c4b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:33.493786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d69639-25f2-43bb-be09-d53d90f56c4b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:33.494069 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d69639-25f2-43bb-be09-d53d90f56c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:33.522683 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-49d69639-25f2-43bb-be09-d53d90f56c4b None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:33.523890 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-49d69639-25f2-43bb-be09-d53d90f56c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:33.575947 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbe6dc-e94c-48e1-8fc1-7f9b07aeb1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:33.576494 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbe6dc-e94c-48e1-8fc1-7f9b07aeb1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:33.576770 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbe6dc-e94c-48e1-8fc1-7f9b07aeb1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:33.577039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbe6dc-e94c-48e1-8fc1-7f9b07aeb1d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:33.661772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 167/340] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 23 15:09:33.674109 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:33.706845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbe6dc-e94c-48e1-8fc1-7f9b07aeb1d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:33.708547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbe6dc-e94c-48e1-8fc1-7f9b07aeb1d8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:33.855330 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 174/341] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:33.861102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d69639-25f2-43bb-be09-d53d90f56c4b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:33.884605 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe5e49-089d-41dd-8b77-9daad547d665 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:33.884919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe5e49-089d-41dd-8b77-9daad547d665 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:33.885165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe5e49-089d-41dd-8b77-9daad547d665 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:33.886852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 175/342] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:33.892576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9a31-91e4-4b36-b566-af89c1caf878 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:33.892850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9a31-91e4-4b36-b566-af89c1caf878 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:33.893125 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9a31-91e4-4b36-b566-af89c1caf878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:33.934854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-86ba9a31-91e4-4b36-b566-af89c1caf878 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:33.936086 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-86ba9a31-91e4-4b36-b566-af89c1caf878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:33.998257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:34.015582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d69639-25f2-43bb-be09-d53d90f56c4b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:34.084385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c815458-048e-434c-9a93-b846d49031cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:34.085468 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c815458-048e-434c-9a93-b846d49031cb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:34.085970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c815458-048e-434c-9a93-b846d49031cb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:34.086464 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c815458-048e-434c-9a93-b846d49031cb None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:34.089221 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c815458-048e-434c-9a93-b846d49031cb None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:34.090941 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c815458-048e-434c-9a93-b846d49031cb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:34.094025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 168/343] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:33 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:34.096354 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f58ac9-f926-40b4-b564-3d8b9c68ed78 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:34.096905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f58ac9-f926-40b4-b564-3d8b9c68ed78 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:34.097371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f58ac9-f926-40b4-b564-3d8b9c68ed78 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:34.099229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 169/344] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:34.100154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f58ac9-f926-40b4-b564-3d8b9c68ed78 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:34.115653 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 176/345] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:09:34.116363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba9a31-91e4-4b36-b566-af89c1caf878 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:34.127846 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:34.256192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba9a31-91e4-4b36-b566-af89c1caf878 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:34.268304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f58ac9-f926-40b4-b564-3d8b9c68ed78 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:34.296311 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdf982-d0bb-4456-979a-21d460db9887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:34.297205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdf982-d0bb-4456-979a-21d460db9887 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:34.297481 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdf982-d0bb-4456-979a-21d460db9887 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:34.298213 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdf982-d0bb-4456-979a-21d460db9887 None admin] PATH_INFO: `/v3/groups/81298eaf8aff446a9413122da99a47c5` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:34.305166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdf982-d0bb-4456-979a-21d460db9887 None admin] RBAC: Authorizing `identity:get_group(group_id=81298eaf8aff446a9413122da99a47c5)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:34.306707 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdf982-d0bb-4456-979a-21d460db9887 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:34.308334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 177/346] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Sep 23 15:09:34 2022] GET /identity/v3/groups/81298eaf8aff446a9413122da99a47c5 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:34.309539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6508b-cb77-45fa-986e-b4c11aa8b55f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:34.310130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6508b-cb77-45fa-986e-b4c11aa8b55f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:34.310306 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6508b-cb77-45fa-986e-b4c11aa8b55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:34.315819 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114fe9f-b3f7-4da2-9510-5b961a298f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:34.316716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114fe9f-b3f7-4da2-9510-5b961a298f56 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:34.317217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114fe9f-b3f7-4da2-9510-5b961a298f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:34.317770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114fe9f-b3f7-4da2-9510-5b961a298f56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:34.332293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114fe9f-b3f7-4da2-9510-5b961a298f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:34.337772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-5114fe9f-b3f7-4da2-9510-5b961a298f56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:34.337772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:34.337772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:34.337772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:34.337772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:34.337772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:34.337772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:34.337772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:34.337772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:34.337772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:34.337772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:34.337772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:34.337772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:34.337772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:34.337772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:34.337772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:34.339092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:34.339092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:34.339092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:34.339092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:34.339092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:34.339092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:34.339092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:34.339092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:34.339092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:34.339092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:34.339092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:34.339092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:34.339092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:34.339092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:34.339092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:34.339092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:34.339912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:34.339912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:34.339912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:34.339912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:34.339912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:34.339912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:34.339912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:34.339912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:34.339912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:34.339912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:34.339912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:34.339912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:34.341545 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4be6508b-cb77-45fa-986e-b4c11aa8b55f None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:34.342496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 170/347] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:09:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:34.343417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4be6508b-cb77-45fa-986e-b4c11aa8b55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:34.344176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c37db-a50f-45ec-8488-d6cc8e12f78f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:34.344654 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c37db-a50f-45ec-8488-d6cc8e12f78f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:34.345172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c37db-a50f-45ec-8488-d6cc8e12f78f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:34.347831 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 171/348] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:34.348451 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c37db-a50f-45ec-8488-d6cc8e12f78f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:34.374372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:34.438248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 178/349] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:34.439241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6508b-cb77-45fa-986e-b4c11aa8b55f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:34.443723 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:34.498439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c37db-a50f-45ec-8488-d6cc8e12f78f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:34.552782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f497f3a-b46d-47e1-9c08-558bb4dcf9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:34.553422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f497f3a-b46d-47e1-9c08-558bb4dcf9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:34.553708 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f497f3a-b46d-47e1-9c08-558bb4dcf9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:34.554014 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f497f3a-b46d-47e1-9c08-558bb4dcf9b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:34.555037 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f497f3a-b46d-47e1-9c08-558bb4dcf9b1 None admin] RBAC: Adding query filter params (group.id=81298eaf8aff446a9413122da99a47c5, role.id=c18fbe0604b34383a2725a382d77d618, scope.project.id=2accefb496f94595afbc2ab6be270cae) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:34.555356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f497f3a-b46d-47e1-9c08-558bb4dcf9b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:34.557845 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f497f3a-b46d-47e1-9c08-558bb4dcf9b1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:34.564987 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 172/350] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Sep 23 15:09:34 2022] GET /identity/v3/role_assignments?group.id=81298eaf8aff446a9413122da99a47c5&scope.project.id=2accefb496f94595afbc2ab6be270cae&role.id=c18fbe0604b34383a2725a382d77d618 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:34.567332 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd399e-2a22-4276-83cd-f9cc78864a7a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:34.567460 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd399e-2a22-4276-83cd-f9cc78864a7a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:34.567668 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd399e-2a22-4276-83cd-f9cc78864a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:34.587916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6508b-cb77-45fa-986e-b4c11aa8b55f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:34.606721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9cdd399e-2a22-4276-83cd-f9cc78864a7a None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:34.608386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9cdd399e-2a22-4276-83cd-f9cc78864a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:34.662693 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6672936-cbf2-4706-bf36-bfadddd9f90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:34.663716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6672936-cbf2-4706-bf36-bfadddd9f90d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:34.664252 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6672936-cbf2-4706-bf36-bfadddd9f90d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:34.664762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6672936-cbf2-4706-bf36-bfadddd9f90d None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:34.665651 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6672936-cbf2-4706-bf36-bfadddd9f90d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:34.666208 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6672936-cbf2-4706-bf36-bfadddd9f90d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:34.667854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6672936-cbf2-4706-bf36-bfadddd9f90d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:34.685630 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 179/351] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:09:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:34.688245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6672936-cbf2-4706-bf36-bfadddd9f90d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:34.744634 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 173/352] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:34.746338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd399e-2a22-4276-83cd-f9cc78864a7a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:34.761976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:34.796396 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:34.851817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6672936-cbf2-4706-bf36-bfadddd9f90d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:34.890587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c733b-ca26-48bc-a896-312e6de8f985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:34.891224 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c733b-ca26-48bc-a896-312e6de8f985 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:34.891500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c733b-ca26-48bc-a896-312e6de8f985 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:34.891768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c733b-ca26-48bc-a896-312e6de8f985 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:34.903636 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c733b-ca26-48bc-a896-312e6de8f985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:34.910659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-268c733b-ca26-48bc-a896-312e6de8f985 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:09:34.910659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:34.910659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:34.910659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:34.910659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:34.910659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:34.910659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:34.910659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:34.910659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:34.910659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:34.910659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:34.910659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:34.910659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:34.910659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:34.910659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:34.910659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:34.911612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:34.911612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:34.911612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:34.911612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:34.911612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:34.911612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:34.911612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:34.911612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:34.911612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:34.911612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:34.911612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:34.911612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:34.911612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:34.911612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:34.911612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:34.911612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:34.912424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:34.912424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:34.912424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:34.912424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:34.912424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:34.912424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:34.912424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:34.912424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:34.912424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:34.912424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:34.912424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 15:09:34.912424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:34.913084 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 180/353] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:34.913652 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c733b-ca26-48bc-a896-312e6de8f985 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:34.945089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd399e-2a22-4276-83cd-f9cc78864a7a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:35.051091 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c631bdd-6c91-4ca0-b83a-c1b13bf738f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:35.051720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c631bdd-6c91-4ca0-b83a-c1b13bf738f9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:35.052001 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c631bdd-6c91-4ca0-b83a-c1b13bf738f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:35.052270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c631bdd-6c91-4ca0-b83a-c1b13bf738f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:35.064138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c733b-ca26-48bc-a896-312e6de8f985 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:35.108896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:35.122649 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f65393-d76f-4ed9-8117-fea69c416eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:35.123901 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f65393-d76f-4ed9-8117-fea69c416eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:35.124361 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f65393-d76f-4ed9-8117-fea69c416eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:35.125079 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f65393-d76f-4ed9-8117-fea69c416eb2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:35.144034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f65393-d76f-4ed9-8117-fea69c416eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:35.149241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-24f65393-d76f-4ed9-8117-fea69c416eb2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:35.149241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:35.149241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:35.149241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:35.149241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:35.149241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:35.149241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:35.149241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:35.149241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:35.149241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:35.149241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:35.149241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:35.149241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:35.149241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:35.149241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:35.149241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:35.150265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:35.150265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:35.150265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:35.150265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:35.150265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:35.150265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:35.150265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:35.150265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:35.150265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:35.150265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:35.150265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:35.150265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:35.150265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:35.150265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:35.150265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:35.150265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:35.151135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:35.151135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:35.151135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:35.151135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:35.151135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:35.151135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:35.151135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:35.151135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:35.151135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:35.151135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:35.151135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:35.151135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:35.154801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 181/354] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:09:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:35.155635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f65393-d76f-4ed9-8117-fea69c416eb2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:35.158815 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c631bdd-6c91-4ca0-b83a-c1b13bf738f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:35.160292 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c631bdd-6c91-4ca0-b83a-c1b13bf738f9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:35.170300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:35.284890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f65393-d76f-4ed9-8117-fea69c416eb2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:35.296254 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 174/355] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:35.297869 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c631bdd-6c91-4ca0-b83a-c1b13bf738f9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:35.341569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ff08c-992b-41e5-9de0-e438a98df795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:35.342414 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ff08c-992b-41e5-9de0-e438a98df795 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:35.342696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ff08c-992b-41e5-9de0-e438a98df795 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:35.342970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ff08c-992b-41e5-9de0-e438a98df795 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:35.343699 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ff08c-992b-41e5-9de0-e438a98df795 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:35.344006 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ff08c-992b-41e5-9de0-e438a98df795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:35.345542 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ff08c-992b-41e5-9de0-e438a98df795 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:35.355602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 182/356] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:35.356868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd8406-8d73-4677-b0f5-a9758a168d0e None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:35.357152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd8406-8d73-4677-b0f5-a9758a168d0e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:35.357426 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd8406-8d73-4677-b0f5-a9758a168d0e None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:35.358972 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 183/357] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:35.359806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd8406-8d73-4677-b0f5-a9758a168d0e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:35.429118 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:35.435914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c631bdd-6c91-4ca0-b83a-c1b13bf738f9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:35.447109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:35.500639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db833b34-34ea-4916-9f11-dc0c94c8b430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:35.501948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db833b34-34ea-4916-9f11-dc0c94c8b430 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:35.502232 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db833b34-34ea-4916-9f11-dc0c94c8b430 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:35.502501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db833b34-34ea-4916-9f11-dc0c94c8b430 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:35.513542 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db833b34-34ea-4916-9f11-dc0c94c8b430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:35.518541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-db833b34-34ea-4916-9f11-dc0c94c8b430 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:35.518541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:35.518541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:35.518541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:35.518541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:35.518541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:35.518541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:35.518541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:35.518541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:35.518541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:35.518541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:35.518541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:35.518541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:35.518541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:35.518541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:35.518541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:35.519599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:35.519599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:35.519599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:35.519599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:35.519599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:35.519599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:35.519599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:35.519599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:35.519599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:35.519599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:35.519599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:35.519599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:35.519599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:35.519599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:35.519599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:35.519599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:35.520635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:35.520635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:35.520635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:35.520635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:35.520635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:35.520635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:35.520635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:35.520635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:35.520635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:35.520635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:35.520635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:35.520635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:35.521303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd8406-8d73-4677-b0f5-a9758a168d0e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:35.529399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 175/358] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:35.530124 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db833b34-34ea-4916-9f11-dc0c94c8b430 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:35.568786 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d64d1-d3ca-4667-8079-3d3ff063c038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:35.570098 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d64d1-d3ca-4667-8079-3d3ff063c038 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:35.570693 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d64d1-d3ca-4667-8079-3d3ff063c038 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:35.571147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d64d1-d3ca-4667-8079-3d3ff063c038 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:35.571822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d64d1-d3ca-4667-8079-3d3ff063c038 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:35.572123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d64d1-d3ca-4667-8079-3d3ff063c038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:35.573523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d64d1-d3ca-4667-8079-3d3ff063c038 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:35.584565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 184/359] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:09:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:35.585424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d64d1-d3ca-4667-8079-3d3ff063c038 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:35.664747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db833b34-34ea-4916-9f11-dc0c94c8b430 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:35.706770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e51dec-f239-4e2f-896b-99969fa8b90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:35.707415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51dec-f239-4e2f-896b-99969fa8b90c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:35.707694 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51dec-f239-4e2f-896b-99969fa8b90c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:35.707968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e51dec-f239-4e2f-896b-99969fa8b90c None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:35.709266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e51dec-f239-4e2f-896b-99969fa8b90c None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:35.710765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e51dec-f239-4e2f-896b-99969fa8b90c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:35.712529 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 176/360] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:35 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:35.714035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050daa76-af10-4914-b73f-77440f18181a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:35.714320 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050daa76-af10-4914-b73f-77440f18181a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:35.714592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050daa76-af10-4914-b73f-77440f18181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:35.724505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d64d1-d3ca-4667-8079-3d3ff063c038 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:35.734728 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-050daa76-af10-4914-b73f-77440f18181a None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:35.736534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-050daa76-af10-4914-b73f-77440f18181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:35.739984 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:35.771355 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc10c6e-a2f4-4e2b-b115-82d124b9a35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:35.771992 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc10c6e-a2f4-4e2b-b115-82d124b9a35e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:35.772269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc10c6e-a2f4-4e2b-b115-82d124b9a35e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:35.772544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc10c6e-a2f4-4e2b-b115-82d124b9a35e None admin] PATH_INFO: `/v3/users/4d47a2eada9b492fb6da47a2154ef4ab` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:35.772869 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:35.774809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc10c6e-a2f4-4e2b-b115-82d124b9a35e None admin] RBAC: Authorizing `identity:get_user(user_id=4d47a2eada9b492fb6da47a2154ef4ab)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:35.775383 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc10c6e-a2f4-4e2b-b115-82d124b9a35e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:35.777383 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 185/361] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:09:35 2022] GET /identity/v3/users/4d47a2eada9b492fb6da47a2154ef4ab => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:35.778577 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc10c6e-a2f4-4e2b-b115-82d124b9a35e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:35.825237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 177/362] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:35.826545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050daa76-af10-4914-b73f-77440f18181a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:35.921487 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc10c6e-a2f4-4e2b-b115-82d124b9a35e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:35.982141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050daa76-af10-4914-b73f-77440f18181a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:35.986511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68359c27-184b-4d19-a079-b4c0466282c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:35.987159 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68359c27-184b-4d19-a079-b4c0466282c8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:35.987433 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68359c27-184b-4d19-a079-b4c0466282c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:35.987705 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68359c27-184b-4d19-a079-b4c0466282c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:35.988430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68359c27-184b-4d19-a079-b4c0466282c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:35.988729 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68359c27-184b-4d19-a079-b4c0466282c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:35.990192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68359c27-184b-4d19-a079-b4c0466282c8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:36.001219 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 186/363] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:36.002185 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68359c27-184b-4d19-a079-b4c0466282c8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:36.030561 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570cdf-f720-41b0-9d7f-50dd61fd68bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:36.031564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570cdf-f720-41b0-9d7f-50dd61fd68bf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:36.032036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570cdf-f720-41b0-9d7f-50dd61fd68bf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:36.033114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570cdf-f720-41b0-9d7f-50dd61fd68bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:36.053007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:36.084376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:36.145100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f570cdf-f720-41b0-9d7f-50dd61fd68bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:36.146627 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f570cdf-f720-41b0-9d7f-50dd61fd68bf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:36.158143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68359c27-184b-4d19-a079-b4c0466282c8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:36.208189 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfe4b2-0f57-451d-85c0-8d9b7c843607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:36.208843 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfe4b2-0f57-451d-85c0-8d9b7c843607 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:36.209155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfe4b2-0f57-451d-85c0-8d9b7c843607 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:36.209390 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfe4b2-0f57-451d-85c0-8d9b7c843607 None admin] PATH_INFO: `/v3/groups/81298eaf8aff446a9413122da99a47c5` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:36.215087 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfe4b2-0f57-451d-85c0-8d9b7c843607 None admin] RBAC: Authorizing `identity:get_group(group_id=81298eaf8aff446a9413122da99a47c5)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:36.215383 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfe4b2-0f57-451d-85c0-8d9b7c843607 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:36.217945 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 187/364] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Sep 23 15:09:36 2022] GET /identity/v3/groups/81298eaf8aff446a9413122da99a47c5 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:36.218119 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfe4b2-0f57-451d-85c0-8d9b7c843607 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:36.289323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 178/365] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:36.290190 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570cdf-f720-41b0-9d7f-50dd61fd68bf None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:36.366202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfe4b2-0f57-451d-85c0-8d9b7c843607 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:36.375403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:36.376853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:36.419637 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c9678-408c-4442-9cca-41598cbedee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:36.420896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c9678-408c-4442-9cca-41598cbedee6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:36.421391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c9678-408c-4442-9cca-41598cbedee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:36.421952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c9678-408c-4442-9cca-41598cbedee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:36.422790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c9678-408c-4442-9cca-41598cbedee6 None admin] RBAC: Adding query filter params (role.id=fe20f96b39034b82ae491a24ebbda3b4, user.id=4d47a2eada9b492fb6da47a2154ef4ab, scope.system=all) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:36.423125 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c9678-408c-4442-9cca-41598cbedee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:36.424800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c9678-408c-4442-9cca-41598cbedee6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:36.432511 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570cdf-f720-41b0-9d7f-50dd61fd68bf None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:36.449048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 188/366] 10.222.0.82 () {56 vars in 1308 bytes} [Fri Sep 23 15:09:36 2022] GET /identity/v3/role_assignments?user.id=4d47a2eada9b492fb6da47a2154ef4ab&scope.system=all&role.id=fe20f96b39034b82ae491a24ebbda3b4 => generated 510 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:36.450093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c9678-408c-4442-9cca-41598cbedee6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:36.476021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e514f-6dfc-4a09-8a1d-f1b991501cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:36.477258 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e514f-6dfc-4a09-8a1d-f1b991501cde None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:36.477810 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e514f-6dfc-4a09-8a1d-f1b991501cde None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:36.478312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e514f-6dfc-4a09-8a1d-f1b991501cde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:36.583428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e514f-6dfc-4a09-8a1d-f1b991501cde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:36.585292 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e514f-6dfc-4a09-8a1d-f1b991501cde None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:36.616408 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c9678-408c-4442-9cca-41598cbedee6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:36.667787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65540851-f0c1-4229-8161-1d77d84ba278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:36.668690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65540851-f0c1-4229-8161-1d77d84ba278 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:36.668970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65540851-f0c1-4229-8161-1d77d84ba278 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:36.669240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65540851-f0c1-4229-8161-1d77d84ba278 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:36.681695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:36.686370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65540851-f0c1-4229-8161-1d77d84ba278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:36.692386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-65540851-f0c1-4229-8161-1d77d84ba278 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:09:36.692386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:36.692386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:36.692386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:36.692386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:36.692386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:36.692386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:36.692386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:36.692386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:36.692386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:36.692386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:36.692386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:36.692386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:36.692386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:36.692386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:36.692386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:36.702920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:36.702920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:36.702920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:36.702920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:36.702920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:36.702920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:36.702920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:36.702920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:36.702920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:36.702920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:36.702920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:36.702920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:36.702920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:36.702920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:36.702920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:36.702920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:36.703909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:36.703909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:36.703909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:36.703909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:36.703909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:36.703909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:36.703909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:36.703909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:36.703909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:36.703909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:36.703909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:09:36.703909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:36.703909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 189/367] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:09:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:36.703909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65540851-f0c1-4229-8161-1d77d84ba278 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:36.723276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:36.738026 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 179/368] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:36.738894 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e514f-6dfc-4a09-8a1d-f1b991501cde None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:36.821919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65540851-f0c1-4229-8161-1d77d84ba278 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:36.866567 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e514f-6dfc-4a09-8a1d-f1b991501cde None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:36.872401 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f3757-e8b4-4076-a2f0-d519924639c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:36.873013 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f3757-e8b4-4076-a2f0-d519924639c0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:36.873288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f3757-e8b4-4076-a2f0-d519924639c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:36.873640 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f3757-e8b4-4076-a2f0-d519924639c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:36.874788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f3757-e8b4-4076-a2f0-d519924639c0 None admin] RBAC: Adding query filter params (group.id=81298eaf8aff446a9413122da99a47c5, role.id=acaa0e7c8246470aa47504d9bc3ae56f, scope.project.id=2accefb496f94595afbc2ab6be270cae) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:36.875107 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f3757-e8b4-4076-a2f0-d519924639c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:36.877131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f3757-e8b4-4076-a2f0-d519924639c0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:36.889826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 190/369] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Sep 23 15:09:36 2022] GET /identity/v3/role_assignments?group.id=81298eaf8aff446a9413122da99a47c5&scope.project.id=2accefb496f94595afbc2ab6be270cae&role.id=acaa0e7c8246470aa47504d9bc3ae56f => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:36.889826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f3757-e8b4-4076-a2f0-d519924639c0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:36.926581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e34bc-5fcd-496c-81cb-5eb12a2a787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:36.927663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e34bc-5fcd-496c-81cb-5eb12a2a787d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:36.928481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e34bc-5fcd-496c-81cb-5eb12a2a787d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:36.928760 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e34bc-5fcd-496c-81cb-5eb12a2a787d None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:36.930385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e34bc-5fcd-496c-81cb-5eb12a2a787d None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:36.933600 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e34bc-5fcd-496c-81cb-5eb12a2a787d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:36.935976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 180/370] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:36 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:36.937083 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e34bc-5fcd-496c-81cb-5eb12a2a787d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:36.998837 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:37.020524 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:37.036350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f3757-e8b4-4076-a2f0-d519924639c0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:37.083938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63f70a-35e3-4f9f-89f1-43258f469f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:37.084740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63f70a-35e3-4f9f-89f1-43258f469f45 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:37.085117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63f70a-35e3-4f9f-89f1-43258f469f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:37.086058 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63f70a-35e3-4f9f-89f1-43258f469f45 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:37.086852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63f70a-35e3-4f9f-89f1-43258f469f45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:37.087438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63f70a-35e3-4f9f-89f1-43258f469f45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:37.089211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63f70a-35e3-4f9f-89f1-43258f469f45 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:37.101023 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e34bc-5fcd-496c-81cb-5eb12a2a787d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:37.102873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 191/371] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:37.108353 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63f70a-35e3-4f9f-89f1-43258f469f45 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:37.152442 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2be11-d021-4236-ac94-02dfd9f707b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:37.153061 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2be11-d021-4236-ac94-02dfd9f707b8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:37.153286 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2be11-d021-4236-ac94-02dfd9f707b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:37.153549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2be11-d021-4236-ac94-02dfd9f707b8 None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:37.154835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2be11-d021-4236-ac94-02dfd9f707b8 None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:37.156304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2be11-d021-4236-ac94-02dfd9f707b8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:37.158530 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 181/372] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:36 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:37.159436 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2be11-d021-4236-ac94-02dfd9f707b8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:37.231232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63f70a-35e3-4f9f-89f1-43258f469f45 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:37.265704 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:37.270661 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2be11-d021-4236-ac94-02dfd9f707b8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:37.272062 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e104a83-ef9b-45e5-b301-5c9106d0c148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:37.272925 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e104a83-ef9b-45e5-b301-5c9106d0c148 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:37.273204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e104a83-ef9b-45e5-b301-5c9106d0c148 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:37.273534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e104a83-ef9b-45e5-b301-5c9106d0c148 None admin] PATH_INFO: `/v3/groups/81298eaf8aff446a9413122da99a47c5` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:37.275011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e104a83-ef9b-45e5-b301-5c9106d0c148 None admin] RBAC: Authorizing `identity:get_group(group_id=81298eaf8aff446a9413122da99a47c5)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:37.276479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e104a83-ef9b-45e5-b301-5c9106d0c148 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:37.281907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 192/373] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Sep 23 15:09:37 2022] GET /identity/v3/groups/81298eaf8aff446a9413122da99a47c5 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:37.285626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079742fb-1d05-45ba-8991-3d489d51aa16 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:37.287355 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079742fb-1d05-45ba-8991-3d489d51aa16 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:37.287520 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079742fb-1d05-45ba-8991-3d489d51aa16 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:37.289053 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 193/374] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:37.290752 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079742fb-1d05-45ba-8991-3d489d51aa16 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:37.319170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:37.325283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d7595-0e12-412b-803d-39e17b2bbaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:37.325283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d7595-0e12-412b-803d-39e17b2bbaaf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:37.325800 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d7595-0e12-412b-803d-39e17b2bbaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:37.326082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d7595-0e12-412b-803d-39e17b2bbaaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:37.421080 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d7595-0e12-412b-803d-39e17b2bbaaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:37.423430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d7595-0e12-412b-803d-39e17b2bbaaf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:37.423806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079742fb-1d05-45ba-8991-3d489d51aa16 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:37.466963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd2628-395c-418a-acc3-e864b2c157b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:37.467664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd2628-395c-418a-acc3-e864b2c157b4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:37.467938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd2628-395c-418a-acc3-e864b2c157b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:37.468206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd2628-395c-418a-acc3-e864b2c157b4 None admin] PATH_INFO: `/v3/groups/81298eaf8aff446a9413122da99a47c5` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:37.469334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd2628-395c-418a-acc3-e864b2c157b4 None admin] RBAC: Authorizing `identity:get_group(group_id=81298eaf8aff446a9413122da99a47c5)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:37.471311 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd2628-395c-418a-acc3-e864b2c157b4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:37.473221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 194/375] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Sep 23 15:09:37 2022] GET /identity/v3/groups/81298eaf8aff446a9413122da99a47c5 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:37.474028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd2628-395c-418a-acc3-e864b2c157b4 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:37.551153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:37.556700 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 182/376] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:37.558564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d1d03-9d6e-4954-8e68-ab0733a78db5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:37.559619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d1d03-9d6e-4954-8e68-ab0733a78db5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:37.560098 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d1d03-9d6e-4954-8e68-ab0733a78db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:37.582223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f78d1d03-9d6e-4954-8e68-ab0733a78db5 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:37.583820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f78d1d03-9d6e-4954-8e68-ab0733a78db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:37.585040 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:37.606650 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd2628-395c-418a-acc3-e864b2c157b4 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:37.652574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a955e36-950c-4fb3-9f55-3fb05406d961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:37.653186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955e36-950c-4fb3-9f55-3fb05406d961 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:37.653487 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955e36-950c-4fb3-9f55-3fb05406d961 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:37.653773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955e36-950c-4fb3-9f55-3fb05406d961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:37.654512 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a955e36-950c-4fb3-9f55-3fb05406d961 None admin] RBAC: Adding query filter params (group.id=81298eaf8aff446a9413122da99a47c5, role.id=acaa0e7c8246470aa47504d9bc3ae56f, scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:37.654819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a955e36-950c-4fb3-9f55-3fb05406d961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:37.656254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a955e36-950c-4fb3-9f55-3fb05406d961 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:37.663341 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 195/377] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Sep 23 15:09:37 2022] GET /identity/v3/role_assignments?group.id=81298eaf8aff446a9413122da99a47c5&scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651&role.id=acaa0e7c8246470aa47504d9bc3ae56f => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:37.666606 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a955e36-950c-4fb3-9f55-3fb05406d961 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:37.680873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 183/378] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:37.682162 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d1d03-9d6e-4954-8e68-ab0733a78db5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:37.857308 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a955e36-950c-4fb3-9f55-3fb05406d961 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:37.872920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d1d03-9d6e-4954-8e68-ab0733a78db5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:37.929610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:37.935529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23473035-ce07-47da-8f99-da9e97efd519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:37.936051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23473035-ce07-47da-8f99-da9e97efd519 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:37.936382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23473035-ce07-47da-8f99-da9e97efd519 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:37.936677 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23473035-ce07-47da-8f99-da9e97efd519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:37.938507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23473035-ce07-47da-8f99-da9e97efd519 None admin] RBAC: Adding query filter params (group.id=81298eaf8aff446a9413122da99a47c5, role.id=c18fbe0604b34383a2725a382d77d618, scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:37.938507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23473035-ce07-47da-8f99-da9e97efd519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:37.939694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23473035-ce07-47da-8f99-da9e97efd519 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:37.941757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a37838-de58-4001-a0d0-ac5ca67dcba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:37.943826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a37838-de58-4001-a0d0-ac5ca67dcba8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:37.943826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a37838-de58-4001-a0d0-ac5ca67dcba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:37.943826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a37838-de58-4001-a0d0-ac5ca67dcba8 None admin] PATH_INFO: `/v3/projects/9413a28bc00744258077edf9f566b1b7` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:37.945799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a37838-de58-4001-a0d0-ac5ca67dcba8 None admin] RBAC: Authorizing `identity:get_project(project_id=9413a28bc00744258077edf9f566b1b7)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:37.947540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a37838-de58-4001-a0d0-ac5ca67dcba8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:37.947926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 196/379] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Sep 23 15:09:37 2022] GET /identity/v3/role_assignments?group.id=81298eaf8aff446a9413122da99a47c5&scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651&role.id=c18fbe0604b34383a2725a382d77d618 => generated 260 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:37.954126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 184/380] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:37 2022] GET /identity/v3/projects/9413a28bc00744258077edf9f566b1b7 => generated 344 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:37.955311 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23473035-ce07-47da-8f99-da9e97efd519 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:37.974416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a37838-de58-4001-a0d0-ac5ca67dcba8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:37.982247 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:38.102525 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23473035-ce07-47da-8f99-da9e97efd519 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:38.164705 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc7d50-7a3f-4f14-a0c0-89d40be6f463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:38.165937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc7d50-7a3f-4f14-a0c0-89d40be6f463 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:38.166810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc7d50-7a3f-4f14-a0c0-89d40be6f463 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:38.167404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc7d50-7a3f-4f14-a0c0-89d40be6f463 None admin] PATH_INFO: `/v3/groups/bd4d70e961df425ebb0d15687be3584d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:38.173262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a37838-de58-4001-a0d0-ac5ca67dcba8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:38.174964 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc7d50-7a3f-4f14-a0c0-89d40be6f463 None admin] RBAC: Authorizing `identity:get_group(group_id=bd4d70e961df425ebb0d15687be3584d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:38.177538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc7d50-7a3f-4f14-a0c0-89d40be6f463 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:38.179677 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 197/381] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Sep 23 15:09:37 2022] GET /identity/v3/groups/bd4d70e961df425ebb0d15687be3584d => generated 229 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:38.186063 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc7d50-7a3f-4f14-a0c0-89d40be6f463 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:38.261370 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f27428-06b6-45d8-93ec-1fab8ed77504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:38.262059 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f27428-06b6-45d8-93ec-1fab8ed77504 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:38.262340 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f27428-06b6-45d8-93ec-1fab8ed77504 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:38.262611 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f27428-06b6-45d8-93ec-1fab8ed77504 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:38.290116 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:38.290442 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f27428-06b6-45d8-93ec-1fab8ed77504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:38.295346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-59f27428-06b6-45d8-93ec-1fab8ed77504 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:38.295346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:38.295346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:38.295346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:38.295346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:38.295346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:38.295346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:38.295346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:38.295346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:38.295346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:38.295346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:38.295346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:38.295346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:38.295346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:38.295346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:38.295346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:38.296241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:38.296241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:38.296241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:38.296241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:38.296241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:38.296241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:38.296241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:38.296241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:38.296241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:38.296241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:38.296241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:38.296241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:38.296241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:38.296241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:38.296241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:38.296241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:38.297312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:38.297312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:38.297312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:38.297312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:38.297312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:38.297312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:38.297312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:38.297312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:38.297312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:38.297312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:38.297312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:38.297312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:38.297312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 185/382] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:09:38.304899 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f27428-06b6-45d8-93ec-1fab8ed77504 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:38.310110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc7d50-7a3f-4f14-a0c0-89d40be6f463 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:38.342911 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6593b-2b37-44be-88ef-a5d6b79ed2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:38.343528 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6593b-2b37-44be-88ef-a5d6b79ed2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:38.343808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6593b-2b37-44be-88ef-a5d6b79ed2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:38.344080 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6593b-2b37-44be-88ef-a5d6b79ed2c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:38.345370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6593b-2b37-44be-88ef-a5d6b79ed2c8 None admin] RBAC: Adding query filter params (group.id=bd4d70e961df425ebb0d15687be3584d, role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=9413a28bc00744258077edf9f566b1b7) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:38.345680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6593b-2b37-44be-88ef-a5d6b79ed2c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:38.347830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6593b-2b37-44be-88ef-a5d6b79ed2c8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:38.353805 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 198/383] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Sep 23 15:09:38 2022] GET /identity/v3/role_assignments?group.id=bd4d70e961df425ebb0d15687be3584d&scope.project.id=9413a28bc00744258077edf9f566b1b7&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:38.436744 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:38.508380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f27428-06b6-45d8-93ec-1fab8ed77504 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:38.560676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18377ef-7d8f-47a8-869e-1687097d78ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:38.561402 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18377ef-7d8f-47a8-869e-1687097d78ae None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:38.561629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18377ef-7d8f-47a8-869e-1687097d78ae None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:38.562034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18377ef-7d8f-47a8-869e-1687097d78ae None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:38.562746 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18377ef-7d8f-47a8-869e-1687097d78ae None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:38.563045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18377ef-7d8f-47a8-869e-1687097d78ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:38.564439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18377ef-7d8f-47a8-869e-1687097d78ae None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:38.574485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 186/384] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:38.582883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6593b-2b37-44be-88ef-a5d6b79ed2c8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:38.708165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6593b-2b37-44be-88ef-a5d6b79ed2c8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:38.749762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd82b4-0f13-4599-bbcc-862a8fc9d93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:38.750403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd82b4-0f13-4599-bbcc-862a8fc9d93e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:38.751181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd82b4-0f13-4599-bbcc-862a8fc9d93e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:38.751454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd82b4-0f13-4599-bbcc-862a8fc9d93e None admin] PATH_INFO: `/v3/groups/81298eaf8aff446a9413122da99a47c5` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:38.752588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd82b4-0f13-4599-bbcc-862a8fc9d93e None admin] RBAC: Authorizing `identity:get_group(group_id=81298eaf8aff446a9413122da99a47c5)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:38.754055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd82b4-0f13-4599-bbcc-862a8fc9d93e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:38.756033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 199/385] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Sep 23 15:09:38 2022] GET /identity/v3/groups/81298eaf8aff446a9413122da99a47c5 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:38.762278 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18377ef-7d8f-47a8-869e-1687097d78ae None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:38.888084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18377ef-7d8f-47a8-869e-1687097d78ae None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:38.914192 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:38.930882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241739a-24b9-461f-835c-043674b23d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:38.931758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241739a-24b9-461f-835c-043674b23d4f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:38.932042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241739a-24b9-461f-835c-043674b23d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:38.932314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241739a-24b9-461f-835c-043674b23d4f None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:38.933864 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241739a-24b9-461f-835c-043674b23d4f None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:38.936042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241739a-24b9-461f-835c-043674b23d4f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:38.938264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 187/386] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:38 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:38.946559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd82b4-0f13-4599-bbcc-862a8fc9d93e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:38.973260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:39.089426 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd82b4-0f13-4599-bbcc-862a8fc9d93e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:39.135446 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6fabf-d369-4898-a6b1-6fa6e471c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:39.136130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6fabf-d369-4898-a6b1-6fa6e471c487 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:39.136407 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6fabf-d369-4898-a6b1-6fa6e471c487 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:39.136677 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6fabf-d369-4898-a6b1-6fa6e471c487 None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae/groups/81298eaf8aff446a9413122da99a47c5/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:39.140133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6fabf-d369-4898-a6b1-6fa6e471c487 None admin] RBAC: Authorizing `identity:create_grant(project_id=2accefb496f94595afbc2ab6be270cae, group_id=81298eaf8aff446a9413122da99a47c5, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:39.142155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6fabf-d369-4898-a6b1-6fa6e471c487 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:39.251577 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 200/387] 10.222.0.82 () {58 vars in 1442 bytes} [Fri Sep 23 15:09:38 2022] PUT /identity/v3/projects/2accefb496f94595afbc2ab6be270cae/groups/81298eaf8aff446a9413122da99a47c5/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:09:39.361776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaca979-4491-4256-a917-b045ffcbb275 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:39.362135 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaca979-4491-4256-a917-b045ffcbb275 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:39.362399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaca979-4491-4256-a917-b045ffcbb275 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:39.364037 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 188/388] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:39.370389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926163f7-d6f3-4c81-9aab-d16ae73a539b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:39.371007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926163f7-d6f3-4c81-9aab-d16ae73a539b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:39.371560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926163f7-d6f3-4c81-9aab-d16ae73a539b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:39.391834 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-926163f7-d6f3-4c81-9aab-d16ae73a539b None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:39.393499 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-926163f7-d6f3-4c81-9aab-d16ae73a539b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:39.465551 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:39.471413 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 201/389] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:39.801284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaca979-4491-4256-a917-b045ffcbb275 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:39.927521 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaca979-4491-4256-a917-b045ffcbb275 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:39.989160 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d80e5d-2cf3-4f47-a410-daf83c7c8d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:39.990143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d80e5d-2cf3-4f47-a410-daf83c7c8d2a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:39.990605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d80e5d-2cf3-4f47-a410-daf83c7c8d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:39.991086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d80e5d-2cf3-4f47-a410-daf83c7c8d2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:40.005628 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d80e5d-2cf3-4f47-a410-daf83c7c8d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:40.011422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-25d80e5d-2cf3-4f47-a410-daf83c7c8d2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:40.011422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:40.011422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:40.011422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:40.011422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:40.011422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:40.011422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:40.011422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:40.011422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:40.011422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:40.011422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:40.011422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:40.011422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:40.011422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:40.011422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:40.011422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:40.012371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:40.012371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:40.012371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:40.012371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:40.012371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:40.012371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:40.012371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:40.012371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:40.012371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:40.012371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:40.012371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:40.012371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:40.012371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:40.012371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:40.012371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:40.012371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:40.013214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:40.013214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:40.013214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:40.013214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:40.013214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:40.013214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:40.013214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:40.013214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:40.013214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:40.013214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:40.013214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:40.013214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:40.015212 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 189/390] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:09:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:40.021256 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926163f7-d6f3-4c81-9aab-d16ae73a539b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:40.166502 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926163f7-d6f3-4c81-9aab-d16ae73a539b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:40.212278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70efebb-770d-431f-9e5c-a23e72087ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:40.212923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70efebb-770d-431f-9e5c-a23e72087ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:40.213206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70efebb-770d-431f-9e5c-a23e72087ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:40.213479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70efebb-770d-431f-9e5c-a23e72087ff2 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:40.214341 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70efebb-770d-431f-9e5c-a23e72087ff2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:40.214690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70efebb-770d-431f-9e5c-a23e72087ff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:40.216151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70efebb-770d-431f-9e5c-a23e72087ff2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:40.230531 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 202/391] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:09:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:40.236665 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d80e5d-2cf3-4f47-a410-daf83c7c8d2a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:40.309078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:40.340871 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c914d-e317-44f0-999b-7e126366c1b2 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:40.341267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c914d-e317-44f0-999b-7e126366c1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:40.341671 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c914d-e317-44f0-999b-7e126366c1b2 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:40.343182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 203/392] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:09:40.349009 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38953e19-b025-4eb2-a57b-624ea03ec87b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:40.349300 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38953e19-b025-4eb2-a57b-624ea03ec87b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:40.349579 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38953e19-b025-4eb2-a57b-624ea03ec87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:40.380953 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d80e5d-2cf3-4f47-a410-daf83c7c8d2a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:40.385136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-38953e19-b025-4eb2-a57b-624ea03ec87b None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:40.386382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-38953e19-b025-4eb2-a57b-624ea03ec87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:40.442056 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8a014-bde6-442b-91e9-7d61db078fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:40.442610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8a014-bde6-442b-91e9-7d61db078fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:40.442890 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8a014-bde6-442b-91e9-7d61db078fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:40.443163 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8a014-bde6-442b-91e9-7d61db078fb4 None admin] PATH_INFO: `/v3/groups/81298eaf8aff446a9413122da99a47c5` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:40.445007 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8a014-bde6-442b-91e9-7d61db078fb4 None admin] RBAC: Authorizing `identity:get_group(group_id=81298eaf8aff446a9413122da99a47c5)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:40.447269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8a014-bde6-442b-91e9-7d61db078fb4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:40.451397 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 190/393] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Sep 23 15:09:40 2022] GET /identity/v3/groups/81298eaf8aff446a9413122da99a47c5 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:40.454766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8a014-bde6-442b-91e9-7d61db078fb4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:40.482678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:40.495006 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 204/394] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:40.595436 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8a014-bde6-442b-91e9-7d61db078fb4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:40.613191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:40.631543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89187cbb-e191-4a46-bf32-46dc52c6e72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:40.632177 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89187cbb-e191-4a46-bf32-46dc52c6e72f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:40.632459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89187cbb-e191-4a46-bf32-46dc52c6e72f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:40.632737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89187cbb-e191-4a46-bf32-46dc52c6e72f None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:40.633974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89187cbb-e191-4a46-bf32-46dc52c6e72f None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:40.635412 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89187cbb-e191-4a46-bf32-46dc52c6e72f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:40.637345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 191/395] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:40 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:40.643352 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38953e19-b025-4eb2-a57b-624ea03ec87b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:40.679200 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155a8b5-cc68-4357-998f-6d78039feb0f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:40.679516 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155a8b5-cc68-4357-998f-6d78039feb0f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:40.679754 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155a8b5-cc68-4357-998f-6d78039feb0f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:40.682350 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 192/396] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:09:40.686350 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c654b-30fb-4f2e-b955-e7ef30926363 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:40.686631 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c654b-30fb-4f2e-b955-e7ef30926363 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:40.686977 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c654b-30fb-4f2e-b955-e7ef30926363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:40.713074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f75c654b-30fb-4f2e-b955-e7ef30926363 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:40.714284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f75c654b-30fb-4f2e-b955-e7ef30926363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:40.794411 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38953e19-b025-4eb2-a57b-624ea03ec87b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:40.842127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 193/397] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:09:40.850235 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d1db6-4b84-41f4-ab70-37585577f371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:40.850904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d1db6-4b84-41f4-ab70-37585577f371 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:40.851183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d1db6-4b84-41f4-ab70-37585577f371 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:40.851458 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d1db6-4b84-41f4-ab70-37585577f371 None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae/groups/81298eaf8aff446a9413122da99a47c5/roles/acaa0e7c8246470aa47504d9bc3ae56f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:40.853637 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d1db6-4b84-41f4-ab70-37585577f371 None admin] RBAC: Authorizing `identity:create_grant(project_id=2accefb496f94595afbc2ab6be270cae, group_id=81298eaf8aff446a9413122da99a47c5, role_id=acaa0e7c8246470aa47504d9bc3ae56f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:40.855145 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d1db6-4b84-41f4-ab70-37585577f371 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:40.879967 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c654b-30fb-4f2e-b955-e7ef30926363 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:40.965549 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 205/398] 10.222.0.82 () {58 vars in 1442 bytes} [Fri Sep 23 15:09:40 2022] PUT /identity/v3/projects/2accefb496f94595afbc2ab6be270cae/groups/81298eaf8aff446a9413122da99a47c5/roles/acaa0e7c8246470aa47504d9bc3ae56f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:09:41.013039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c654b-30fb-4f2e-b955-e7ef30926363 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:41.030469 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:41.060537 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd28d6-66a3-4c53-a411-3c2cba9c4ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:41.061260 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd28d6-66a3-4c53-a411-3c2cba9c4ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:41.061540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd28d6-66a3-4c53-a411-3c2cba9c4ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:41.061832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd28d6-66a3-4c53-a411-3c2cba9c4ed6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:41.076831 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd28d6-66a3-4c53-a411-3c2cba9c4ed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:41.082522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-70bd28d6-66a3-4c53-a411-3c2cba9c4ed6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:41.082522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:41.082522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:41.082522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:41.082522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:41.082522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:41.082522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:41.082522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:41.082522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:41.082522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:41.082522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:41.082522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:41.082522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:41.082522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:41.082522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:41.082522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:41.083575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:41.083575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:41.083575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:41.083575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:41.083575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:41.083575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:41.083575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:41.083575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:41.083575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:41.083575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:41.083575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:41.083575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:41.083575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:41.083575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:41.083575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:41.083575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:41.084998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:41.084998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:41.084998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:41.084998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:41.084998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:41.084998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:41.084998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:41.084998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:41.084998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:41.084998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:41.084998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:41.084998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:41.084998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 194/399] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:09:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:09:41.092160 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d1db6-4b84-41f4-ab70-37585577f371 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:41.166785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:41.224173 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d1db6-4b84-41f4-ab70-37585577f371 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:41.254143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd28d6-66a3-4c53-a411-3c2cba9c4ed6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:41.258579 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38365999-0ec5-4f54-94af-9e030bce6247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:41.259479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38365999-0ec5-4f54-94af-9e030bce6247 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:41.259755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38365999-0ec5-4f54-94af-9e030bce6247 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:41.260027 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38365999-0ec5-4f54-94af-9e030bce6247 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:41.260699 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38365999-0ec5-4f54-94af-9e030bce6247 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:41.260998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38365999-0ec5-4f54-94af-9e030bce6247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:41.263588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38365999-0ec5-4f54-94af-9e030bce6247 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:41.274377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 206/400] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:09:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:41.280366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38365999-0ec5-4f54-94af-9e030bce6247 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:41.392481 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38365999-0ec5-4f54-94af-9e030bce6247 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:41.392673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd28d6-66a3-4c53-a411-3c2cba9c4ed6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:41.407830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:41.429917 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27c17a-ee86-4dcc-8fb2-898ff1a4d7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:41.430824 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27c17a-ee86-4dcc-8fb2-898ff1a4d7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:41.431354 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27c17a-ee86-4dcc-8fb2-898ff1a4d7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:41.431822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27c17a-ee86-4dcc-8fb2-898ff1a4d7a9 None admin] PATH_INFO: `/v3/groups/81298eaf8aff446a9413122da99a47c5` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:41.432214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53651f64-6ff8-43a2-8552-46b433a79040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:41.432918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53651f64-6ff8-43a2-8552-46b433a79040 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:41.433267 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53651f64-6ff8-43a2-8552-46b433a79040 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:41.433587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27c17a-ee86-4dcc-8fb2-898ff1a4d7a9 None admin] RBAC: Authorizing `identity:get_group(group_id=81298eaf8aff446a9413122da99a47c5)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:41.433699 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53651f64-6ff8-43a2-8552-46b433a79040 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:41.435308 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27c17a-ee86-4dcc-8fb2-898ff1a4d7a9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:41.437570 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 207/401] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Sep 23 15:09:41 2022] GET /identity/v3/groups/81298eaf8aff446a9413122da99a47c5 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:41.439442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962583a0-4e68-4c5e-b5d9-f79d274996f7 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:41.439890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962583a0-4e68-4c5e-b5d9-f79d274996f7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:41.440307 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962583a0-4e68-4c5e-b5d9-f79d274996f7 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:41.441977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 208/402] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:41.443589 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962583a0-4e68-4c5e-b5d9-f79d274996f7 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:41.452054 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53651f64-6ff8-43a2-8552-46b433a79040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:41.458404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-53651f64-6ff8-43a2-8552-46b433a79040 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:41.458404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:41.458404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:41.458404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:41.458404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:41.458404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:41.458404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:41.458404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:41.458404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:41.458404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:41.458404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:41.458404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:41.458404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:41.458404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:41.458404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:41.458404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:41.459510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:41.459510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:41.459510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:41.459510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:41.459510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:41.459510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:41.459510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:41.459510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:41.459510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:41.459510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:41.459510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:41.459510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:41.459510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:41.459510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:41.459510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:41.459510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:41.460526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:41.460526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:41.460526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:41.460526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:41.460526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:41.460526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:41.460526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:41.460526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:41.460526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:41.460526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:41.460526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:41.460526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:41.462418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 195/403] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:41.468979 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee17161-9f34-4279-9701-0a2d5a51c2d7 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:41.469334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee17161-9f34-4279-9701-0a2d5a51c2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:41.469689 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee17161-9f34-4279-9701-0a2d5a51c2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:41.491580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-dee17161-9f34-4279-9701-0a2d5a51c2d7 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:41.492957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dee17161-9f34-4279-9701-0a2d5a51c2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:41.523674 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:41.564751 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 196/404] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:41.565992 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee17161-9f34-4279-9701-0a2d5a51c2d7 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:41.589327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962583a0-4e68-4c5e-b5d9-f79d274996f7 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:41.654324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adb499-5a42-4f84-93b2-2f32dd801b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:41.656047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adb499-5a42-4f84-93b2-2f32dd801b0e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:41.657000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adb499-5a42-4f84-93b2-2f32dd801b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:41.659155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adb499-5a42-4f84-93b2-2f32dd801b0e None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:41.661310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adb499-5a42-4f84-93b2-2f32dd801b0e None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:41.662985 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adb499-5a42-4f84-93b2-2f32dd801b0e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:41.665069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 209/405] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:41 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:41.670464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adb499-5a42-4f84-93b2-2f32dd801b0e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:41.726980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:41.740350 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee17161-9f34-4279-9701-0a2d5a51c2d7 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:41.776173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052069c7-4c6a-4e13-af65-ac7744d87d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:41.776864 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052069c7-4c6a-4e13-af65-ac7744d87d1a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:41.777368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052069c7-4c6a-4e13-af65-ac7744d87d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:41.777715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052069c7-4c6a-4e13-af65-ac7744d87d1a None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:41.778654 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052069c7-4c6a-4e13-af65-ac7744d87d1a None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:41.778993 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052069c7-4c6a-4e13-af65-ac7744d87d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:41.780457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052069c7-4c6a-4e13-af65-ac7744d87d1a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:41.785411 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adb499-5a42-4f84-93b2-2f32dd801b0e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:41.790871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 197/406] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:41.796652 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052069c7-4c6a-4e13-af65-ac7744d87d1a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:41.825598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:41.839911 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da231c6-0aa6-48f8-baff-7ad83917c454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:41.840893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da231c6-0aa6-48f8-baff-7ad83917c454 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:41.841319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da231c6-0aa6-48f8-baff-7ad83917c454 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:41.841767 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da231c6-0aa6-48f8-baff-7ad83917c454 None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651/groups/81298eaf8aff446a9413122da99a47c5/roles/acaa0e7c8246470aa47504d9bc3ae56f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:41.844783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da231c6-0aa6-48f8-baff-7ad83917c454 None admin] RBAC: Authorizing `identity:create_grant(project_id=04ee7300c1d74f5bbe668c0fa5c4e651, group_id=81298eaf8aff446a9413122da99a47c5, role_id=acaa0e7c8246470aa47504d9bc3ae56f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:41.846486 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da231c6-0aa6-48f8-baff-7ad83917c454 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:41.900780 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052069c7-4c6a-4e13-af65-ac7744d87d1a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:41.937220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c472448-bbb6-4c55-9686-64fb785b5731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:41.937920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c472448-bbb6-4c55-9686-64fb785b5731 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:41.938198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c472448-bbb6-4c55-9686-64fb785b5731 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:41.938519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c472448-bbb6-4c55-9686-64fb785b5731 None admin] PATH_INFO: `/v3/groups/81298eaf8aff446a9413122da99a47c5` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:41.939649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c472448-bbb6-4c55-9686-64fb785b5731 None admin] RBAC: Authorizing `identity:get_group(group_id=81298eaf8aff446a9413122da99a47c5)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:41.941162 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c472448-bbb6-4c55-9686-64fb785b5731 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:41.942885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 198/407] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Sep 23 15:09:41 2022] GET /identity/v3/groups/81298eaf8aff446a9413122da99a47c5 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:41.943503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c472448-bbb6-4c55-9686-64fb785b5731 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:42.022609 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 210/408] 10.222.0.82 () {58 vars in 1442 bytes} [Fri Sep 23 15:09:41 2022] PUT /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651/groups/81298eaf8aff446a9413122da99a47c5/roles/acaa0e7c8246470aa47504d9bc3ae56f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:09:42.023546 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da231c6-0aa6-48f8-baff-7ad83917c454 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:42.070391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:42.082461 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c472448-bbb6-4c55-9686-64fb785b5731 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:42.142945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b401a-0fbd-4ca6-802b-859e9a5cb01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:42.143612 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b401a-0fbd-4ca6-802b-859e9a5cb01b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:42.143889 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b401a-0fbd-4ca6-802b-859e9a5cb01b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:42.144156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b401a-0fbd-4ca6-802b-859e9a5cb01b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:42.170243 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b401a-0fbd-4ca6-802b-859e9a5cb01b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:42.173544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da231c6-0aa6-48f8-baff-7ad83917c454 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:42.182198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-bb2b401a-0fbd-4ca6-802b-859e9a5cb01b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:09:42.182198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:42.182198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:42.182198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:42.182198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:42.182198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:42.182198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:42.182198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:42.182198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:42.182198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:42.182198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:42.182198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:42.182198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:42.182198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:42.182198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:42.182198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:42.183179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:42.183179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:42.183179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:42.183179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:42.183179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:42.183179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:42.183179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:42.183179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:42.183179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:42.183179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:42.183179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:42.183179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:42.183179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:42.183179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:42.183179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:42.183179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:42.183968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:42.183968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:42.183968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:42.183968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:42.183968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:42.183968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:42.183968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:42.183968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:42.183968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:42.183968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:42.183968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:09:42.183968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:42.183968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 199/409] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:09:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:42.194069 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b401a-0fbd-4ca6-802b-859e9a5cb01b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:42.194884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:42.240738 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2eb3d-6f84-4c89-8c8b-8ed848c9089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:42.241403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2eb3d-6f84-4c89-8c8b-8ed848c9089f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:42.241687 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2eb3d-6f84-4c89-8c8b-8ed848c9089f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:42.242187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2eb3d-6f84-4c89-8c8b-8ed848c9089f None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:42.243980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2eb3d-6f84-4c89-8c8b-8ed848c9089f None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:42.245856 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2eb3d-6f84-4c89-8c8b-8ed848c9089f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:42.248390 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 211/410] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:42 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:42.250055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb174f-5dde-44fb-b9b2-9d5f0e0b88c5 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:42.250444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb174f-5dde-44fb-b9b2-9d5f0e0b88c5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:42.251615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb174f-5dde-44fb-b9b2-9d5f0e0b88c5 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:42.257896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 212/411] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:42.261056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb174f-5dde-44fb-b9b2-9d5f0e0b88c5 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:42.336105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b401a-0fbd-4ca6-802b-859e9a5cb01b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:42.380926 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c113c21-700e-4d73-8e3c-88f6c1137a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:42.382035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113c21-700e-4d73-8e3c-88f6c1137a91 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:42.382814 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113c21-700e-4d73-8e3c-88f6c1137a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:42.383294 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113c21-700e-4d73-8e3c-88f6c1137a91 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:42.384489 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c113c21-700e-4d73-8e3c-88f6c1137a91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:42.385496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c113c21-700e-4d73-8e3c-88f6c1137a91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:42.387741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c113c21-700e-4d73-8e3c-88f6c1137a91 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:42.396651 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb174f-5dde-44fb-b9b2-9d5f0e0b88c5 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:42.401120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 200/412] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:42.402614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c69fb-9b95-40a9-9147-0c20a4b3eb78 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:42.403174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c69fb-9b95-40a9-9147-0c20a4b3eb78 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:42.403671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c69fb-9b95-40a9-9147-0c20a4b3eb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:42.427410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3a5c69fb-9b95-40a9-9147-0c20a4b3eb78 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:42.429695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3a5c69fb-9b95-40a9-9147-0c20a4b3eb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:42.442040 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da24616-c0cb-4f6c-8d3b-9a35f296aeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:42.443074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da24616-c0cb-4f6c-8d3b-9a35f296aeaa None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:42.443366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da24616-c0cb-4f6c-8d3b-9a35f296aeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:42.443641 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da24616-c0cb-4f6c-8d3b-9a35f296aeaa None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651/groups/81298eaf8aff446a9413122da99a47c5/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:42.446060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da24616-c0cb-4f6c-8d3b-9a35f296aeaa None admin] RBAC: Authorizing `identity:create_grant(project_id=04ee7300c1d74f5bbe668c0fa5c4e651, group_id=81298eaf8aff446a9413122da99a47c5, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:42.446191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:42.447691 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da24616-c0cb-4f6c-8d3b-9a35f296aeaa None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:42.505315 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 201/413] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:42.506751 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c69fb-9b95-40a9-9147-0c20a4b3eb78 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:42.579420 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 213/414] 10.222.0.82 () {58 vars in 1442 bytes} [Fri Sep 23 15:09:42 2022] PUT /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651/groups/81298eaf8aff446a9413122da99a47c5/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:09:42.626670 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c69fb-9b95-40a9-9147-0c20a4b3eb78 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:42.666312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31504371-71b5-4e88-94be-69c0dd1bb847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:42.667382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504371-71b5-4e88-94be-69c0dd1bb847 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:42.667868 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504371-71b5-4e88-94be-69c0dd1bb847 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:42.668339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504371-71b5-4e88-94be-69c0dd1bb847 None admin] PATH_INFO: `/v3/groups/bd4d70e961df425ebb0d15687be3584d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:42.669930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31504371-71b5-4e88-94be-69c0dd1bb847 None admin] RBAC: Authorizing `identity:get_group(group_id=bd4d70e961df425ebb0d15687be3584d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:42.672114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31504371-71b5-4e88-94be-69c0dd1bb847 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:42.674572 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 202/415] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Sep 23 15:09:42 2022] GET /identity/v3/groups/bd4d70e961df425ebb0d15687be3584d => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:42.680014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da24616-c0cb-4f6c-8d3b-9a35f296aeaa None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:42.725582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:42.809863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da24616-c0cb-4f6c-8d3b-9a35f296aeaa None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:42.833911 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31504371-71b5-4e88-94be-69c0dd1bb847 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:42.861514 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:42.870634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f8582-cb55-4272-bb11-b086510d4d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:42.875817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f8582-cb55-4272-bb11-b086510d4d3c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:42.875817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f8582-cb55-4272-bb11-b086510d4d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:42.875817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f8582-cb55-4272-bb11-b086510d4d3c None admin] PATH_INFO: `/v3/projects/9413a28bc00744258077edf9f566b1b7` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:42.875817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f8582-cb55-4272-bb11-b086510d4d3c None admin] RBAC: Authorizing `identity:get_project(project_id=9413a28bc00744258077edf9f566b1b7)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:42.875817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f8582-cb55-4272-bb11-b086510d4d3c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:42.877844 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 214/416] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:42 2022] GET /identity/v3/projects/9413a28bc00744258077edf9f566b1b7 => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:42.883126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f8582-cb55-4272-bb11-b086510d4d3c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:42.972761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31504371-71b5-4e88-94be-69c0dd1bb847 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:43.016424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcd200-16da-4a29-824b-488f98fdf8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:43.017148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcd200-16da-4a29-824b-488f98fdf8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:43.017500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcd200-16da-4a29-824b-488f98fdf8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:43.017872 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcd200-16da-4a29-824b-488f98fdf8d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:43.028618 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f8582-cb55-4272-bb11-b086510d4d3c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:43.030769 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcd200-16da-4a29-824b-488f98fdf8d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:43.036381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-acbcd200-16da-4a29-824b-488f98fdf8d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:43.036381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:43.036381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:43.036381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:43.036381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:43.036381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:43.036381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:43.036381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:43.036381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:43.036381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:43.036381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:43.036381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:43.036381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:43.036381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:43.036381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:43.036381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:43.037317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:43.037317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:43.037317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:43.037317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:43.037317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:43.037317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:43.037317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:43.037317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:43.037317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:43.037317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:43.037317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:43.037317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:43.037317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:43.037317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:43.037317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:43.037317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:43.038153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:43.038153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:43.038153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:43.038153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:43.038153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:43.038153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:43.038153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:43.038153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:43.038153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:43.038153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:43.038153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:43.038153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:43.038153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 203/417] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:09:43.040145 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:43.043934 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcd200-16da-4a29-824b-488f98fdf8d5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:43.077299 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3599a7-846e-4bd3-b7ed-73572915ac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:43.078534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3599a7-846e-4bd3-b7ed-73572915ac35 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:43.079792 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3599a7-846e-4bd3-b7ed-73572915ac35 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:43.080089 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3599a7-846e-4bd3-b7ed-73572915ac35 None admin] PATH_INFO: `/v3/projects/9413a28bc00744258077edf9f566b1b7/groups/bd4d70e961df425ebb0d15687be3584d/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:43.082553 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3599a7-846e-4bd3-b7ed-73572915ac35 None admin] RBAC: Authorizing `identity:create_grant(project_id=9413a28bc00744258077edf9f566b1b7, group_id=bd4d70e961df425ebb0d15687be3584d, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:43.084161 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3599a7-846e-4bd3-b7ed-73572915ac35 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:43.136748 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:43.164920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcd200-16da-4a29-824b-488f98fdf8d5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:43.205790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780ea72-ee22-44b7-8b6e-882ec417f25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:43.206809 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780ea72-ee22-44b7-8b6e-882ec417f25b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:43.207297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780ea72-ee22-44b7-8b6e-882ec417f25b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:43.207775 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780ea72-ee22-44b7-8b6e-882ec417f25b None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:43.208698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780ea72-ee22-44b7-8b6e-882ec417f25b None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:43.209239 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780ea72-ee22-44b7-8b6e-882ec417f25b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:43.210905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780ea72-ee22-44b7-8b6e-882ec417f25b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:43.225868 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 204/418] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:43.227661 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780ea72-ee22-44b7-8b6e-882ec417f25b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:43.239964 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 215/419] 10.222.0.82 () {58 vars in 1442 bytes} [Fri Sep 23 15:09:42 2022] PUT /identity/v3/projects/9413a28bc00744258077edf9f566b1b7/groups/bd4d70e961df425ebb0d15687be3584d/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:09:43.346983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780ea72-ee22-44b7-8b6e-882ec417f25b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:43.390635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5cc8c-c628-440e-9c14-5b62b934e468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:43.390635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5cc8c-c628-440e-9c14-5b62b934e468 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:43.390635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5cc8c-c628-440e-9c14-5b62b934e468 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:43.390635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5cc8c-c628-440e-9c14-5b62b934e468 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:43.395409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:43.470891 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5cc8c-c628-440e-9c14-5b62b934e468 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:43.472439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5cc8c-c628-440e-9c14-5b62b934e468 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:43.501749 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b2553-416d-4ba0-84cf-ed1c4c8ab6b4 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:43.502076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b2553-416d-4ba0-84cf-ed1c4c8ab6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:43.502309 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b2553-416d-4ba0-84cf-ed1c4c8ab6b4 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:43.503708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 216/420] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:09:43.510115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a070ef-72de-4719-99aa-139bf4ae522f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:43.510398 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a070ef-72de-4719-99aa-139bf4ae522f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:43.510672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a070ef-72de-4719-99aa-139bf4ae522f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:43.535131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-81a070ef-72de-4719-99aa-139bf4ae522f None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:43.536441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-81a070ef-72de-4719-99aa-139bf4ae522f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:43.616766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 205/421] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 15:09:43.627391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5cc8c-c628-440e-9c14-5b62b934e468 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:43.631634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 217/422] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:43.682784 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:43.765112 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5cc8c-c628-440e-9c14-5b62b934e468 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:43.803215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882804b-cbd1-44ad-aeb3-b6405b38e217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:43.803873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882804b-cbd1-44ad-aeb3-b6405b38e217 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:43.804165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882804b-cbd1-44ad-aeb3-b6405b38e217 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:43.804452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882804b-cbd1-44ad-aeb3-b6405b38e217 None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:43.805583 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882804b-cbd1-44ad-aeb3-b6405b38e217 None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:43.807063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882804b-cbd1-44ad-aeb3-b6405b38e217 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:43.813886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 206/423] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:43 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:43.815292 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a070ef-72de-4719-99aa-139bf4ae522f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:43.912172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882804b-cbd1-44ad-aeb3-b6405b38e217 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:43.924073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:43.932423 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a070ef-72de-4719-99aa-139bf4ae522f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:43.977543 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406dc8e-93e4-4aa1-9649-d69c339b6a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:43.982486 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406dc8e-93e4-4aa1-9649-d69c339b6a25 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:43.982988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406dc8e-93e4-4aa1-9649-d69c339b6a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:43.986403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406dc8e-93e4-4aa1-9649-d69c339b6a25 None admin] PATH_INFO: `/v3/groups/81298eaf8aff446a9413122da99a47c5` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:43.986403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406dc8e-93e4-4aa1-9649-d69c339b6a25 None admin] RBAC: Authorizing `identity:get_group(group_id=81298eaf8aff446a9413122da99a47c5)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:43.989075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406dc8e-93e4-4aa1-9649-d69c339b6a25 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:43.993406 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 218/424] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Sep 23 15:09:43 2022] GET /identity/v3/groups/81298eaf8aff446a9413122da99a47c5 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:43.998926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406dc8e-93e4-4aa1-9649-d69c339b6a25 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:44.036699 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882804b-cbd1-44ad-aeb3-b6405b38e217 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:44.040058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:44.079766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505906e-4186-43a9-a53f-08760fa35bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:44.082958 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505906e-4186-43a9-a53f-08760fa35bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:44.083415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505906e-4186-43a9-a53f-08760fa35bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:44.084095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505906e-4186-43a9-a53f-08760fa35bb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:44.113336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505906e-4186-43a9-a53f-08760fa35bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:44.120293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-d505906e-4186-43a9-a53f-08760fa35bb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:44.120293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:44.120293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:44.120293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:44.120293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:44.120293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:44.120293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:44.120293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:44.120293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:44.120293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:44.120293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:44.120293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:44.120293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:44.120293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:44.120293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:44.120293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:44.121272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:44.121272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:44.121272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:44.121272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:44.121272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:44.121272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:44.121272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:44.121272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:44.121272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:44.121272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:44.121272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:44.121272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:44.121272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:44.121272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:44.121272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:44.121272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:44.122126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:44.122126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:44.122126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:44.122126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:44.122126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:44.122126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:44.122126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:44.122126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:44.122126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:44.122126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:44.122126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:44.122126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:44.131340 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 207/425] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:09:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:09:44.139461 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505906e-4186-43a9-a53f-08760fa35bb0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:44.205982 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406dc8e-93e4-4aa1-9649-d69c339b6a25 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:44.260072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c431f76-c597-4420-8b2f-1ca06f1cf45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:44.261757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c431f76-c597-4420-8b2f-1ca06f1cf45f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:44.262246 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c431f76-c597-4420-8b2f-1ca06f1cf45f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:44.262812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c431f76-c597-4420-8b2f-1ca06f1cf45f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:44.263757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c431f76-c597-4420-8b2f-1ca06f1cf45f None admin] RBAC: Adding query filter params (group.id=81298eaf8aff446a9413122da99a47c5, role.id=c18fbe0604b34383a2725a382d77d618, scope.project.id=2accefb496f94595afbc2ab6be270cae) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:44.264269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c431f76-c597-4420-8b2f-1ca06f1cf45f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:44.266516 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c431f76-c597-4420-8b2f-1ca06f1cf45f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:44.273703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 219/426] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Sep 23 15:09:43 2022] GET /identity/v3/role_assignments?group.id=81298eaf8aff446a9413122da99a47c5&scope.project.id=2accefb496f94595afbc2ab6be270cae&role.id=c18fbe0604b34383a2725a382d77d618 => generated 611 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:44.323496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505906e-4186-43a9-a53f-08760fa35bb0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:44.363268 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8750b2-f427-468f-a119-3e117f76dd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:44.364416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8750b2-f427-468f-a119-3e117f76dd61 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:44.364923 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8750b2-f427-468f-a119-3e117f76dd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:44.365448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8750b2-f427-468f-a119-3e117f76dd61 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:44.366386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8750b2-f427-468f-a119-3e117f76dd61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:44.366900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8750b2-f427-468f-a119-3e117f76dd61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:44.368538 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8750b2-f427-468f-a119-3e117f76dd61 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:44.379885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 208/427] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:09:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:44.386014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c431f76-c597-4420-8b2f-1ca06f1cf45f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:44.418375 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:44.501303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c431f76-c597-4420-8b2f-1ca06f1cf45f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:44.544594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45df051-4d16-4f5e-8805-6c1ea0d0340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:44.545986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45df051-4d16-4f5e-8805-6c1ea0d0340f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:44.546994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45df051-4d16-4f5e-8805-6c1ea0d0340f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:44.547564 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45df051-4d16-4f5e-8805-6c1ea0d0340f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:44.639572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45df051-4d16-4f5e-8805-6c1ea0d0340f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:44.641085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45df051-4d16-4f5e-8805-6c1ea0d0340f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:44.674092 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:44.696788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d6763-49ec-4a93-b15b-0449693cc5da None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:44.697410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d6763-49ec-4a93-b15b-0449693cc5da None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:44.697939 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d6763-49ec-4a93-b15b-0449693cc5da None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:44.699769 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 209/428] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:44.710146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70aae1-9e19-4a89-ba78-4320651f60f1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:44.710146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70aae1-9e19-4a89-ba78-4320651f60f1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:44.710146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70aae1-9e19-4a89-ba78-4320651f60f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:44.733393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5c70aae1-9e19-4a89-ba78-4320651f60f1 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:44.735605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5c70aae1-9e19-4a89-ba78-4320651f60f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:44.763055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:44.769684 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 220/429] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:44.776037 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45df051-4d16-4f5e-8805-6c1ea0d0340f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:44.836409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 210/430] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:09:44.893248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45df051-4d16-4f5e-8805-6c1ea0d0340f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:44.922162 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:44.930614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03066d-5563-40e2-a8a4-c44b1084e438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:44.935776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03066d-5563-40e2-a8a4-c44b1084e438 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:44.935776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03066d-5563-40e2-a8a4-c44b1084e438 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:44.935776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03066d-5563-40e2-a8a4-c44b1084e438 None admin] PATH_INFO: `/v3/projects/2accefb496f94595afbc2ab6be270cae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:44.935776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03066d-5563-40e2-a8a4-c44b1084e438 None admin] RBAC: Authorizing `identity:get_project(project_id=2accefb496f94595afbc2ab6be270cae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:44.935776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03066d-5563-40e2-a8a4-c44b1084e438 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:44.936115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 221/431] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:44 2022] GET /identity/v3/projects/2accefb496f94595afbc2ab6be270cae => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:44.942778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70aae1-9e19-4a89-ba78-4320651f60f1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:45.054507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70aae1-9e19-4a89-ba78-4320651f60f1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:45.096163 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35c72f-a524-46b4-b3b8-23a548665515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:45.096721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35c72f-a524-46b4-b3b8-23a548665515 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:45.097002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35c72f-a524-46b4-b3b8-23a548665515 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:45.097277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35c72f-a524-46b4-b3b8-23a548665515 None admin] PATH_INFO: `/v3/groups/81298eaf8aff446a9413122da99a47c5` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:45.098437 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35c72f-a524-46b4-b3b8-23a548665515 None admin] RBAC: Authorizing `identity:get_group(group_id=81298eaf8aff446a9413122da99a47c5)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:45.099909 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35c72f-a524-46b4-b3b8-23a548665515 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:45.105871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 211/432] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Sep 23 15:09:44 2022] GET /identity/v3/groups/81298eaf8aff446a9413122da99a47c5 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:45.107883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03066d-5563-40e2-a8a4-c44b1084e438 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:45.158378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35c72f-a524-46b4-b3b8-23a548665515 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:45.186009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:45.225952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03066d-5563-40e2-a8a4-c44b1084e438 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:45.276552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e2963-a00f-4256-abc1-522372d2053b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:45.277162 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e2963-a00f-4256-abc1-522372d2053b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:45.277530 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e2963-a00f-4256-abc1-522372d2053b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:45.277706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e2963-a00f-4256-abc1-522372d2053b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:45.278498 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e2963-a00f-4256-abc1-522372d2053b None admin] RBAC: Adding query filter params (group.id=81298eaf8aff446a9413122da99a47c5, role.id=acaa0e7c8246470aa47504d9bc3ae56f, scope.project.id=2accefb496f94595afbc2ab6be270cae) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:45.280114 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e2963-a00f-4256-abc1-522372d2053b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:45.282618 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e2963-a00f-4256-abc1-522372d2053b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:45.286070 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35c72f-a524-46b4-b3b8-23a548665515 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:45.297025 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 222/433] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Sep 23 15:09:45 2022] GET /identity/v3/role_assignments?group.id=81298eaf8aff446a9413122da99a47c5&scope.project.id=2accefb496f94595afbc2ab6be270cae&role.id=acaa0e7c8246470aa47504d9bc3ae56f => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:45.330551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f82ed4-0d64-4e68-8df8-a87c81dc88a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:45.331448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f82ed4-0d64-4e68-8df8-a87c81dc88a0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:45.331876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f82ed4-0d64-4e68-8df8-a87c81dc88a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:45.332323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f82ed4-0d64-4e68-8df8-a87c81dc88a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:45.346833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f82ed4-0d64-4e68-8df8-a87c81dc88a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:45.352357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-88f82ed4-0d64-4e68-8df8-a87c81dc88a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:45.352357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:45.352357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:45.352357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:45.352357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:45.352357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:45.352357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:45.352357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:45.352357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:45.352357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:45.352357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:45.352357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:45.352357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:45.352357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:45.352357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:45.352357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:45.353778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:45.353778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:45.353778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:45.353778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:45.353778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:45.353778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:45.353778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:45.353778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:45.353778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:45.353778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:45.353778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:45.353778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:45.353778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:45.353778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:45.353778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:45.353778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:45.354808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:45.354808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:45.354808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:45.354808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:45.354808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:45.354808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:45.354808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:45.354808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:45.354808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:45.354808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:45.354808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:45.354808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:45.357338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 212/434] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:09:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:09:45.363433 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e2963-a00f-4256-abc1-522372d2053b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:45.444658 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:45.475383 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936de92-e31c-4181-932a-640f55a9a944 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:45.475672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936de92-e31c-4181-932a-640f55a9a944 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:45.475986 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936de92-e31c-4181-932a-640f55a9a944 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:45.482555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 213/435] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:09:45.484074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a533a-5f11-48b5-b9a6-e38a93938b33 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:45.484362 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a533a-5f11-48b5-b9a6-e38a93938b33 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:45.484636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a533a-5f11-48b5-b9a6-e38a93938b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:45.519551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b33a533a-5f11-48b5-b9a6-e38a93938b33 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:45.520810 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b33a533a-5f11-48b5-b9a6-e38a93938b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:45.532685 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e2963-a00f-4256-abc1-522372d2053b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:45.582403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1e05a-7c42-4ce9-a140-918db2407240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:45.583362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1e05a-7c42-4ce9-a140-918db2407240 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:45.583681 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1e05a-7c42-4ce9-a140-918db2407240 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:45.583875 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1e05a-7c42-4ce9-a140-918db2407240 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:45.584691 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1e05a-7c42-4ce9-a140-918db2407240 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:45.585003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1e05a-7c42-4ce9-a140-918db2407240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:45.589903 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1e05a-7c42-4ce9-a140-918db2407240 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:45.600478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 223/436] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:09:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:45.606633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1e05a-7c42-4ce9-a140-918db2407240 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:45.615605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 214/437] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:45.736110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1e05a-7c42-4ce9-a140-918db2407240 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:45.759905 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:45.772817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d6e0c-4782-46a9-bd80-7980af3a5c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:45.773427 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d6e0c-4782-46a9-bd80-7980af3a5c12 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:45.776031 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d6e0c-4782-46a9-bd80-7980af3a5c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:45.776031 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d6e0c-4782-46a9-bd80-7980af3a5c12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:45.847561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d6e0c-4782-46a9-bd80-7980af3a5c12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:45.849040 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d6e0c-4782-46a9-bd80-7980af3a5c12 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:45.896519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a533a-5f11-48b5-b9a6-e38a93938b33 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:45.911989 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:45.957071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 224/438] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:45.962751 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d6e0c-4782-46a9-bd80-7980af3a5c12 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:45.988004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:46.009821 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a533a-5f11-48b5-b9a6-e38a93938b33 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:46.050714 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dced65-3966-444a-b5d1-e63e6105bc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:46.051499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dced65-3966-444a-b5d1-e63e6105bc97 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:46.051781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dced65-3966-444a-b5d1-e63e6105bc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:46.052049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dced65-3966-444a-b5d1-e63e6105bc97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:46.063719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dced65-3966-444a-b5d1-e63e6105bc97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:46.069882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-60dced65-3966-444a-b5d1-e63e6105bc97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:46.069882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:46.069882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:46.069882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:46.069882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:46.069882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:46.069882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:46.069882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:46.069882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:46.069882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:46.069882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:46.069882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:46.069882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:46.069882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:46.069882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:46.069882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:46.070793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:46.070793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:46.070793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:46.070793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:46.070793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:46.070793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:46.070793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:46.070793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:46.070793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:46.070793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:46.070793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:46.070793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:46.070793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:46.070793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:46.070793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:46.070793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:46.076826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:46.076826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:46.076826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:46.076826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:46.076826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:46.076826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:46.076826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:46.076826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:46.076826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:46.076826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:46.076826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 15:09:46.076826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:46.076826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 215/439] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:46.077492 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d6e0c-4782-46a9-bd80-7980af3a5c12 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:46.079457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dced65-3966-444a-b5d1-e63e6105bc97 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:46.108835 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef406e-0a4b-4f86-ab9f-4abcdb887125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:46.109469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef406e-0a4b-4f86-ab9f-4abcdb887125 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:46.109780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef406e-0a4b-4f86-ab9f-4abcdb887125 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:46.110037 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef406e-0a4b-4f86-ab9f-4abcdb887125 None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:46.111254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef406e-0a4b-4f86-ab9f-4abcdb887125 None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:46.112798 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef406e-0a4b-4f86-ab9f-4abcdb887125 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:46.115060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 225/440] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:45 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:46.120065 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef406e-0a4b-4f86-ab9f-4abcdb887125 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:46.164075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:46.188642 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dced65-3966-444a-b5d1-e63e6105bc97 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:46.210092 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:46.219406 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef406e-0a4b-4f86-ab9f-4abcdb887125 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:46.223041 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe755f3-c517-40b6-84ab-600a32cb1f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:46.223644 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe755f3-c517-40b6-84ab-600a32cb1f8f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:46.223921 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe755f3-c517-40b6-84ab-600a32cb1f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:46.224254 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe755f3-c517-40b6-84ab-600a32cb1f8f None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:46.224847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe755f3-c517-40b6-84ab-600a32cb1f8f None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:46.225147 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe755f3-c517-40b6-84ab-600a32cb1f8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:46.226550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe755f3-c517-40b6-84ab-600a32cb1f8f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:46.234583 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 216/441] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:09:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:46.235813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771db5e-ebee-4077-9767-a204a56e2834 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:46.236100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771db5e-ebee-4077-9767-a204a56e2834 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:46.236498 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771db5e-ebee-4077-9767-a204a56e2834 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:46.237719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 217/442] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:46.240277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771db5e-ebee-4077-9767-a204a56e2834 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:46.255433 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683f174-4d6a-4cb3-91b1-18a016933f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:46.256061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683f174-4d6a-4cb3-91b1-18a016933f3f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:46.256337 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683f174-4d6a-4cb3-91b1-18a016933f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:46.256614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683f174-4d6a-4cb3-91b1-18a016933f3f None admin] PATH_INFO: `/v3/groups/81298eaf8aff446a9413122da99a47c5` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:46.257712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683f174-4d6a-4cb3-91b1-18a016933f3f None admin] RBAC: Authorizing `identity:get_group(group_id=81298eaf8aff446a9413122da99a47c5)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:46.259172 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683f174-4d6a-4cb3-91b1-18a016933f3f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:46.260857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 226/443] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Sep 23 15:09:46 2022] GET /identity/v3/groups/81298eaf8aff446a9413122da99a47c5 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:46.261959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5d5f-7305-4638-9e77-901481765179 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:46.262286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5d5f-7305-4638-9e77-901481765179 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:46.262563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5d5f-7305-4638-9e77-901481765179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:46.280416 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a36e5d5f-7305-4638-9e77-901481765179 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:46.281635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a36e5d5f-7305-4638-9e77-901481765179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:46.345286 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771db5e-ebee-4077-9767-a204a56e2834 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:46.347658 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 227/444] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:46.348502 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e5d5f-7305-4638-9e77-901481765179 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:46.380376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075b428-1b89-4f47-8f34-fca485e7003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:46.380974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075b428-1b89-4f47-8f34-fca485e7003d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:46.381252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075b428-1b89-4f47-8f34-fca485e7003d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:46.381520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075b428-1b89-4f47-8f34-fca485e7003d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:46.386833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:46.441417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:46.455181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e5d5f-7305-4638-9e77-901481765179 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:46.462757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075b428-1b89-4f47-8f34-fca485e7003d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:46.462757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075b428-1b89-4f47-8f34-fca485e7003d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:46.489064 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149d161-6ad3-40d2-90dd-b3ce653ba863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:46.489676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149d161-6ad3-40d2-90dd-b3ce653ba863 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:46.490276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149d161-6ad3-40d2-90dd-b3ce653ba863 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:46.508830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149d161-6ad3-40d2-90dd-b3ce653ba863 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:46.508830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149d161-6ad3-40d2-90dd-b3ce653ba863 None admin] RBAC: Adding query filter params (group.id=81298eaf8aff446a9413122da99a47c5, role.id=acaa0e7c8246470aa47504d9bc3ae56f, scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:46.508830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149d161-6ad3-40d2-90dd-b3ce653ba863 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:46.508830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149d161-6ad3-40d2-90dd-b3ce653ba863 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:46.508830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 228/445] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Sep 23 15:09:46 2022] GET /identity/v3/role_assignments?group.id=81298eaf8aff446a9413122da99a47c5&scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651&role.id=acaa0e7c8246470aa47504d9bc3ae56f => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:46.579607 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 218/446] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:46.585333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149d161-6ad3-40d2-90dd-b3ce653ba863 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:46.619183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075b428-1b89-4f47-8f34-fca485e7003d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:46.658815 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:46.701491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149d161-6ad3-40d2-90dd-b3ce653ba863 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:46.736044 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075b428-1b89-4f47-8f34-fca485e7003d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:46.737796 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744b6a8-38e0-4025-af29-cfc9f189d44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:46.738443 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744b6a8-38e0-4025-af29-cfc9f189d44f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:46.738719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744b6a8-38e0-4025-af29-cfc9f189d44f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:46.738999 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744b6a8-38e0-4025-af29-cfc9f189d44f None admin] PATH_INFO: `/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:46.740115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744b6a8-38e0-4025-af29-cfc9f189d44f None admin] RBAC: Authorizing `identity:get_project(project_id=04ee7300c1d74f5bbe668c0fa5c4e651)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:46.741555 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744b6a8-38e0-4025-af29-cfc9f189d44f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:46.743373 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 229/447] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:46 2022] GET /identity/v3/projects/04ee7300c1d74f5bbe668c0fa5c4e651 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:46.748688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744b6a8-38e0-4025-af29-cfc9f189d44f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:46.770138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:46.775388 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07e9d5-1ead-486e-8dd7-b9bdbb5955a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:46.776023 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07e9d5-1ead-486e-8dd7-b9bdbb5955a4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:46.776359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07e9d5-1ead-486e-8dd7-b9bdbb5955a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:46.776730 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07e9d5-1ead-486e-8dd7-b9bdbb5955a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:46.787255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07e9d5-1ead-486e-8dd7-b9bdbb5955a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:46.792457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4d07e9d5-1ead-486e-8dd7-b9bdbb5955a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:09:46.792457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:46.792457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:46.792457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:46.792457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:46.792457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:46.792457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:46.792457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:46.792457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:46.792457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:46.792457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:46.792457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:46.792457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:46.792457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:46.792457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:46.792457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:46.793524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:46.793524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:46.793524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:46.793524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:46.793524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:46.793524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:46.793524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:46.793524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:46.793524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:46.793524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:46.793524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:46.793524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:46.793524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:46.793524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:46.793524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:46.793524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:46.794666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:46.794666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:46.794666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:46.794666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:46.794666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:46.794666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:46.794666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:46.794666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:46.794666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:46.794666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:46.794666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:09:46.794666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:46.794666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 219/448] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:09:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:09:46.800251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07e9d5-1ead-486e-8dd7-b9bdbb5955a4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:46.851741 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744b6a8-38e0-4025-af29-cfc9f189d44f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:46.887631 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d1d95-13f7-4fe5-861a-26f11adb9abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:46.888259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d1d95-13f7-4fe5-861a-26f11adb9abb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:46.888535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d1d95-13f7-4fe5-861a-26f11adb9abb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:46.888907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d1d95-13f7-4fe5-861a-26f11adb9abb None admin] PATH_INFO: `/v3/groups/81298eaf8aff446a9413122da99a47c5` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:46.890059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d1d95-13f7-4fe5-861a-26f11adb9abb None admin] RBAC: Authorizing `identity:get_group(group_id=81298eaf8aff446a9413122da99a47c5)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:46.891495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d1d95-13f7-4fe5-861a-26f11adb9abb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:46.892798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:46.893059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 230/449] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Sep 23 15:09:46 2022] GET /identity/v3/groups/81298eaf8aff446a9413122da99a47c5 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:46.898791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d1d95-13f7-4fe5-861a-26f11adb9abb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:46.898937 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07e9d5-1ead-486e-8dd7-b9bdbb5955a4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:46.933695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1fd9f-3a86-4fda-82a0-8a14c0b429bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:46.934355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1fd9f-3a86-4fda-82a0-8a14c0b429bf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:46.934635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1fd9f-3a86-4fda-82a0-8a14c0b429bf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:46.934910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1fd9f-3a86-4fda-82a0-8a14c0b429bf None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:46.935567 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1fd9f-3a86-4fda-82a0-8a14c0b429bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:46.935870 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1fd9f-3a86-4fda-82a0-8a14c0b429bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:46.937633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1fd9f-3a86-4fda-82a0-8a14c0b429bf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:46.946606 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 220/450] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:46.951678 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1fd9f-3a86-4fda-82a0-8a14c0b429bf None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:46.989270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:47.001190 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d1d95-13f7-4fe5-861a-26f11adb9abb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:47.035334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b908e98-5cc8-4f87-a60f-138612976810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:47.036027 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b908e98-5cc8-4f87-a60f-138612976810 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:47.036308 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b908e98-5cc8-4f87-a60f-138612976810 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:47.036580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b908e98-5cc8-4f87-a60f-138612976810 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:47.037304 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b908e98-5cc8-4f87-a60f-138612976810 None admin] RBAC: Adding query filter params (group.id=81298eaf8aff446a9413122da99a47c5, role.id=c18fbe0604b34383a2725a382d77d618, scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:47.037617 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b908e98-5cc8-4f87-a60f-138612976810 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:47.039451 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b908e98-5cc8-4f87-a60f-138612976810 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:47.061764 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 231/451] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Sep 23 15:09:46 2022] GET /identity/v3/role_assignments?group.id=81298eaf8aff446a9413122da99a47c5&scope.project.id=04ee7300c1d74f5bbe668c0fa5c4e651&role.id=c18fbe0604b34383a2725a382d77d618 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:09:47.062015 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1fd9f-3a86-4fda-82a0-8a14c0b429bf None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:47.088176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8e84b-2b06-4659-b4ef-8e33caabf1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:47.088945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8e84b-2b06-4659-b4ef-8e33caabf1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:47.089231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8e84b-2b06-4659-b4ef-8e33caabf1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:47.089522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8e84b-2b06-4659-b4ef-8e33caabf1e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:47.119905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:47.165008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8e84b-2b06-4659-b4ef-8e33caabf1e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:47.166523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8e84b-2b06-4659-b4ef-8e33caabf1e2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:47.270833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 221/452] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 15:09:47.276206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b908e98-5cc8-4f87-a60f-138612976810 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:47.402725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b908e98-5cc8-4f87-a60f-138612976810 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:47.442439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed576795-0160-406f-be63-e06186ae05dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:47.442439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed576795-0160-406f-be63-e06186ae05dc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:47.442731 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed576795-0160-406f-be63-e06186ae05dc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:47.442807 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed576795-0160-406f-be63-e06186ae05dc None admin] PATH_INFO: `/v3/projects/9413a28bc00744258077edf9f566b1b7` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:47.445482 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed576795-0160-406f-be63-e06186ae05dc None admin] RBAC: Authorizing `identity:get_project(project_id=9413a28bc00744258077edf9f566b1b7)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:47.445482 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed576795-0160-406f-be63-e06186ae05dc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:47.447590 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 232/453] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:09:47 2022] GET /identity/v3/projects/9413a28bc00744258077edf9f566b1b7 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:47.454097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8e84b-2b06-4659-b4ef-8e33caabf1e2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:47.525046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:47.579643 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8e84b-2b06-4659-b4ef-8e33caabf1e2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:47.617698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0469e-d6c4-48f1-b93b-fc23be408ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:47.618362 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0469e-d6c4-48f1-b93b-fc23be408ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:47.618638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0469e-d6c4-48f1-b93b-fc23be408ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:47.618906 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0469e-d6c4-48f1-b93b-fc23be408ea1 None admin] PATH_INFO: `/v3/groups/bd4d70e961df425ebb0d15687be3584d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:47.619983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0469e-d6c4-48f1-b93b-fc23be408ea1 None admin] RBAC: Authorizing `identity:get_group(group_id=bd4d70e961df425ebb0d15687be3584d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:47.621494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0469e-d6c4-48f1-b93b-fc23be408ea1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:47.623076 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 222/454] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Sep 23 15:09:47 2022] GET /identity/v3/groups/bd4d70e961df425ebb0d15687be3584d => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:47.629054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed576795-0160-406f-be63-e06186ae05dc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:47.650847 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:47.729722 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed576795-0160-406f-be63-e06186ae05dc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:47.763548 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d626b-6611-4df6-a6c4-71118489f337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:47.764152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d626b-6611-4df6-a6c4-71118489f337 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:47.764433 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d626b-6611-4df6-a6c4-71118489f337 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:47.764706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d626b-6611-4df6-a6c4-71118489f337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:47.766003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d626b-6611-4df6-a6c4-71118489f337 None admin] RBAC: Adding query filter params (group.id=bd4d70e961df425ebb0d15687be3584d, role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=9413a28bc00744258077edf9f566b1b7) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:47.766313 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d626b-6611-4df6-a6c4-71118489f337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:47.767747 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d626b-6611-4df6-a6c4-71118489f337 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:47.773354 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 233/455] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Sep 23 15:09:47 2022] GET /identity/v3/role_assignments?group.id=bd4d70e961df425ebb0d15687be3584d&scope.project.id=9413a28bc00744258077edf9f566b1b7&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:50.877918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292b76b-733d-40c5-b5ca-6ae1b405be64 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:50.878472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292b76b-733d-40c5-b5ca-6ae1b405be64 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:50.878884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292b76b-733d-40c5-b5ca-6ae1b405be64 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:50.881296 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 223/456] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:09:50.893103 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667accd5-3dfe-4102-866b-1d4e3d2df149 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:50.893594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667accd5-3dfe-4102-866b-1d4e3d2df149 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:50.894069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667accd5-3dfe-4102-866b-1d4e3d2df149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:50.917502 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c566df5-67f1-4b62-8a3f-e32ba28aab7c None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:50.918004 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c566df5-67f1-4b62-8a3f-e32ba28aab7c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:50.918484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c566df5-67f1-4b62-8a3f-e32ba28aab7c None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:50.921262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 224/457] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:09:50.927002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde57e7-a41a-4fc3-a7fd-012e2943bcc7 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:50.927495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde57e7-a41a-4fc3-a7fd-012e2943bcc7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:50.927978 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde57e7-a41a-4fc3-a7fd-012e2943bcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:50.943620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-667accd5-3dfe-4102-866b-1d4e3d2df149 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:50.944849 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-667accd5-3dfe-4102-866b-1d4e3d2df149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:50.960448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8bde57e7-a41a-4fc3-a7fd-012e2943bcc7 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:50.962755 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8bde57e7-a41a-4fc3-a7fd-012e2943bcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:51.025924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 234/458] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:51.028392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc5a14-1515-4c98-9eaf-46dfe610241c None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:51.029057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc5a14-1515-4c98-9eaf-46dfe610241c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:51.029859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc5a14-1515-4c98-9eaf-46dfe610241c None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:51.036763 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 235/459] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:51.042542 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b98e8-d6b6-4549-8ae1-0c702b9289ce None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:51.049170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b98e8-d6b6-4549-8ae1-0c702b9289ce None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:51.049676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b98e8-d6b6-4549-8ae1-0c702b9289ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:51.082600 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-870b98e8-d6b6-4549-8ae1-0c702b9289ce None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:51.084043 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-870b98e8-d6b6-4549-8ae1-0c702b9289ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:51.104711 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:51.106950 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 225/460] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:09:51.185894 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 236/461] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:51.259936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b403f5-07f7-4990-9ef2-77fc99236550 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:51.260591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b403f5-07f7-4990-9ef2-77fc99236550 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:51.261062 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b403f5-07f7-4990-9ef2-77fc99236550 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:51.262903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 226/462] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:51.268957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df01b2-6ee9-42e8-9716-206fa8d2ce1c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:51.269483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df01b2-6ee9-42e8-9716-206fa8d2ce1c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:51.270036 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df01b2-6ee9-42e8-9716-206fa8d2ce1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:51.294686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f7df01b2-6ee9-42e8-9716-206fa8d2ce1c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:51.296491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f7df01b2-6ee9-42e8-9716-206fa8d2ce1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:51.371737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b403f5-07f7-4990-9ef2-77fc99236550 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:51.390961 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 237/463] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:51.461725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:51.493362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df01b2-6ee9-42e8-9716-206fa8d2ce1c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:51.520945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b403f5-07f7-4990-9ef2-77fc99236550 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:51.584468 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3cf66-b0b6-4c9a-8163-cef3c3eb6d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:51.585102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3cf66-b0b6-4c9a-8163-cef3c3eb6d77 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:51.585379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3cf66-b0b6-4c9a-8163-cef3c3eb6d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:51.585655 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3cf66-b0b6-4c9a-8163-cef3c3eb6d77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:51.607007 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3cf66-b0b6-4c9a-8163-cef3c3eb6d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:51.609066 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3cf66-b0b6-4c9a-8163-cef3c3eb6d77 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:51.613310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:51.627198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-8eb3cf66-b0b6-4c9a-8163-cef3c3eb6d77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:51.627198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:51.627198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:51.627198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:51.627198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:51.627198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:51.627198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:51.627198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:51.627198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:51.627198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:51.627198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:51.627198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:51.627198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:09:51.627198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:09:51.627198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:09:51.627198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:51.628747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:09:51.629754 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:09:51.629754 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:51.629754 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:51.630629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 227/464] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:51.631648 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3cf66-b0b6-4c9a-8163-cef3c3eb6d77 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:51.643134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df01b2-6ee9-42e8-9716-206fa8d2ce1c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:51.679967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d5446-8bc9-4529-a368-d6c0832f28cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:51.680983 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d5446-8bc9-4529-a368-d6c0832f28cd None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:51.681439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d5446-8bc9-4529-a368-d6c0832f28cd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:51.681993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d5446-8bc9-4529-a368-d6c0832f28cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:51.694252 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d5446-8bc9-4529-a368-d6c0832f28cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:51.696032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d5446-8bc9-4529-a368-d6c0832f28cd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:51.713750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-609d5446-8bc9-4529-a368-d6c0832f28cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:51.713750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:51.713750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:51.713750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:51.713750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:51.713750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:51.713750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:51.713750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:51.713750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:51.713750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:51.713750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:51.713750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:51.713750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:09:51.713750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:09:51.713750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:09:51.713750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:51.714706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:09:51.715560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:09:51.715560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:51.715560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:51.715560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 238/465] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:09:51.716338 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d5446-8bc9-4529-a368-d6c0832f28cd None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:51.747605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3cf66-b0b6-4c9a-8163-cef3c3eb6d77 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:51.758165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:51.786255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a021a01-b246-4fe2-b78e-20fcc8da13ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:51.786884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021a01-b246-4fe2-b78e-20fcc8da13ea None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:51.787168 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021a01-b246-4fe2-b78e-20fcc8da13ea None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:51.787540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021a01-b246-4fe2-b78e-20fcc8da13ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:51.800971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a021a01-b246-4fe2-b78e-20fcc8da13ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:51.802475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a021a01-b246-4fe2-b78e-20fcc8da13ea None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:51.821148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-2a021a01-b246-4fe2-b78e-20fcc8da13ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:51.821148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:51.821148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:51.821148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:51.821148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:51.821148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:51.821148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:51.821148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:51.821148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:51.821148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:51.821148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:51.821148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:51.821148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:09:51.821148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:09:51.821148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:09:51.821148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:51.822141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:09:51.822998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:09:51.822998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:51.822998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:51.822998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 228/466] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:51.823684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a021a01-b246-4fe2-b78e-20fcc8da13ea None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:51.832882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d5446-8bc9-4529-a368-d6c0832f28cd None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:51.860316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:51.869247 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed52025-3a8d-407a-a2c9-df8fc85f51d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:51.869892 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed52025-3a8d-407a-a2c9-df8fc85f51d0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:51.870201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed52025-3a8d-407a-a2c9-df8fc85f51d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:51.870551 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed52025-3a8d-407a-a2c9-df8fc85f51d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:51.873471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed52025-3a8d-407a-a2c9-df8fc85f51d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:51.873471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed52025-3a8d-407a-a2c9-df8fc85f51d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:51.873471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed52025-3a8d-407a-a2c9-df8fc85f51d0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:51.897358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 239/467] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:51.897358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed52025-3a8d-407a-a2c9-df8fc85f51d0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:51.938479 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a021a01-b246-4fe2-b78e-20fcc8da13ea None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:51.977032 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b87dc-7364-478c-af4c-3843198a272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:51.977663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b87dc-7364-478c-af4c-3843198a272d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:51.977970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b87dc-7364-478c-af4c-3843198a272d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:51.978250 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b87dc-7364-478c-af4c-3843198a272d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:51.989817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b87dc-7364-478c-af4c-3843198a272d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:51.991284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b87dc-7364-478c-af4c-3843198a272d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:52.006884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c13b87dc-7364-478c-af4c-3843198a272d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:52.006884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:52.006884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:52.006884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:52.006884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:52.006884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:52.006884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:52.006884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:52.006884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:52.006884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:52.006884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:52.006884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:52.006884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:09:52.006884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:09:52.006884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:09:52.006884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:52.007841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:09:52.008753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:09:52.008753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:52.008753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:52.008753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 229/468] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:52.008978 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b87dc-7364-478c-af4c-3843198a272d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:52.016074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed52025-3a8d-407a-a2c9-df8fc85f51d0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:52.025826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:52.057642 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15e988-9fa2-4f01-84c9-1f97b7e6914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:52.058526 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15e988-9fa2-4f01-84c9-1f97b7e6914a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:52.058943 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15e988-9fa2-4f01-84c9-1f97b7e6914a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:52.059350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15e988-9fa2-4f01-84c9-1f97b7e6914a None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:52.060138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15e988-9fa2-4f01-84c9-1f97b7e6914a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:52.060764 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15e988-9fa2-4f01-84c9-1f97b7e6914a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:52.062902 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15e988-9fa2-4f01-84c9-1f97b7e6914a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:52.074754 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 240/469] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:52.075603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15e988-9fa2-4f01-84c9-1f97b7e6914a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:52.125515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b87dc-7364-478c-af4c-3843198a272d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:52.128655 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:52.161397 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa094b87-abb7-47eb-802f-9a986b4de9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:52.162044 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa094b87-abb7-47eb-802f-9a986b4de9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:52.162434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa094b87-abb7-47eb-802f-9a986b4de9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:52.162795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa094b87-abb7-47eb-802f-9a986b4de9e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:52.163467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa094b87-abb7-47eb-802f-9a986b4de9e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:52.163775 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa094b87-abb7-47eb-802f-9a986b4de9e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:52.165186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa094b87-abb7-47eb-802f-9a986b4de9e7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:52.177914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 230/470] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:52.178753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa094b87-abb7-47eb-802f-9a986b4de9e7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:52.188437 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15e988-9fa2-4f01-84c9-1f97b7e6914a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:52.224158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebac92-7a55-4237-a1e4-6f2dea916a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:52.224688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebac92-7a55-4237-a1e4-6f2dea916a1f None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:52.224966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebac92-7a55-4237-a1e4-6f2dea916a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:52.225236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebac92-7a55-4237-a1e4-6f2dea916a1f None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:52.225907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebac92-7a55-4237-a1e4-6f2dea916a1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:52.227364 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebac92-7a55-4237-a1e4-6f2dea916a1f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:52.261834 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:52.291196 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa094b87-abb7-47eb-802f-9a986b4de9e7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:52.328015 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cfbc7-0ec6-4937-81cb-95532ba6ae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:52.329271 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cfbc7-0ec6-4937-81cb-95532ba6ae9d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:52.329475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cfbc7-0ec6-4937-81cb-95532ba6ae9d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:52.329756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cfbc7-0ec6-4937-81cb-95532ba6ae9d None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:52.330432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cfbc7-0ec6-4937-81cb-95532ba6ae9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:52.330733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cfbc7-0ec6-4937-81cb-95532ba6ae9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:52.332166 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cfbc7-0ec6-4937-81cb-95532ba6ae9d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:52.345304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 231/471] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:52.346191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cfbc7-0ec6-4937-81cb-95532ba6ae9d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:52.381363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 241/472] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:09:52 2022] POST /identity/v3/users => generated 248 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:09:52.382272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebac92-7a55-4237-a1e4-6f2dea916a1f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:52.468202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cfbc7-0ec6-4937-81cb-95532ba6ae9d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:52.502246 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:52.507328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebac92-7a55-4237-a1e4-6f2dea916a1f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:52.508414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa550138-cdd3-4ef7-b9a5-efd60410edc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:52.513203 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:52.513481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa550138-cdd3-4ef7-b9a5-efd60410edc4 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:52.513481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa550138-cdd3-4ef7-b9a5-efd60410edc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:52.513481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa550138-cdd3-4ef7-b9a5-efd60410edc4 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:52.513481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa550138-cdd3-4ef7-b9a5-efd60410edc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:52.515116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa550138-cdd3-4ef7-b9a5-efd60410edc4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:52.544974 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3355305-1a5a-4d41-bb4c-4f0b1211c72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:52.546133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3355305-1a5a-4d41-bb4c-4f0b1211c72c None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:52.546413 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3355305-1a5a-4d41-bb4c-4f0b1211c72c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:52.546685 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3355305-1a5a-4d41-bb4c-4f0b1211c72c None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:52.547339 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3355305-1a5a-4d41-bb4c-4f0b1211c72c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:52.548807 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3355305-1a5a-4d41-bb4c-4f0b1211c72c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:52.655355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 232/473] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:09:52 2022] POST /identity/v3/users => generated 248 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:09:52.656203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa550138-cdd3-4ef7-b9a5-efd60410edc4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:52.689220 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 242/474] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:09:52 2022] POST /identity/v3/users => generated 246 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:09:52.693842 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16ed7d-b0fb-4deb-b084-eb29d669092b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:52.694815 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16ed7d-b0fb-4deb-b084-eb29d669092b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:52.695226 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16ed7d-b0fb-4deb-b084-eb29d669092b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:52.697035 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 243/475] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:52.707319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc95c4-1114-428b-84f6-20d8717d088f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:52.707840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc95c4-1114-428b-84f6-20d8717d088f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:52.708282 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc95c4-1114-428b-84f6-20d8717d088f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:52.728787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-88fc95c4-1114-428b-84f6-20d8717d088f None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:52.730336 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-88fc95c4-1114-428b-84f6-20d8717d088f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:52.815200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 244/476] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:52.853694 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa550138-cdd3-4ef7-b9a5-efd60410edc4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:52.918563 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66772c-785b-48ed-ac1a-c5946637377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:52.919198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66772c-785b-48ed-ac1a-c5946637377c None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:52.919471 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66772c-785b-48ed-ac1a-c5946637377c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:52.919992 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66772c-785b-48ed-ac1a-c5946637377c None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:52.921208 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66772c-785b-48ed-ac1a-c5946637377c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:52.922681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66772c-785b-48ed-ac1a-c5946637377c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:53.015802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 233/477] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:09:52 2022] POST /identity/v3/users => generated 249 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:09:53.125199 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc95c4-1114-428b-84f6-20d8717d088f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:53.246283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:53.260693 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc95c4-1114-428b-84f6-20d8717d088f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:53.303597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d2c2e-be9d-421b-85a9-0f61ddcf12d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:53.304214 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d2c2e-be9d-421b-85a9-0f61ddcf12d8 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:53.304487 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d2c2e-be9d-421b-85a9-0f61ddcf12d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:53.304753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d2c2e-be9d-421b-85a9-0f61ddcf12d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:53.305419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d2c2e-be9d-421b-85a9-0f61ddcf12d8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:53.306830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d2c2e-be9d-421b-85a9-0f61ddcf12d8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:53.346566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.sql.core [None req-234d2c2e-be9d-421b-85a9-0f61ddcf12d8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 23 15:09:53.346566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 23 15:09:53.346566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [parameters: {'id': '9aae28c465e04801bf8564fe7856c65b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 23 15:09:53.346566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81642) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 23 15:09:53.363258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-234d2c2e-be9d-421b-85a9-0f61ddcf12d8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 23 15:09:53.363258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:53.363258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 15:09:53.363258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 15:09:53.363258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 15:09:53.363258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 15:09:53.363258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 15:09:53.363258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 15:09:53.363258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 15:09:53.363258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application conn.query(q) Sep 23 15:09:53.363258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 15:09:53.363258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 15:09:53.363258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 15:09:53.363258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result.read() Sep 23 15:09:53.363258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return ref.to_dict() Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 15:09:53.364181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application next(self.gen) Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application yield resource Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application next(self.gen) Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.session.rollback() Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.force_reraise() Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise self.value Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application session.commit() Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 23 15:09:53.365095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._prepare_impl() Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.session.flush() Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._flush(objects) Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application compat.raise_( Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application flush_context.execute() Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rec.execute(self) Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 15:09:53.366015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 23 15:09:53.366891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 15:09:53.366891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 23 15:09:53.366891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 23 15:09:53.366891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 23 15:09:53.366891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 15:09:53.366891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 15:09:53.366891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 15:09:53.366891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 23 15:09:53.366891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 15:09:53.366891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 23 15:09:53.366891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 15:09:53.366891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 23 15:09:53.366891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 15:09:53.366891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 15:09:53.366891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 15:09:53.366891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception Sep 23 15:09:53.367718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 15:09:53.367718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 15:09:53.367718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 15:09:53.367718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 15:09:53.367718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 15:09:53.367718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 15:09:53.367718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 15:09:53.367718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application conn.query(q) Sep 23 15:09:53.367718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 15:09:53.367718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 15:09:53.367718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 15:09:53.367718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result.read() Sep 23 15:09:53.367718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 15:09:53.367718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 15:09:53.367718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 15:09:53.367718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 15:09:53.368529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 15:09:53.368529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 15:09:53.368529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 15:09:53.368529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 15:09:53.368529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 23 15:09:53.368529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 23 15:09:53.368529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [parameters: {'id': '9aae28c465e04801bf8564fe7856c65b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 23 15:09:53.368529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 15:09:53.368529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:53.368529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:09:53.368529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:53.368529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:53.368529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:53.368529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:53.368529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:53.368529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:53.369493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:53.369493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:53.369493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:53.369493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:53.369493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:53.369493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:53.369493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 23 15:09:53.369493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 23 15:09:53.369493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:53.369493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:53.369493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 23 15:09:53.369493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 23 15:09:53.369493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 23 15:09:53.369493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 23 15:09:53.369493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 23 15:09:53.369493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:53.370386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 245/478] 10.222.0.82 () {60 vars in 1131 bytes} [Fri Sep 23 15:09:53 2022] POST /identity/v3/roles => generated 144 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:53.370450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66772c-785b-48ed-ac1a-c5946637377c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:53.440249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:53.528246 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66772c-785b-48ed-ac1a-c5946637377c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:53.579805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1a63e-811a-4b5e-9200-db5fd8ed4e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:53.580814 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1a63e-811a-4b5e-9200-db5fd8ed4e21 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:53.581294 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1a63e-811a-4b5e-9200-db5fd8ed4e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:53.581823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1a63e-811a-4b5e-9200-db5fd8ed4e21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:53.602606 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1a63e-811a-4b5e-9200-db5fd8ed4e21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:53.608311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a1a1a63e-811a-4b5e-9200-db5fd8ed4e21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:53.608311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:53.608311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:53.608311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:53.608311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:53.608311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:53.608311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:53.608311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:53.608311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:53.608311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:53.608311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:53.608311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:53.608311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:53.608311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:53.608311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:53.608311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:53.609194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:53.609194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:53.609194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:53.609194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:53.609194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:53.609194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:53.609194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:53.609194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:53.609194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:53.609194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:53.609194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:53.609194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:53.609194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:53.609194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:53.609194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:53.609194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:53.610042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:53.610042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:53.610042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:53.610042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:53.610042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:53.610042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:53.610042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:53.610042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:53.610042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:53.610042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:53.610042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 15:09:53.610042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:53.612386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 234/479] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:09:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:53.619033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d2c2e-be9d-421b-85a9-0f61ddcf12d8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:53.771706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d2c2e-be9d-421b-85a9-0f61ddcf12d8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:53.816085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb321c-c771-4d23-bd36-90e3ecab9649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:53.816701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb321c-c771-4d23-bd36-90e3ecab9649 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:53.816980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb321c-c771-4d23-bd36-90e3ecab9649 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:53.817254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb321c-c771-4d23-bd36-90e3ecab9649 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:53.817949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb321c-c771-4d23-bd36-90e3ecab9649 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:53.818256 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb321c-c771-4d23-bd36-90e3ecab9649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:53.819729 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb321c-c771-4d23-bd36-90e3ecab9649 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:53.829252 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 246/480] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:09:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:54.822712 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cfdfc-c0e8-41ec-afa4-f255d82f6157 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:54.823384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cfdfc-c0e8-41ec-afa4-f255d82f6157 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:54.823384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cfdfc-c0e8-41ec-afa4-f255d82f6157 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:54.824860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 235/481] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:54.830453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d13ad-b09b-4aad-93fa-74e7b8be77df None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:54.830941 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d13ad-b09b-4aad-93fa-74e7b8be77df None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:54.831032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d13ad-b09b-4aad-93fa-74e7b8be77df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:54.857328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-398d13ad-b09b-4aad-93fa-74e7b8be77df None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:54.859085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-398d13ad-b09b-4aad-93fa-74e7b8be77df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:54.869760 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:54.938693 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 247/482] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:55.266533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cfdfc-c0e8-41ec-afa4-f255d82f6157 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:55.398700 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cfdfc-c0e8-41ec-afa4-f255d82f6157 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:55.401522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:55.423390 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2a016-9843-4932-8a9d-ac24ff4ebc47 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:55.423727 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2a016-9843-4932-8a9d-ac24ff4ebc47 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:55.423936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2a016-9843-4932-8a9d-ac24ff4ebc47 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:55.425595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 248/483] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:55.431250 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b20e8f-0653-4784-8e9d-f85f098d999d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:55.431557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b20e8f-0653-4784-8e9d-f85f098d999d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:55.431798 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b20e8f-0653-4784-8e9d-f85f098d999d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:55.451866 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-60b20e8f-0653-4784-8e9d-f85f098d999d None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:55.453114 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-60b20e8f-0653-4784-8e9d-f85f098d999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:55.455377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08331961-814c-45d5-89fc-51cddd326544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:55.456021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08331961-814c-45d5-89fc-51cddd326544 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:55.456299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08331961-814c-45d5-89fc-51cddd326544 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:55.456569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08331961-814c-45d5-89fc-51cddd326544 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:55.478991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08331961-814c-45d5-89fc-51cddd326544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:55.485185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-08331961-814c-45d5-89fc-51cddd326544 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:09:55.485185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:55.485185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:55.485185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:55.485185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:55.485185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:55.485185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:55.485185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:55.485185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:55.485185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:55.485185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:55.485185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:55.485185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:55.485185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:55.485185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:55.485185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:55.486148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:55.486148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:55.486148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:55.486148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:55.486148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:55.486148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:55.486148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:55.486148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:55.486148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:55.486148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:55.486148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:55.486148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:55.486148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:55.486148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:55.486148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:55.486148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:55.486983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:55.486983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:55.486983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:55.486983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:55.486983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:55.486983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:55.486983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:55.486983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:55.486983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:55.486983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:55.486983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:09:55.486983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:55.496189 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 236/484] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:09:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:55.498539 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08331961-814c-45d5-89fc-51cddd326544 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:55.590057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 249/485] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:09:55.591683 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f195d79-2c3d-4013-8421-5c08de857aae None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:55.592790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f195d79-2c3d-4013-8421-5c08de857aae None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:55.593242 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f195d79-2c3d-4013-8421-5c08de857aae None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:55.595013 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 250/486] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:55.611958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256e033-8f47-412b-8639-df0cad4944cb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:55.612555 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256e033-8f47-412b-8639-df0cad4944cb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:55.613010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256e033-8f47-412b-8639-df0cad4944cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:55.629808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08331961-814c-45d5-89fc-51cddd326544 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:55.647776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a256e033-8f47-412b-8639-df0cad4944cb None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:55.649349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a256e033-8f47-412b-8639-df0cad4944cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:55.676944 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f102b-f855-46c7-98b6-97ec65866d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:55.678417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f102b-f855-46c7-98b6-97ec65866d27 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:55.679165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f102b-f855-46c7-98b6-97ec65866d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:55.679822 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f102b-f855-46c7-98b6-97ec65866d27 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:55.682342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f102b-f855-46c7-98b6-97ec65866d27 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:55.682880 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f102b-f855-46c7-98b6-97ec65866d27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:55.684459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f102b-f855-46c7-98b6-97ec65866d27 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:55.702237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 237/487] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:09:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:55.706280 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f102b-f855-46c7-98b6-97ec65866d27 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:55.760938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:55.790760 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 251/488] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:09:55.797754 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85c411-f0ad-4beb-8190-f56e5007c547 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:55.797754 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85c411-f0ad-4beb-8190-f56e5007c547 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:55.797754 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85c411-f0ad-4beb-8190-f56e5007c547 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:55.797754 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 252/489] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:55.805360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f30583-7c56-4385-8446-3b5e6db757cd None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:55.805799 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f30583-7c56-4385-8446-3b5e6db757cd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:55.806050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f30583-7c56-4385-8446-3b5e6db757cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:55.815825 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:55.835871 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-49f30583-7c56-4385-8446-3b5e6db757cd None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:55.838393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-49f30583-7c56-4385-8446-3b5e6db757cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:55.901251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f102b-f855-46c7-98b6-97ec65866d27 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:55.954500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b7d9b-6591-437c-b280-61abad4ea63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:55.955420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b7d9b-6591-437c-b280-61abad4ea63f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:55.955705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b7d9b-6591-437c-b280-61abad4ea63f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:55.955977 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b7d9b-6591-437c-b280-61abad4ea63f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:55.962104 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 253/490] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:55.962975 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f30583-7c56-4385-8446-3b5e6db757cd None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:55.978364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b7d9b-6591-437c-b280-61abad4ea63f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:55.980826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b7d9b-6591-437c-b280-61abad4ea63f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:55.997672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e94b7d9b-6591-437c-b280-61abad4ea63f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:55.997672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:55.997672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:55.997672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:55.997672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:55.997672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:55.997672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:55.997672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:55.997672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:55.997672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:55.997672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:55.997672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:55.997672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:09:55.997672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:09:55.997672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:09:55.997672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:55.999202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:09:56.000046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:09:56.000046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:56.000046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:56.000046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 238/491] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:56.009404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b7d9b-6591-437c-b280-61abad4ea63f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:56.143112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f30583-7c56-4385-8446-3b5e6db757cd None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:56.147656 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:56.175068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b7d9b-6591-437c-b280-61abad4ea63f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:56.193342 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520627a-fee4-4efa-a607-10b820efdd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:56.194559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520627a-fee4-4efa-a607-10b820efdd62 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:56.195046 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520627a-fee4-4efa-a607-10b820efdd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:56.195823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520627a-fee4-4efa-a607-10b820efdd62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:56.198031 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:56.210389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520627a-fee4-4efa-a607-10b820efdd62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:56.217211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7520627a-fee4-4efa-a607-10b820efdd62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:09:56.217211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:56.217211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:56.217211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:56.217211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:56.217211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:56.217211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:56.217211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:56.217211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:56.217211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:56.217211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:56.217211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:56.217211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:56.217211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:56.217211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:56.217211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:56.218128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:56.218128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:56.218128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:56.218128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:56.218128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:56.218128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:56.218128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:56.218128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:56.218128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:56.218128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:56.218128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:56.218128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:56.218128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:56.218128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:56.218128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:56.218128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:56.218927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:56.218927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:56.218927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:56.218927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:56.218927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:56.218927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:56.218927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:56.218927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:56.218927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:56.218927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:56.218927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:09:56.218927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:56.218927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 254/492] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:09:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:56.220183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520627a-fee4-4efa-a607-10b820efdd62 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:56.223032 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb76671-f1a1-40df-9966-23372601a951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:56.223830 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb76671-f1a1-40df-9966-23372601a951 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:56.223927 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb76671-f1a1-40df-9966-23372601a951 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:56.224257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb76671-f1a1-40df-9966-23372601a951 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:56.224982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb76671-f1a1-40df-9966-23372601a951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:56.225289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb76671-f1a1-40df-9966-23372601a951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:56.226898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb76671-f1a1-40df-9966-23372601a951 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:56.249860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 239/493] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:56.251130 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb76671-f1a1-40df-9966-23372601a951 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:56.346158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520627a-fee4-4efa-a607-10b820efdd62 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:56.386043 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30283b6b-65c6-4a5b-863c-a47d967b8ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:56.386678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30283b6b-65c6-4a5b-863c-a47d967b8ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:56.386957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30283b6b-65c6-4a5b-863c-a47d967b8ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:56.387067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb76671-f1a1-40df-9966-23372601a951 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:56.387246 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30283b6b-65c6-4a5b-863c-a47d967b8ee3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:56.399394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30283b6b-65c6-4a5b-863c-a47d967b8ee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:56.405479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-30283b6b-65c6-4a5b-863c-a47d967b8ee3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:09:56.405479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:56.405479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:56.405479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:56.405479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:56.405479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:56.405479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:56.405479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:56.405479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:56.405479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:56.405479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:56.405479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:56.405479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:56.405479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:56.405479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:56.405479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:56.406627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:56.406627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:56.406627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:56.406627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:56.406627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:56.406627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:56.406627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:56.406627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:56.406627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:56.406627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:56.406627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:56.406627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:56.406627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:56.406627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:56.406627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:56.406627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:56.408061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:56.408061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:56.408061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:56.408061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:56.408061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:56.408061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:56.408061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:56.408061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:56.408061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:56.408061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:56.408061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:09:56.408061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:56.408061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 255/494] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:09:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:56.408061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30283b6b-65c6-4a5b-863c-a47d967b8ee3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:56.429308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f5280-4a96-4d8f-83ad-a3149e36fd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:56.430055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f5280-4a96-4d8f-83ad-a3149e36fd9d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:56.430276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f5280-4a96-4d8f-83ad-a3149e36fd9d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:56.430542 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f5280-4a96-4d8f-83ad-a3149e36fd9d None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:56.431205 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f5280-4a96-4d8f-83ad-a3149e36fd9d None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:56.431508 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f5280-4a96-4d8f-83ad-a3149e36fd9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:56.432889 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f5280-4a96-4d8f-83ad-a3149e36fd9d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:56.439279 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:56.447603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 240/495] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:09:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:56.447603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f5280-4a96-4d8f-83ad-a3149e36fd9d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:56.474864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:56.523026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30283b6b-65c6-4a5b-863c-a47d967b8ee3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:56.556755 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f5280-4a96-4d8f-83ad-a3149e36fd9d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:56.559497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c01b4b-cf0c-4a01-9397-21d9c2dbe075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:56.560123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c01b4b-cf0c-4a01-9397-21d9c2dbe075 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:56.560504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c01b4b-cf0c-4a01-9397-21d9c2dbe075 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:56.561284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c01b4b-cf0c-4a01-9397-21d9c2dbe075 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:56.569068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c01b4b-cf0c-4a01-9397-21d9c2dbe075 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:56.570519 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c01b4b-cf0c-4a01-9397-21d9c2dbe075 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:56.582913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-25c01b4b-cf0c-4a01-9397-21d9c2dbe075 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 15:09:56.582913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:56.582913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:56.582913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:56.582913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:56.582913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:56.582913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:56.582913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:56.582913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:56.582913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:56.582913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:56.582913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:56.582913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:09:56.582913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:09:56.582913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:09:56.582913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:56.583857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:56.584768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:56.584768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:56.584768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:09:56.584768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:09:56.584768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:09:56.584768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:09:56.584768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:09:56.584768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:09:56.584768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 15:09:56.584768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:56.588651 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 256/496] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:56.589495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c01b4b-cf0c-4a01-9397-21d9c2dbe075 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:56.595358 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0e2ec-4531-4e3e-b553-cb58521beebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:56.595990 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0e2ec-4531-4e3e-b553-cb58521beebd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:56.596272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0e2ec-4531-4e3e-b553-cb58521beebd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:56.596548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0e2ec-4531-4e3e-b553-cb58521beebd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:56.607791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0e2ec-4531-4e3e-b553-cb58521beebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:09:56.612994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-94c0e2ec-4531-4e3e-b553-cb58521beebd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:09:56.612994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:56.612994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:56.612994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:56.612994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:56.612994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:56.612994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:56.612994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:56.612994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:56.612994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:56.612994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:56.612994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:56.612994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:09:56.612994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:09:56.612994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:09:56.612994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:09:56.613973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:09:56.613973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:09:56.613973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:09:56.613973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:09:56.613973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:56.613973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:56.613973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:56.613973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:56.613973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:56.613973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:56.613973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:56.613973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:56.613973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:56.613973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:56.613973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:56.613973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:56.614798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:56.614798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:56.614798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:56.614798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:56.614798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:09:56.614798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:09:56.614798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:09:56.614798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:09:56.614798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:09:56.614798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:09:56.614798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:09:56.614798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:56.614798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 241/497] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:09:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:56.615469 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0e2ec-4531-4e3e-b553-cb58521beebd None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:56.680370 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:56.699229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c01b4b-cf0c-4a01-9397-21d9c2dbe075 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:56.713167 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:56.723057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0e2ec-4531-4e3e-b553-cb58521beebd None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:56.734382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c6200-4cf6-41b2-8398-fad60a06ecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:56.734995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c6200-4cf6-41b2-8398-fad60a06ecd6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:56.735279 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c6200-4cf6-41b2-8398-fad60a06ecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:56.735554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c6200-4cf6-41b2-8398-fad60a06ecd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:56.736246 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c6200-4cf6-41b2-8398-fad60a06ecd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:56.736530 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c6200-4cf6-41b2-8398-fad60a06ecd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:56.737959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c6200-4cf6-41b2-8398-fad60a06ecd6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:56.747218 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 257/498] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:09:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:56.747858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c6200-4cf6-41b2-8398-fad60a06ecd6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:56.764854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bdc8d-bcb0-4f7a-a911-832be92e01fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:56.765483 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bdc8d-bcb0-4f7a-a911-832be92e01fa None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:56.765789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bdc8d-bcb0-4f7a-a911-832be92e01fa None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:56.766066 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bdc8d-bcb0-4f7a-a911-832be92e01fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:56.778478 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bdc8d-bcb0-4f7a-a911-832be92e01fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:56.780576 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bdc8d-bcb0-4f7a-a911-832be92e01fa None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:56.799326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-9e0bdc8d-bcb0-4f7a-a911-832be92e01fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:56.799326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:56.799326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:56.799326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:56.799326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:56.799326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:56.799326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:56.799326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:56.799326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:56.799326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:56.799326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:56.799326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:56.799326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:09:56.799326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:09:56.799326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:09:56.799326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:56.800367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:09:56.801282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:09:56.801282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:56.801282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:56.801282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 242/499] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:56.802241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bdc8d-bcb0-4f7a-a911-832be92e01fa None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:56.865109 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c6200-4cf6-41b2-8398-fad60a06ecd6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:56.900446 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab2370-c9ef-49d8-b850-351c9b492352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:56.901054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab2370-c9ef-49d8-b850-351c9b492352 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:56.901395 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab2370-c9ef-49d8-b850-351c9b492352 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:56.901676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab2370-c9ef-49d8-b850-351c9b492352 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:56.902436 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab2370-c9ef-49d8-b850-351c9b492352 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:56.902741 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab2370-c9ef-49d8-b850-351c9b492352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:56.904779 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab2370-c9ef-49d8-b850-351c9b492352 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:56.912534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bdc8d-bcb0-4f7a-a911-832be92e01fa None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:56.926919 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:56.946233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 258/500] 10.222.0.82 () {56 vars in 1137 bytes} [Fri Sep 23 15:09:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:56.946233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab2370-c9ef-49d8-b850-351c9b492352 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:56.947609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e33896-77be-4727-8d10-b8f7089a9a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:56.948216 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e33896-77be-4727-8d10-b8f7089a9a6c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:56.948492 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e33896-77be-4727-8d10-b8f7089a9a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:56.948761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e33896-77be-4727-8d10-b8f7089a9a6c None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:56.949414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e33896-77be-4727-8d10-b8f7089a9a6c None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:56.949712 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e33896-77be-4727-8d10-b8f7089a9a6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:56.951166 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e33896-77be-4727-8d10-b8f7089a9a6c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:56.959556 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 243/501] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:09:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:56.960336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e33896-77be-4727-8d10-b8f7089a9a6c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:56.978978 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:57.043465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab2370-c9ef-49d8-b850-351c9b492352 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:57.060831 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e33896-77be-4727-8d10-b8f7089a9a6c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:57.079710 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e207de5-6740-4343-887e-71330f8b5ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:57.080343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e207de5-6740-4343-887e-71330f8b5ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:57.080649 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e207de5-6740-4343-887e-71330f8b5ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:57.080927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e207de5-6740-4343-887e-71330f8b5ad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:57.092821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e207de5-6740-4343-887e-71330f8b5ad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:57.094389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e207de5-6740-4343-887e-71330f8b5ad2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:57.095265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44782cdc-57c0-4865-874f-91ba64e81a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:57.095855 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44782cdc-57c0-4865-874f-91ba64e81a92 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:57.096130 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44782cdc-57c0-4865-874f-91ba64e81a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:57.096397 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44782cdc-57c0-4865-874f-91ba64e81a92 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:57.097027 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44782cdc-57c0-4865-874f-91ba64e81a92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:57.097321 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44782cdc-57c0-4865-874f-91ba64e81a92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:57.098712 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44782cdc-57c0-4865-874f-91ba64e81a92 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:57.108782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8e207de5-6740-4343-887e-71330f8b5ad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:57.108782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:57.108782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:57.108782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:57.108782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:57.108782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:57.108782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:57.108782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:57.108782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:57.108782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:57.108782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:57.108782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:57.108782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:09:57.108782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:09:57.108782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:09:57.108782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:57.114673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:09:57.115854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:09:57.115854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:57.115854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:57.115854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 259/503] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:57.116114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 244/503] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:57.116114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44782cdc-57c0-4865-874f-91ba64e81a92 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:57.116270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff4ed1-fc26-46c0-81cd-fc40d5451a21 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:57.116270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff4ed1-fc26-46c0-81cd-fc40d5451a21 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:57.116270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff4ed1-fc26-46c0-81cd-fc40d5451a21 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:57.116270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 260/504] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:09:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:09:57.116270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff4ed1-fc26-46c0-81cd-fc40d5451a21 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:57.154121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:57.199545 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:57.215046 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff4ed1-fc26-46c0-81cd-fc40d5451a21 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:57.220883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44782cdc-57c0-4865-874f-91ba64e81a92 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:57.249417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae124f21-57d9-4dd6-bc4a-807486301744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:57.250182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae124f21-57d9-4dd6-bc4a-807486301744 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:57.250558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae124f21-57d9-4dd6-bc4a-807486301744 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:57.250908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae124f21-57d9-4dd6-bc4a-807486301744 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:57.254161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e503d9-5e50-4ec0-8052-2c45943e5d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:57.254760 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e503d9-5e50-4ec0-8052-2c45943e5d10 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:57.255037 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e503d9-5e50-4ec0-8052-2c45943e5d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:57.255307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e503d9-5e50-4ec0-8052-2c45943e5d10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:57.261033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae124f21-57d9-4dd6-bc4a-807486301744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:57.262605 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae124f21-57d9-4dd6-bc4a-807486301744 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:57.278370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ae124f21-57d9-4dd6-bc4a-807486301744 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:57.278370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:57.278370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:57.278370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:57.278370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:57.278370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:57.278370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:57.278370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:57.278370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:57.278370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:57.278370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:57.278370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:57.278370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:09:57.278370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:09:57.278370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:09:57.278370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:57.279968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:09:57.280979 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:09:57.280979 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:57.280979 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:57.282322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 261/505] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:57.283088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae124f21-57d9-4dd6-bc4a-807486301744 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:57.324012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e503d9-5e50-4ec0-8052-2c45943e5d10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:57.325470 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e503d9-5e50-4ec0-8052-2c45943e5d10 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:57.363301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:57.382382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae124f21-57d9-4dd6-bc4a-807486301744 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:57.416407 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3cf97-9e6b-47d1-a81e-189c74e9d7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:57.419523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3cf97-9e6b-47d1-a81e-189c74e9d7ad None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:57.419523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3cf97-9e6b-47d1-a81e-189c74e9d7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:57.419523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3cf97-9e6b-47d1-a81e-189c74e9d7ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:57.425566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3cf97-9e6b-47d1-a81e-189c74e9d7ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:57.427062 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3cf97-9e6b-47d1-a81e-189c74e9d7ad None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:57.428801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:57.433151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 245/506] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:57.434105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e503d9-5e50-4ec0-8052-2c45943e5d10 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:57.439495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-3ee3cf97-9e6b-47d1-a81e-189c74e9d7ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:09:57.439495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:57.439495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:57.439495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:57.439495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:57.439495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:57.439495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:57.439495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:57.439495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:57.439495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:57.439495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:57.439495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:57.439495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:09:57.439495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:09:57.439495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:09:57.439495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:57.440444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:57.441325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:57.441325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:57.441325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:09:57.441325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:09:57.441325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:09:57.441325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:09:57.441325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:09:57.441325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:09:57.441325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:09:57.441325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:57.441325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 262/507] 10.222.0.82 () {56 vars in 1093 bytes} [Fri Sep 23 15:09:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:57.441954 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998148a-6d80-400e-af62-76bb8921c15b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:57.442143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998148a-6d80-400e-af62-76bb8921c15b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:57.442384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998148a-6d80-400e-af62-76bb8921c15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:57.490897 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3998148a-6d80-400e-af62-76bb8921c15b None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:09:57.492072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3998148a-6d80-400e-af62-76bb8921c15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:09:57.559513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 263/508] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:09:57.560880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998148a-6d80-400e-af62-76bb8921c15b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:57.587228 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e503d9-5e50-4ec0-8052-2c45943e5d10 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:57.623693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9626dc-0ffa-4b20-87ca-8a69b4618572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:57.624326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9626dc-0ffa-4b20-87ca-8a69b4618572 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:57.624606 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9626dc-0ffa-4b20-87ca-8a69b4618572 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:57.624876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9626dc-0ffa-4b20-87ca-8a69b4618572 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:57.625512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9626dc-0ffa-4b20-87ca-8a69b4618572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:57.625837 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9626dc-0ffa-4b20-87ca-8a69b4618572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:57.627203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9626dc-0ffa-4b20-87ca-8a69b4618572 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:57.628738 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:57.644111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 246/509] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:57.644111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9626dc-0ffa-4b20-87ca-8a69b4618572 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:57.672141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998148a-6d80-400e-af62-76bb8921c15b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:57.704789 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:57.712889 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c082012-a8a8-43dd-afef-4c6ed40b5883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:57.716927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c082012-a8a8-43dd-afef-4c6ed40b5883 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:57.716927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c082012-a8a8-43dd-afef-4c6ed40b5883 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:57.716927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c082012-a8a8-43dd-afef-4c6ed40b5883 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:57.716927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c082012-a8a8-43dd-afef-4c6ed40b5883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:57.716927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c082012-a8a8-43dd-afef-4c6ed40b5883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:57.716927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c082012-a8a8-43dd-afef-4c6ed40b5883 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:57.727837 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 264/510] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:57.728457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c082012-a8a8-43dd-afef-4c6ed40b5883 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:57.751789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9626dc-0ffa-4b20-87ca-8a69b4618572 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:57.789165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44702acb-f089-4510-b4aa-3eac2f857320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:57.789828 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44702acb-f089-4510-b4aa-3eac2f857320 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:57.790105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44702acb-f089-4510-b4aa-3eac2f857320 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:57.790379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44702acb-f089-4510-b4aa-3eac2f857320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:57.801991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44702acb-f089-4510-b4aa-3eac2f857320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:57.803606 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44702acb-f089-4510-b4aa-3eac2f857320 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:57.820179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-44702acb-f089-4510-b4aa-3eac2f857320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:57.820179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:57.820179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:57.820179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:57.820179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:57.820179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:57.820179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:57.820179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:57.820179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:57.820179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:57.820179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:57.820179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:57.820179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:09:57.820179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:09:57.820179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:09:57.820179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:57.821121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:09:57.822129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:09:57.822129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:57.822129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:57.822129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 247/511] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:57.822350 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44702acb-f089-4510-b4aa-3eac2f857320 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:57.842951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c082012-a8a8-43dd-afef-4c6ed40b5883 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:57.875569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:57.876864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70670214-07e8-49c8-bbcb-68cdefd630c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:57.877467 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70670214-07e8-49c8-bbcb-68cdefd630c8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:57.877747 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70670214-07e8-49c8-bbcb-68cdefd630c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:57.878029 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70670214-07e8-49c8-bbcb-68cdefd630c8 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:57.878750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70670214-07e8-49c8-bbcb-68cdefd630c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:57.879051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70670214-07e8-49c8-bbcb-68cdefd630c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:57.880490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70670214-07e8-49c8-bbcb-68cdefd630c8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:57.897792 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 265/512] 10.222.0.82 () {56 vars in 1133 bytes} [Fri Sep 23 15:09:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:57.898619 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70670214-07e8-49c8-bbcb-68cdefd630c8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:57.938593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44702acb-f089-4510-b4aa-3eac2f857320 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:57.947114 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:57.974111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ccc09-6e87-4687-8cf3-165325daa2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:57.974734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ccc09-6e87-4687-8cf3-165325daa2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:57.975013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ccc09-6e87-4687-8cf3-165325daa2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:57.975284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ccc09-6e87-4687-8cf3-165325daa2a9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:57.983478 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ccc09-6e87-4687-8cf3-165325daa2a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:57.985021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ccc09-6e87-4687-8cf3-165325daa2a9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:58.001459 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70670214-07e8-49c8-bbcb-68cdefd630c8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:58.002096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-076ccc09-6e87-4687-8cf3-165325daa2a9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 23 15:09:58.002096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:58.002096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:58.002096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:58.002096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:58.002096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:58.002096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:58.002096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:58.002096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:58.002096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:58.002096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:58.002096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:58.002096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:09:58.002096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:09:58.002096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:09:58.002096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:58.003117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:58.004043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:58.004043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:58.004043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:09:58.004043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:09:58.004043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:09:58.004043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:09:58.004043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:09:58.004043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:09:58.004043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 23 15:09:58.004043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:58.004043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 248/513] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:09:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:58.004043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ccc09-6e87-4687-8cf3-165325daa2a9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:58.037337 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8a46d-be56-4080-a773-1e35a8d6a3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:58.038005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8a46d-be56-4080-a773-1e35a8d6a3bd None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:58.038285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8a46d-be56-4080-a773-1e35a8d6a3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:58.038563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8a46d-be56-4080-a773-1e35a8d6a3bd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:58.046529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8a46d-be56-4080-a773-1e35a8d6a3bd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:58.047996 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8a46d-be56-4080-a773-1e35a8d6a3bd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:58.060780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-b0f8a46d-be56-4080-a773-1e35a8d6a3bd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 15:09:58.060780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:58.060780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:58.060780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:58.060780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:58.060780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:58.060780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:58.060780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:58.060780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:58.060780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:58.060780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:58.060780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:58.060780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:09:58.060780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:09:58.060780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:09:58.060780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:58.061880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:58.062958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:58.062958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:58.062958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:09:58.062958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:09:58.062958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:09:58.062958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:09:58.062958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:09:58.062958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:09:58.062958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 15:09:58.062958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:58.062958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 266/514] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:09:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:58.063526 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8a46d-be56-4080-a773-1e35a8d6a3bd None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:58.111909 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ccc09-6e87-4687-8cf3-165325daa2a9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:58.118692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:58.146909 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3fb5d-8ba2-444f-8ea0-f75360ea02ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:58.147514 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3fb5d-8ba2-444f-8ea0-f75360ea02ee None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:58.147795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3fb5d-8ba2-444f-8ea0-f75360ea02ee None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:58.148067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3fb5d-8ba2-444f-8ea0-f75360ea02ee None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:58.148707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3fb5d-8ba2-444f-8ea0-f75360ea02ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:58.149009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3fb5d-8ba2-444f-8ea0-f75360ea02ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:58.150530 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3fb5d-8ba2-444f-8ea0-f75360ea02ee None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:58.162707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 249/515] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:58.163321 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3fb5d-8ba2-444f-8ea0-f75360ea02ee None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:58.163918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8a46d-be56-4080-a773-1e35a8d6a3bd None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:58.173920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:58.200809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1c78d-1fc0-4ff6-ad44-da07d4e644c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:58.201513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1c78d-1fc0-4ff6-ad44-da07d4e644c3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:58.201719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1c78d-1fc0-4ff6-ad44-da07d4e644c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:58.202025 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1c78d-1fc0-4ff6-ad44-da07d4e644c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:58.212214 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1c78d-1fc0-4ff6-ad44-da07d4e644c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:58.213675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1c78d-1fc0-4ff6-ad44-da07d4e644c3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:58.228850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-33b1c78d-1fc0-4ff6-ad44-da07d4e644c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:58.228850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:58.228850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:58.228850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:58.228850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:58.228850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:58.228850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:58.228850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:58.228850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:58.228850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:58.228850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:58.228850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:58.228850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:09:58.228850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:09:58.228850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:09:58.228850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:58.230069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:09:58.231191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:09:58.231191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:58.231191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:58.231191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 267/516] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:58.231191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1c78d-1fc0-4ff6-ad44-da07d4e644c3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:58.271988 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3fb5d-8ba2-444f-8ea0-f75360ea02ee None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:58.300182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c22ce6-c7b2-4431-82d4-4b0a6fbc25f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:58.300780 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c22ce6-c7b2-4431-82d4-4b0a6fbc25f2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:58.301058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c22ce6-c7b2-4431-82d4-4b0a6fbc25f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:58.301339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c22ce6-c7b2-4431-82d4-4b0a6fbc25f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:58.332022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1c78d-1fc0-4ff6-ad44-da07d4e644c3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:58.335018 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:58.366435 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f0902-6070-47a8-9363-aa61540137b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:58.367040 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f0902-6070-47a8-9363-aa61540137b2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:58.367317 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f0902-6070-47a8-9363-aa61540137b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:58.367624 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f0902-6070-47a8-9363-aa61540137b2 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:58.368353 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f0902-6070-47a8-9363-aa61540137b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:58.368658 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f0902-6070-47a8-9363-aa61540137b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:58.369994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c22ce6-c7b2-4431-82d4-4b0a6fbc25f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:58.370209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f0902-6070-47a8-9363-aa61540137b2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:58.371431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c22ce6-c7b2-4431-82d4-4b0a6fbc25f2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:58.388364 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 268/517] 10.222.0.82 () {56 vars in 1137 bytes} [Fri Sep 23 15:09:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:58.389186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f0902-6070-47a8-9363-aa61540137b2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:58.409173 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:58.475675 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 250/518] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:58.476534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c22ce6-c7b2-4431-82d4-4b0a6fbc25f2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:58.490357 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f0902-6070-47a8-9363-aa61540137b2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:58.524347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02717b25-d4d2-4762-8e84-28bb5ae40a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:58.524905 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02717b25-d4d2-4762-8e84-28bb5ae40a93 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:58.525184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02717b25-d4d2-4762-8e84-28bb5ae40a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:58.525454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02717b25-d4d2-4762-8e84-28bb5ae40a93 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:58.526333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02717b25-d4d2-4762-8e84-28bb5ae40a93 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:58.526536 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02717b25-d4d2-4762-8e84-28bb5ae40a93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:58.528001 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02717b25-d4d2-4762-8e84-28bb5ae40a93 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:58.542999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:58.546415 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 269/519] 10.222.0.82 () {56 vars in 1139 bytes} [Fri Sep 23 15:09:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:58.547226 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02717b25-d4d2-4762-8e84-28bb5ae40a93 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:58.577952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c22ce6-c7b2-4431-82d4-4b0a6fbc25f2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:58.613870 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ce44e-da30-4470-9037-d47539533560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:58.614494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ce44e-da30-4470-9037-d47539533560 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:58.614770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ce44e-da30-4470-9037-d47539533560 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:58.615040 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ce44e-da30-4470-9037-d47539533560 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:58.621350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:58.621481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ce44e-da30-4470-9037-d47539533560 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:58.622962 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ce44e-da30-4470-9037-d47539533560 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:58.634638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-584ce44e-da30-4470-9037-d47539533560 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:09:58.634638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:58.634638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:58.634638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:58.634638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:58.634638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:58.634638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:58.634638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:58.634638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:58.634638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:58.634638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:58.634638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:58.634638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:09:58.634638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:09:58.634638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:58.635639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:58.636559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:09:58.636559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:09:58.636559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:09:58.636559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:09:58.636559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:09:58.636559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:09:58.636559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:09:58.636559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:58.636559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 251/520] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:09:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:58.636559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ce44e-da30-4470-9037-d47539533560 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:58.650798 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02717b25-d4d2-4762-8e84-28bb5ae40a93 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:58.686206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24a095-de48-43c1-81a5-89ebcda63741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:58.686815 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24a095-de48-43c1-81a5-89ebcda63741 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:58.687090 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24a095-de48-43c1-81a5-89ebcda63741 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:58.687361 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24a095-de48-43c1-81a5-89ebcda63741 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:58.687998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24a095-de48-43c1-81a5-89ebcda63741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:58.688299 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24a095-de48-43c1-81a5-89ebcda63741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:58.689670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24a095-de48-43c1-81a5-89ebcda63741 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:58.702347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 270/521] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:58.703153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24a095-de48-43c1-81a5-89ebcda63741 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:58.735730 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ce44e-da30-4470-9037-d47539533560 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:58.760219 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:58.769819 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076b71e-c651-41b6-acd3-c2a8140cd892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:58.776737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076b71e-c651-41b6-acd3-c2a8140cd892 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:58.776737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076b71e-c651-41b6-acd3-c2a8140cd892 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:58.776737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076b71e-c651-41b6-acd3-c2a8140cd892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:58.803153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24a095-de48-43c1-81a5-89ebcda63741 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:58.836300 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13737390-c8b0-4570-9fa9-e226c48de6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:58.836944 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13737390-c8b0-4570-9fa9-e226c48de6cc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:58.837229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13737390-c8b0-4570-9fa9-e226c48de6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:58.837492 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13737390-c8b0-4570-9fa9-e226c48de6cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:58.839228 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076b71e-c651-41b6-acd3-c2a8140cd892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:58.839453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:58.840684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076b71e-c651-41b6-acd3-c2a8140cd892 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:58.850259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13737390-c8b0-4570-9fa9-e226c48de6cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:58.851832 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13737390-c8b0-4570-9fa9-e226c48de6cc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:58.866748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-13737390-c8b0-4570-9fa9-e226c48de6cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:58.866748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:58.866748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:58.866748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:58.866748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:58.866748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:58.866748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:58.866748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:58.866748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:58.866748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:58.866748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:58.866748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:58.866748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:09:58.866748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:09:58.866748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:09:58.866748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:58.867719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:09:58.868580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:09:58.868580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:58.868580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:58.868580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 271/522] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:58.868580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13737390-c8b0-4570-9fa9-e226c48de6cc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:58.946945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 252/523] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:58.948548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076b71e-c651-41b6-acd3-c2a8140cd892 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:58.976233 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:58.982833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13737390-c8b0-4570-9fa9-e226c48de6cc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:59.016850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94fec0-0ff4-4059-ad57-16a9b0e7c941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:59.017452 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94fec0-0ff4-4059-ad57-16a9b0e7c941 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:59.017756 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94fec0-0ff4-4059-ad57-16a9b0e7c941 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:59.018057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94fec0-0ff4-4059-ad57-16a9b0e7c941 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:59.050620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076b71e-c651-41b6-acd3-c2a8140cd892 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:59.073020 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:59.083573 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b7605-8889-4587-a5b6-a323e7e26a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:59.084184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b7605-8889-4587-a5b6-a323e7e26a24 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:59.084459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b7605-8889-4587-a5b6-a323e7e26a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:59.084730 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b7605-8889-4587-a5b6-a323e7e26a24 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:59.085693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b7605-8889-4587-a5b6-a323e7e26a24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:59.085829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94fec0-0ff4-4059-ad57-16a9b0e7c941 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:59.085907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b7605-8889-4587-a5b6-a323e7e26a24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:59.087082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94fec0-0ff4-4059-ad57-16a9b0e7c941 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:59.087183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b7605-8889-4587-a5b6-a323e7e26a24 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:59.105430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 253/524] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:09:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:59.106190 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b7605-8889-4587-a5b6-a323e7e26a24 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:59.186380 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 272/525] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:09:59.187211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94fec0-0ff4-4059-ad57-16a9b0e7c941 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:59.198158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:59.214834 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b7605-8889-4587-a5b6-a323e7e26a24 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:59.251625 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663135f-d401-4491-a41f-0023480f6578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:59.252263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663135f-d401-4491-a41f-0023480f6578 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:59.252617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663135f-d401-4491-a41f-0023480f6578 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:59.252948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663135f-d401-4491-a41f-0023480f6578 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:59.253569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663135f-d401-4491-a41f-0023480f6578 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:59.255076 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663135f-d401-4491-a41f-0023480f6578 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:59.273423 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:59.288305 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94fec0-0ff4-4059-ad57-16a9b0e7c941 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:59.321273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b60a39-8222-4579-b64b-8a27ce011425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:59.321839 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b60a39-8222-4579-b64b-8a27ce011425 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:59.322120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b60a39-8222-4579-b64b-8a27ce011425 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:59.322393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b60a39-8222-4579-b64b-8a27ce011425 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:59.323027 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b60a39-8222-4579-b64b-8a27ce011425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:59.323329 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b60a39-8222-4579-b64b-8a27ce011425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:59.324701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b60a39-8222-4579-b64b-8a27ce011425 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:59.336152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 273/526] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:59.336924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b60a39-8222-4579-b64b-8a27ce011425 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:59.408520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 254/527] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:09:59 2022] POST /identity/v3/users => generated 247 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:09:59.409448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663135f-d401-4491-a41f-0023480f6578 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:59.435690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b60a39-8222-4579-b64b-8a27ce011425 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:59.479845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b9162-2fe7-4094-8b19-efa3fcf8f5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:59.480501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b9162-2fe7-4094-8b19-efa3fcf8f5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:59.480778 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b9162-2fe7-4094-8b19-efa3fcf8f5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:59.481051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b9162-2fe7-4094-8b19-efa3fcf8f5b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:59.493835 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b9162-2fe7-4094-8b19-efa3fcf8f5b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:59.495358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b9162-2fe7-4094-8b19-efa3fcf8f5b6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:59.502883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:59.513803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-a27b9162-2fe7-4094-8b19-efa3fcf8f5b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:59.513803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:59.513803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:59.513803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:59.513803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:59.513803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:59.513803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:59.513803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:59.513803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:59.513803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:59.513803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:59.513803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:59.513803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:09:59.513803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:09:59.513803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:09:59.513803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:59.514977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:09:59.526110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:09:59.526110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:59.526110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:59.526110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 274/528] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:59.526110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b9162-2fe7-4094-8b19-efa3fcf8f5b6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:59.541874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663135f-d401-4491-a41f-0023480f6578 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:59.582408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a78dc5-2119-421b-8e8c-2ee9325e5564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:59.582941 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a78dc5-2119-421b-8e8c-2ee9325e5564 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:59.583241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a78dc5-2119-421b-8e8c-2ee9325e5564 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:59.583486 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a78dc5-2119-421b-8e8c-2ee9325e5564 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:59.585154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a78dc5-2119-421b-8e8c-2ee9325e5564 None admin] RBAC: Adding query filter params (role.id=118b4b27bab54b429c3a70924d659c72, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=47bd08ee89014df281d0c0d5f8f6cabc) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:59.585154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a78dc5-2119-421b-8e8c-2ee9325e5564 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:59.586127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a78dc5-2119-421b-8e8c-2ee9325e5564 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:59.597938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 255/529] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:09:59 2022] GET /identity/v3/role_assignments?user.id=47bd08ee89014df281d0c0d5f8f6cabc&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=118b4b27bab54b429c3a70924d659c72 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:59.597938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a78dc5-2119-421b-8e8c-2ee9325e5564 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:59.606269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:59.637951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b9162-2fe7-4094-8b19-efa3fcf8f5b6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:59.688803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8719e7-8cc5-4f85-a316-c5b1a3f16245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:59.689706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8719e7-8cc5-4f85-a316-c5b1a3f16245 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:59.690191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8719e7-8cc5-4f85-a316-c5b1a3f16245 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:59.690617 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8719e7-8cc5-4f85-a316-c5b1a3f16245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:59.703070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8719e7-8cc5-4f85-a316-c5b1a3f16245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:59.704565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8719e7-8cc5-4f85-a316-c5b1a3f16245 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:59.720050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7e8719e7-8cc5-4f85-a316-c5b1a3f16245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:59.720050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:59.720050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:59.720050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:59.720050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:59.720050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:59.720050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:59.720050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:59.720050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:59.720050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:59.720050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:59.720050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:59.720050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:09:59.720050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:09:59.720050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:09:59.720050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:59.721032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:09:59.722319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:09:59.722319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:09:59.722319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:09:59.722319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 275/530] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:59.722319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8719e7-8cc5-4f85-a316-c5b1a3f16245 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:59.741767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a78dc5-2119-421b-8e8c-2ee9325e5564 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:59.781704 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313c2d2-c3a0-4f30-86d3-958af4511df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:59.782475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313c2d2-c3a0-4f30-86d3-958af4511df8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:59.782758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313c2d2-c3a0-4f30-86d3-958af4511df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:59.783027 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313c2d2-c3a0-4f30-86d3-958af4511df8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:59.786395 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:59.791473 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313c2d2-c3a0-4f30-86d3-958af4511df8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:59.792933 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313c2d2-c3a0-4f30-86d3-958af4511df8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:59.805543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-5313c2d2-c3a0-4f30-86d3-958af4511df8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:09:59.805543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:09:59.805543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:09:59.805543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:09:59.805543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:09:59.805543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:09:59.805543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:09:59.805543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:09:59.805543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:09:59.805543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:09:59.805543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:09:59.805543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:09:59.805543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:09:59.805543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:09:59.805543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:09:59.806481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:09:59.807345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:09:59.807345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:09:59.807345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:09:59.807345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:09:59.807345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:09:59.807345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:09:59.807345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:09:59.807345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:09:59.807345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 256/531] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:09:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:09:59.807820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313c2d2-c3a0-4f30-86d3-958af4511df8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:59.841470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8719e7-8cc5-4f85-a316-c5b1a3f16245 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:59.877353 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b89c01-854f-4e86-b846-dfb925cc6404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:59.878150 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b89c01-854f-4e86-b846-dfb925cc6404 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:59.878310 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:09:59.878605 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b89c01-854f-4e86-b846-dfb925cc6404 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:59.878968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b89c01-854f-4e86-b846-dfb925cc6404 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:59.880057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b89c01-854f-4e86-b846-dfb925cc6404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:59.880057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b89c01-854f-4e86-b846-dfb925cc6404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:59.881560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b89c01-854f-4e86-b846-dfb925cc6404 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:59.895538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 276/532] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:59.896572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b89c01-854f-4e86-b846-dfb925cc6404 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:09:59.916324 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313c2d2-c3a0-4f30-86d3-958af4511df8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:09:59.953515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58fe40-1b0a-4e27-b431-f27ea06f194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:09:59.954969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58fe40-1b0a-4e27-b431-f27ea06f194c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:09:59.955480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58fe40-1b0a-4e27-b431-f27ea06f194c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:09:59.955932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58fe40-1b0a-4e27-b431-f27ea06f194c None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:09:59.956741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58fe40-1b0a-4e27-b431-f27ea06f194c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:09:59.957213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58fe40-1b0a-4e27-b431-f27ea06f194c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:09:59.959096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58fe40-1b0a-4e27-b431-f27ea06f194c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:09:59.980428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 257/533] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:09:59.981683 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58fe40-1b0a-4e27-b431-f27ea06f194c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:00.003806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b89c01-854f-4e86-b846-dfb925cc6404 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:00.015518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:00.039155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b72d3-167f-4bdd-a72e-dc5edb87f78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:00.039864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b72d3-167f-4bdd-a72e-dc5edb87f78e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:00.040207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b72d3-167f-4bdd-a72e-dc5edb87f78e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:00.040686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b72d3-167f-4bdd-a72e-dc5edb87f78e None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:00.041266 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b72d3-167f-4bdd-a72e-dc5edb87f78e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:00.041573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b72d3-167f-4bdd-a72e-dc5edb87f78e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:00.045395 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b72d3-167f-4bdd-a72e-dc5edb87f78e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:00.069424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 277/534] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:09:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:00.070307 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b72d3-167f-4bdd-a72e-dc5edb87f78e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:00.103189 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58fe40-1b0a-4e27-b431-f27ea06f194c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:00.134135 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:00.141657 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714e5bf-4066-4844-9439-0904d4cdb4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:00.142411 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714e5bf-4066-4844-9439-0904d4cdb4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:00.142758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714e5bf-4066-4844-9439-0904d4cdb4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:00.143095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714e5bf-4066-4844-9439-0904d4cdb4c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:00.151239 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714e5bf-4066-4844-9439-0904d4cdb4c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:00.153227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714e5bf-4066-4844-9439-0904d4cdb4c9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:00.167073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c714e5bf-4066-4844-9439-0904d4cdb4c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:00.167073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:00.167073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:00.167073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:00.167073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:00.167073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:00.167073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:00.167073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:00.167073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:00.167073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:00.167073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:00.167073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:00.167073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:00.167073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:00.167073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:00.169184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:00.171569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:00.171569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:00.171569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:00.171569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:00.171569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:00.171569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:00.171569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:00.171569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:00.171569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 258/535] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:09:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:00.171569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714e5bf-4066-4844-9439-0904d4cdb4c9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:00.179425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b72d3-167f-4bdd-a72e-dc5edb87f78e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:00.216571 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a25c7-6d37-454a-a82c-4419554ebf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:00.217362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a25c7-6d37-454a-a82c-4419554ebf44 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:00.217649 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a25c7-6d37-454a-a82c-4419554ebf44 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:00.217957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a25c7-6d37-454a-a82c-4419554ebf44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:00.225553 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a25c7-6d37-454a-a82c-4419554ebf44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:00.227195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a25c7-6d37-454a-a82c-4419554ebf44 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:00.243201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-6b5a25c7-6d37-454a-a82c-4419554ebf44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:00.243201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:00.243201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:00.243201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:00.243201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:00.243201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:00.243201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:00.243201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:00.243201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:00.243201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:00.243201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:00.243201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:00.243201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:00.243201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:00.243201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:00.245248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:00.248301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:00.248301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:00.248301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:00.248301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:00.248301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:00.248301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:00.248301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:00.248301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:00.248301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 278/536] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:00.248301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a25c7-6d37-454a-a82c-4419554ebf44 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:00.288078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:00.299058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714e5bf-4066-4844-9439-0904d4cdb4c9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:00.344771 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33af9e-b060-46c7-9951-68712c9c2962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:00.345382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33af9e-b060-46c7-9951-68712c9c2962 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:00.345660 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33af9e-b060-46c7-9951-68712c9c2962 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:00.345954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33af9e-b060-46c7-9951-68712c9c2962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:00.346676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33af9e-b060-46c7-9951-68712c9c2962 None admin] RBAC: Adding query filter params (role.id=118b4b27bab54b429c3a70924d659c72, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=6dbf682960cc447099c11862afa3206b) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:00.346975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33af9e-b060-46c7-9951-68712c9c2962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:00.348532 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33af9e-b060-46c7-9951-68712c9c2962 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:00.361650 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 259/537] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:00 2022] GET /identity/v3/role_assignments?user.id=6dbf682960cc447099c11862afa3206b&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=118b4b27bab54b429c3a70924d659c72 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:00.363272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33af9e-b060-46c7-9951-68712c9c2962 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:00.389829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a25c7-6d37-454a-a82c-4419554ebf44 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:00.453548 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae59bad-75db-47fa-b29c-5bfa1129ba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:00.455620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae59bad-75db-47fa-b29c-5bfa1129ba3f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:00.456102 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae59bad-75db-47fa-b29c-5bfa1129ba3f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:00.456603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae59bad-75db-47fa-b29c-5bfa1129ba3f None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:00.457516 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae59bad-75db-47fa-b29c-5bfa1129ba3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:00.458051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae59bad-75db-47fa-b29c-5bfa1129ba3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:00.459904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae59bad-75db-47fa-b29c-5bfa1129ba3f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:00.478725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 279/538] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:00.485176 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae59bad-75db-47fa-b29c-5bfa1129ba3f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:00.496125 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:00.589623 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33af9e-b060-46c7-9951-68712c9c2962 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:00.629274 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae7d2d-77c4-4479-9de1-0356db9d791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:00.630297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae7d2d-77c4-4479-9de1-0356db9d791d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:00.630781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae7d2d-77c4-4479-9de1-0356db9d791d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:00.631276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae7d2d-77c4-4479-9de1-0356db9d791d None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:00.632173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae7d2d-77c4-4479-9de1-0356db9d791d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:00.632691 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae7d2d-77c4-4479-9de1-0356db9d791d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:00.634392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae7d2d-77c4-4479-9de1-0356db9d791d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:00.649644 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 260/539] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:00.656249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae7d2d-77c4-4479-9de1-0356db9d791d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:00.709094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:00.724404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae59bad-75db-47fa-b29c-5bfa1129ba3f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:00.770985 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae7d2d-77c4-4479-9de1-0356db9d791d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:00.784158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3f5ea-ba70-4e0b-aeb5-76fc40c9c63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:00.784546 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3f5ea-ba70-4e0b-aeb5-76fc40c9c63b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:00.784824 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3f5ea-ba70-4e0b-aeb5-76fc40c9c63b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:00.785092 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3f5ea-ba70-4e0b-aeb5-76fc40c9c63b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:00.785858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3f5ea-ba70-4e0b-aeb5-76fc40c9c63b None admin] RBAC: Adding query filter params (role.id=118b4b27bab54b429c3a70924d659c72, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=1879a3ad7be74303b9feceff75f62979) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:00.786060 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:00.786195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3f5ea-ba70-4e0b-aeb5-76fc40c9c63b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:00.787603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3f5ea-ba70-4e0b-aeb5-76fc40c9c63b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:00.800729 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 280/540] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:00 2022] GET /identity/v3/role_assignments?user.id=1879a3ad7be74303b9feceff75f62979&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=118b4b27bab54b429c3a70924d659c72 => generated 259 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:00.815912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9365d3b-2d26-4355-a112-897fc5301800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:00.816613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9365d3b-2d26-4355-a112-897fc5301800 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:00.816893 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9365d3b-2d26-4355-a112-897fc5301800 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:00.817166 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9365d3b-2d26-4355-a112-897fc5301800 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:00.817944 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9365d3b-2d26-4355-a112-897fc5301800 None admin] RBAC: Adding query filter params (role.id=118b4b27bab54b429c3a70924d659c72, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=defbff3e8f934dab9c800c7207c1d539) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:00.818252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9365d3b-2d26-4355-a112-897fc5301800 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:00.819882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9365d3b-2d26-4355-a112-897fc5301800 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:00.833309 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 261/541] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:00 2022] GET /identity/v3/role_assignments?user.id=defbff3e8f934dab9c800c7207c1d539&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=118b4b27bab54b429c3a70924d659c72 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:01.817845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6938-ddab-4bb7-a235-9dfd1c43fa96 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:01.818874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6938-ddab-4bb7-a235-9dfd1c43fa96 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:01.819368 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6938-ddab-4bb7-a235-9dfd1c43fa96 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:01.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 281/542] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:01.827430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633392c-c372-4f84-8d42-5d5be1d11fd9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:01.827888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633392c-c372-4f84-8d42-5d5be1d11fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:01.827979 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633392c-c372-4f84-8d42-5d5be1d11fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:01.855211 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f633392c-c372-4f84-8d42-5d5be1d11fd9 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:01.856413 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f633392c-c372-4f84-8d42-5d5be1d11fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:01.951748 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 262/543] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:02.251472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd084a8-404d-47f8-ae16-66491af9159d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:02.251864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd084a8-404d-47f8-ae16-66491af9159d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:02.252035 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd084a8-404d-47f8-ae16-66491af9159d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:02.253605 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 282/544] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:02.258776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59431438-662a-4dea-84c8-007aa78ed383 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:02.259063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59431438-662a-4dea-84c8-007aa78ed383 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:02.259340 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59431438-662a-4dea-84c8-007aa78ed383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:02.286745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-59431438-662a-4dea-84c8-007aa78ed383 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:02.287938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-59431438-662a-4dea-84c8-007aa78ed383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:02.343469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd084a8-404d-47f8-ae16-66491af9159d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:02.364548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 263/545] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:02.489549 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd084a8-404d-47f8-ae16-66491af9159d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:02.541004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192adaa-057e-48f7-801b-c748713ecd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:02.541571 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192adaa-057e-48f7-801b-c748713ecd17 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:02.541876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192adaa-057e-48f7-801b-c748713ecd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:02.542153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192adaa-057e-48f7-801b-c748713ecd17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:02.559076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192adaa-057e-48f7-801b-c748713ecd17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:02.563973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-6192adaa-057e-48f7-801b-c748713ecd17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:02.563973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:02.563973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:02.563973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:02.563973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:02.563973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:02.563973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:02.563973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:02.563973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:02.563973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:02.563973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:02.563973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:02.563973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:02.563973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:02.563973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:02.563973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:02.564872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:02.564872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:02.564872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:02.564872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:02.564872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:02.564872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:02.564872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:02.564872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:02.564872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:02.564872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:02.564872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:02.564872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:02.564872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:02.564872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:02.564872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:02.564872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:02.565668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:02.565668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:02.565668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:02.565668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:02.565668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:02.565668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:02.565668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:02.565668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:02.565668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:02.565668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:02.565668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:02.565668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:02.565668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 283/546] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:10:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:02.571005 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59431438-662a-4dea-84c8-007aa78ed383 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:02.618444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:02.648036 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192adaa-057e-48f7-801b-c748713ecd17 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:02.669808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:02.690780 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59431438-662a-4dea-84c8-007aa78ed383 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:02.736282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472da6fe-1257-42d7-86e0-ed5b5782fc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:02.736910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472da6fe-1257-42d7-86e0-ed5b5782fc32 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:02.737193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472da6fe-1257-42d7-86e0-ed5b5782fc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:02.737467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472da6fe-1257-42d7-86e0-ed5b5782fc32 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:02.738174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472da6fe-1257-42d7-86e0-ed5b5782fc32 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:02.738480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472da6fe-1257-42d7-86e0-ed5b5782fc32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:02.739887 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472da6fe-1257-42d7-86e0-ed5b5782fc32 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:02.758556 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 264/547] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:10:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:02.764410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472da6fe-1257-42d7-86e0-ed5b5782fc32 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:02.813281 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192adaa-057e-48f7-801b-c748713ecd17 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:02.880288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e629e4-70d2-4d44-aad9-78c62ab7136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:02.880946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e629e4-70d2-4d44-aad9-78c62ab7136c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:02.881177 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e629e4-70d2-4d44-aad9-78c62ab7136c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:02.881449 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e629e4-70d2-4d44-aad9-78c62ab7136c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:02.907111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e629e4-70d2-4d44-aad9-78c62ab7136c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:02.911879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-98e629e4-70d2-4d44-aad9-78c62ab7136c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:02.911879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:02.911879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:02.911879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:02.911879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:02.911879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:02.911879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:02.911879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:02.911879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:02.911879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:02.911879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:02.911879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:02.911879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:02.911879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:02.911879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:02.911879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:02.913284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:02.913284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:02.913284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:02.913284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:02.913284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:02.913284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:02.913284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:02.913284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:02.913284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:02.913284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:02.913284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:02.913284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:02.913284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:02.913284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:02.913284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:02.913284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:02.914293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:02.914293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:02.914293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:02.914293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:02.914293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:02.914293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:02.914293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:02.914293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:02.914293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:02.914293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:02.914293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:02.914293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:02.921572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 284/548] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:10:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:02.926605 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e629e4-70d2-4d44-aad9-78c62ab7136c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:02.950164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:02.956784 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472da6fe-1257-42d7-86e0-ed5b5782fc32 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:03.030714 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6b5ab-8559-4984-90d9-4f2ea92b986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:03.031353 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6b5ab-8559-4984-90d9-4f2ea92b986e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:03.031629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6b5ab-8559-4984-90d9-4f2ea92b986e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:03.031898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6b5ab-8559-4984-90d9-4f2ea92b986e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:03.050255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6b5ab-8559-4984-90d9-4f2ea92b986e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:03.051708 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6b5ab-8559-4984-90d9-4f2ea92b986e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:03.080954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c9f6b5ab-8559-4984-90d9-4f2ea92b986e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:03.080954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:03.080954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:03.080954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:03.080954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:03.080954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:03.080954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:03.080954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:03.080954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:03.080954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:03.080954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:03.080954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:03.080954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:03.080954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:03.080954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:03.080954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:03.081966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:03.082827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:03.082827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:03.082827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:03.082827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 265/549] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:03.089233 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6b5ab-8559-4984-90d9-4f2ea92b986e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:03.090949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:03.124488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e629e4-70d2-4d44-aad9-78c62ab7136c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:03.168000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bae82b-b00c-42a9-bfb9-b193ccb7aa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:03.169409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bae82b-b00c-42a9-bfb9-b193ccb7aa1a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:03.169690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bae82b-b00c-42a9-bfb9-b193ccb7aa1a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:03.169990 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bae82b-b00c-42a9-bfb9-b193ccb7aa1a None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:03.170833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bae82b-b00c-42a9-bfb9-b193ccb7aa1a None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:03.171147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bae82b-b00c-42a9-bfb9-b193ccb7aa1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:03.173473 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bae82b-b00c-42a9-bfb9-b193ccb7aa1a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:03.183949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 285/550] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:10:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:03.185950 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be454cef-d2c7-4e73-9451-95744414be14 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:03.186237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be454cef-d2c7-4e73-9451-95744414be14 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:03.186880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be454cef-d2c7-4e73-9451-95744414be14 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:03.189925 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 286/551] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:03.190896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be454cef-d2c7-4e73-9451-95744414be14 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:03.209990 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6b5ab-8559-4984-90d9-4f2ea92b986e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:03.244647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fbe21-7032-49a5-af45-805626ecaa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:03.245253 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fbe21-7032-49a5-af45-805626ecaa8c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:03.245536 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fbe21-7032-49a5-af45-805626ecaa8c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:03.245850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fbe21-7032-49a5-af45-805626ecaa8c None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:03.246492 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fbe21-7032-49a5-af45-805626ecaa8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:03.246795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fbe21-7032-49a5-af45-805626ecaa8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:03.248717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fbe21-7032-49a5-af45-805626ecaa8c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:03.265430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 266/552] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:03.266850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002655e-875d-43a2-877d-e5abc359a03e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:03.267074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002655e-875d-43a2-877d-e5abc359a03e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:03.267352 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002655e-875d-43a2-877d-e5abc359a03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:03.285306 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c002655e-875d-43a2-877d-e5abc359a03e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:03.286547 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c002655e-875d-43a2-877d-e5abc359a03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:03.288554 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:03.313879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be454cef-d2c7-4e73-9451-95744414be14 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:03.352505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a603e-f3c3-4bc7-91ae-15335f13c7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:03.353462 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a603e-f3c3-4bc7-91ae-15335f13c7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:03.353981 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a603e-f3c3-4bc7-91ae-15335f13c7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:03.354758 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a603e-f3c3-4bc7-91ae-15335f13c7f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:03.358430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:03.367759 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 267/553] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:03.370014 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002655e-875d-43a2-877d-e5abc359a03e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:03.379962 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a603e-f3c3-4bc7-91ae-15335f13c7f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:03.382780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a603e-f3c3-4bc7-91ae-15335f13c7f7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:03.414913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e15a603e-f3c3-4bc7-91ae-15335f13c7f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:03.414913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:03.414913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:03.414913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:03.414913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:03.414913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:03.414913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:03.414913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:03.414913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:03.414913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:03.414913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:03.414913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:03.414913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:03.414913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:03.414913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:03.414913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:03.415937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:03.416826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:03.416826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:03.416826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:03.423765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 287/554] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:03.429684 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a603e-f3c3-4bc7-91ae-15335f13c7f7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:03.568460 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a603e-f3c3-4bc7-91ae-15335f13c7f7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:03.580448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002655e-875d-43a2-877d-e5abc359a03e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:03.614534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ea7a8-a249-4275-b783-96078757b3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:03.615493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ea7a8-a249-4275-b783-96078757b3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:03.616256 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ea7a8-a249-4275-b783-96078757b3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:03.616733 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ea7a8-a249-4275-b783-96078757b3f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:03.617874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ea7a8-a249-4275-b783-96078757b3f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:03.618824 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ea7a8-a249-4275-b783-96078757b3f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:03.620927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ea7a8-a249-4275-b783-96078757b3f4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:03.623120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ea3dc-d1fd-43a2-bb1f-1854a0264b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:03.623750 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ea3dc-d1fd-43a2-bb1f-1854a0264b9d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:03.624027 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ea3dc-d1fd-43a2-bb1f-1854a0264b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:03.624309 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ea3dc-d1fd-43a2-bb1f-1854a0264b9d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:03.631753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ea3dc-d1fd-43a2-bb1f-1854a0264b9d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:03.633182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ea3dc-d1fd-43a2-bb1f-1854a0264b9d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:03.635073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:03.642603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 288/555] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:03.642603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7ba15-27af-4cfd-ae1a-18a305046587 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:03.642603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7ba15-27af-4cfd-ae1a-18a305046587 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:03.642603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7ba15-27af-4cfd-ae1a-18a305046587 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:03.642603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 289/556] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:03.643112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b95d9a-5112-46c2-9135-5a42fc41ea2d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:03.643112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b95d9a-5112-46c2-9135-5a42fc41ea2d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:03.643924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b95d9a-5112-46c2-9135-5a42fc41ea2d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:03.644745 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 290/557] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:03.645787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b95d9a-5112-46c2-9135-5a42fc41ea2d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:03.651707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-447ea3dc-d1fd-43a2-bb1f-1854a0264b9d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 15:10:03.651707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:03.651707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:03.651707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:03.651707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:03.651707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:03.651707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:03.651707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:03.651707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:03.651707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:03.651707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:03.651707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:03.651707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:03.651707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:03.651707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:03.651707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:03.652873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:03.654603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:03.654603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:03.654603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:03.654603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:03.654603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:03.654603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:03.654603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:03.654603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:03.654603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 15:10:03.654603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:03.656419 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 268/558] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:10:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:03.657707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28118b66-5858-43d1-8b74-e07a1a179277 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:03.658177 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28118b66-5858-43d1-8b74-e07a1a179277 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:03.658628 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28118b66-5858-43d1-8b74-e07a1a179277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:03.679128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-28118b66-5858-43d1-8b74-e07a1a179277 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:03.680304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-28118b66-5858-43d1-8b74-e07a1a179277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:03.698938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:03.747223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 269/559] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:03.748515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b74260-ecc1-4772-a287-8ba13d716c57 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:03.748798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b74260-ecc1-4772-a287-8ba13d716c57 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:03.749069 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b74260-ecc1-4772-a287-8ba13d716c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:03.751459 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b95d9a-5112-46c2-9135-5a42fc41ea2d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:03.767432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-34b74260-ecc1-4772-a287-8ba13d716c57 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:03.768692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-34b74260-ecc1-4772-a287-8ba13d716c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:03.791938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb66e1-32ea-41b6-8786-4f53faf0ff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:03.792563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb66e1-32ea-41b6-8786-4f53faf0ff1f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:03.793069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb66e1-32ea-41b6-8786-4f53faf0ff1f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:03.793069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb66e1-32ea-41b6-8786-4f53faf0ff1f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:03.801142 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb66e1-32ea-41b6-8786-4f53faf0ff1f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:03.802734 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb66e1-32ea-41b6-8786-4f53faf0ff1f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:03.814127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-befb66e1-32ea-41b6-8786-4f53faf0ff1f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 15:10:03.814127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:03.814127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:03.814127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:03.814127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:03.814127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:03.814127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:03.814127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:03.814127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:03.814127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:03.814127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:03.814127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:03.814127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:03.814127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:03.814127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:03.814127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:03.815249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:03.816207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:03.816207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:03.816207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:03.816207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:03.816207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:03.816207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:03.816207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:03.816207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:03.816207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 15:10:03.816207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:03.816207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 291/560] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:10:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:03.816207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb66e1-32ea-41b6-8786-4f53faf0ff1f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:03.845910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 270/561] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:03.854726 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b74260-ecc1-4772-a287-8ba13d716c57 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:03.925787 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:03.930193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb66e1-32ea-41b6-8786-4f53faf0ff1f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:03.941257 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:03.974519 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfa308-9d91-4f67-99bd-47e25e989fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:03.975657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfa308-9d91-4f67-99bd-47e25e989fdf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:03.976099 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfa308-9d91-4f67-99bd-47e25e989fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:03.976533 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfa308-9d91-4f67-99bd-47e25e989fdf None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:03.977421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfa308-9d91-4f67-99bd-47e25e989fdf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:03.977916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfa308-9d91-4f67-99bd-47e25e989fdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:03.980193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfa308-9d91-4f67-99bd-47e25e989fdf None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:03.994316 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b74260-ecc1-4772-a287-8ba13d716c57 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:04.005283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 292/562] 10.222.0.82 () {56 vars in 1137 bytes} [Fri Sep 23 15:10:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:04.006412 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfa308-9d91-4f67-99bd-47e25e989fdf None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:04.042303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a3948-32c4-4e70-b11c-39220bf43a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:04.043194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a3948-32c4-4e70-b11c-39220bf43a77 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:04.043745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a3948-32c4-4e70-b11c-39220bf43a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:04.044016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a3948-32c4-4e70-b11c-39220bf43a77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:04.057505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a3948-32c4-4e70-b11c-39220bf43a77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:04.063851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-960a3948-32c4-4e70-b11c-39220bf43a77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:04.063851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:04.063851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:04.063851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:04.063851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:04.063851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:04.063851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:04.063851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:04.063851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:04.063851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:04.063851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:04.063851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:04.063851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:04.063851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:04.063851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:04.063851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:04.064793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:04.064793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:04.064793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:04.064793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:04.064793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:04.064793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:04.064793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:04.064793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:04.064793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:04.064793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:04.064793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:04.064793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:04.064793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:04.064793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:04.064793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:04.064793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:04.065647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:04.065647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:04.065647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:04.065647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:04.065647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:04.065647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:04.065647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:04.065647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:04.065647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:04.065647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:04.065647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:04.065647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:04.066991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 271/563] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:10:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:04.066991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a3948-32c4-4e70-b11c-39220bf43a77 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:04.121191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfa308-9d91-4f67-99bd-47e25e989fdf None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:04.156572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c99cf-d6c4-4df4-96c7-bd9caf100696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:04.157188 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c99cf-d6c4-4df4-96c7-bd9caf100696 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:04.157464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c99cf-d6c4-4df4-96c7-bd9caf100696 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:04.157757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c99cf-d6c4-4df4-96c7-bd9caf100696 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:04.158490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c99cf-d6c4-4df4-96c7-bd9caf100696 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:04.158796 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c99cf-d6c4-4df4-96c7-bd9caf100696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:04.160247 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c99cf-d6c4-4df4-96c7-bd9caf100696 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:04.167524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a3948-32c4-4e70-b11c-39220bf43a77 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:04.177487 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 293/564] 10.222.0.82 () {56 vars in 1135 bytes} [Fri Sep 23 15:10:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:04.178250 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c99cf-d6c4-4df4-96c7-bd9caf100696 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:04.185603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:04.202819 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8693d-4d0b-4c22-855b-cb7ab9245f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:04.203412 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:04.203543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8693d-4d0b-4c22-855b-cb7ab9245f73 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:04.203716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8693d-4d0b-4c22-855b-cb7ab9245f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:04.203988 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8693d-4d0b-4c22-855b-cb7ab9245f73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:04.213872 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8693d-4d0b-4c22-855b-cb7ab9245f73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:04.215312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8693d-4d0b-4c22-855b-cb7ab9245f73 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:04.230247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-5ff8693d-4d0b-4c22-855b-cb7ab9245f73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:04.230247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:04.230247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:04.230247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:04.230247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:04.230247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:04.230247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:04.230247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:04.230247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:04.230247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:04.230247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:04.230247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:04.230247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:04.230247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:04.230247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:04.230247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:04.231408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:04.232335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:04.232335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:04.232335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:04.232335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 272/565] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:04.232335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8693d-4d0b-4c22-855b-cb7ab9245f73 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:04.283940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c99cf-d6c4-4df4-96c7-bd9caf100696 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:04.322468 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a51b3-981c-424c-9e4d-0316bb5011ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:04.323106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a51b3-981c-424c-9e4d-0316bb5011ea None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:04.323379 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a51b3-981c-424c-9e4d-0316bb5011ea None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:04.323648 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a51b3-981c-424c-9e4d-0316bb5011ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:04.334902 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8693d-4d0b-4c22-855b-cb7ab9245f73 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:04.341325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a51b3-981c-424c-9e4d-0316bb5011ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:04.347148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-5c6a51b3-981c-424c-9e4d-0316bb5011ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:04.347148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:04.347148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:04.347148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:04.347148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:04.347148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:04.347148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:04.347148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:04.347148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:04.347148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:04.347148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:04.347148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:04.347148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:04.347148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:04.347148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:04.347148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:04.348241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:04.348241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:04.348241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:04.348241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:04.348241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:04.348241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:04.348241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:04.348241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:04.348241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:04.348241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:04.348241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:04.348241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:04.348241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:04.348241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:04.348241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:04.348241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:04.350850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:04.350850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:04.350850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:04.350850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:04.350850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:04.350850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:04.350850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:04.350850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:04.350850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:04.350850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:04.350850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:04.350850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:04.350850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 294/566] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:10:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:04.350850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a51b3-981c-424c-9e4d-0316bb5011ea None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:04.373403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7891246-769e-4ab2-bd60-a1628619a7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:04.374109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7891246-769e-4ab2-bd60-a1628619a7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:04.374384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7891246-769e-4ab2-bd60-a1628619a7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:04.374656 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7891246-769e-4ab2-bd60-a1628619a7b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:04.375306 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7891246-769e-4ab2-bd60-a1628619a7b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:04.375606 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7891246-769e-4ab2-bd60-a1628619a7b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:04.376969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7891246-769e-4ab2-bd60-a1628619a7b1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:04.384754 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 273/567] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:10:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:04.385531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7891246-769e-4ab2-bd60-a1628619a7b1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:04.416819 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:04.433577 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:04.450664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a51b3-981c-424c-9e4d-0316bb5011ea None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:04.483039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c53344-7a9d-4279-a841-a68040d56361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:04.483663 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c53344-7a9d-4279-a841-a68040d56361 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:04.483933 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c53344-7a9d-4279-a841-a68040d56361 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:04.484201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c53344-7a9d-4279-a841-a68040d56361 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:04.485530 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7891246-769e-4ab2-bd60-a1628619a7b1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:04.493915 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c53344-7a9d-4279-a841-a68040d56361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:04.499156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-91c53344-7a9d-4279-a841-a68040d56361 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:04.499156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:04.499156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:04.499156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:04.499156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:04.499156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:04.499156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:04.499156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:04.499156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:04.499156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:04.499156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:04.499156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:04.499156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:04.499156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:04.499156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:04.499156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:04.500271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:04.500271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:04.500271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:04.500271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:04.500271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:04.500271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:04.500271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:04.500271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:04.500271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:04.500271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:04.500271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:04.500271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:04.500271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:04.500271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:04.500271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:04.500271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:04.501397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:04.501397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:04.501397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:04.501397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:04.501397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:04.501397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:04.501397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:04.501397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:04.501397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:04.501397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:04.501397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:04.501397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:04.501397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 295/568] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:10:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:04.501397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c53344-7a9d-4279-a841-a68040d56361 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:04.525269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52415509-00fc-4d3b-99b7-a52c5532a8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:04.525915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52415509-00fc-4d3b-99b7-a52c5532a8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:04.526192 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52415509-00fc-4d3b-99b7-a52c5532a8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:04.526465 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52415509-00fc-4d3b-99b7-a52c5532a8f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:04.594519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52415509-00fc-4d3b-99b7-a52c5532a8f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:04.595967 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52415509-00fc-4d3b-99b7-a52c5532a8f1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:04.600309 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c53344-7a9d-4279-a841-a68040d56361 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:04.627183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:04.634449 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93d253-7d80-418c-8a3a-5e7b2e71fec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:04.635057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93d253-7d80-418c-8a3a-5e7b2e71fec2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:04.635341 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93d253-7d80-418c-8a3a-5e7b2e71fec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:04.635612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93d253-7d80-418c-8a3a-5e7b2e71fec2 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:04.637064 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93d253-7d80-418c-8a3a-5e7b2e71fec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:04.637064 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93d253-7d80-418c-8a3a-5e7b2e71fec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:04.637943 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93d253-7d80-418c-8a3a-5e7b2e71fec2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:04.649463 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 296/569] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:04.650305 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93d253-7d80-418c-8a3a-5e7b2e71fec2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:04.654597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:04.702681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 274/570] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:10:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:10:04.703503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52415509-00fc-4d3b-99b7-a52c5532a8f1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:04.752540 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93d253-7d80-418c-8a3a-5e7b2e71fec2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:04.785585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdbfba-a6e1-43da-a415-788334197d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:04.786451 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdbfba-a6e1-43da-a415-788334197d5b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:04.786723 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdbfba-a6e1-43da-a415-788334197d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:04.786992 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdbfba-a6e1-43da-a415-788334197d5b None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:04.787634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdbfba-a6e1-43da-a415-788334197d5b None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:04.787940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdbfba-a6e1-43da-a415-788334197d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:04.789335 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdbfba-a6e1-43da-a415-788334197d5b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:04.798447 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 297/571] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:10:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:04.799363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdbfba-a6e1-43da-a415-788334197d5b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:04.803640 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52415509-00fc-4d3b-99b7-a52c5532a8f1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:04.832419 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:04.837123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d820045-143b-4c9d-8b00-43e3fc7e39f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:04.843233 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d820045-143b-4c9d-8b00-43e3fc7e39f8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:04.843233 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d820045-143b-4c9d-8b00-43e3fc7e39f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:04.843233 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d820045-143b-4c9d-8b00-43e3fc7e39f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:04.848616 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d820045-143b-4c9d-8b00-43e3fc7e39f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:04.850097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d820045-143b-4c9d-8b00-43e3fc7e39f8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:04.863838 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:04.864270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3d820045-143b-4c9d-8b00-43e3fc7e39f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:04.864270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:04.864270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:04.864270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:04.864270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:04.864270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:04.864270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:04.864270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:04.864270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:04.864270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:04.864270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:04.864270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:04.864270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:04.864270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:04.864270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:04.864270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:04.865359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:04.866494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:04.866494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:04.866494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:04.866494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 275/572] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:04.866494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d820045-143b-4c9d-8b00-43e3fc7e39f8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:04.899681 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdbfba-a6e1-43da-a415-788334197d5b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:04.934755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6713349-3155-44a5-bca6-5a4cacc7fa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:04.935399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6713349-3155-44a5-bca6-5a4cacc7fa6c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:04.935620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6713349-3155-44a5-bca6-5a4cacc7fa6c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:04.935896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6713349-3155-44a5-bca6-5a4cacc7fa6c None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:04.936554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6713349-3155-44a5-bca6-5a4cacc7fa6c None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:04.936856 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6713349-3155-44a5-bca6-5a4cacc7fa6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:04.938287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6713349-3155-44a5-bca6-5a4cacc7fa6c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:04.946223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 298/573] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:10:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:04.947004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6713349-3155-44a5-bca6-5a4cacc7fa6c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:04.981872 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d820045-143b-4c9d-8b00-43e3fc7e39f8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:05.015391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8277a67-473e-4ed9-9a5f-410e989c7990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:05.016013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8277a67-473e-4ed9-9a5f-410e989c7990 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:05.016278 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8277a67-473e-4ed9-9a5f-410e989c7990 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:05.016549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8277a67-473e-4ed9-9a5f-410e989c7990 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:05.023138 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8277a67-473e-4ed9-9a5f-410e989c7990 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:05.024611 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8277a67-473e-4ed9-9a5f-410e989c7990 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:05.036323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c8277a67-473e-4ed9-9a5f-410e989c7990 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:05.036323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:05.036323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:05.036323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:05.036323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:05.036323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:05.036323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:05.036323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:05.036323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:05.036323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:05.036323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:05.036323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:05.036323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:05.036323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:05.036323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:05.037386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:05.038349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:05.038349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:05.038349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:05.038349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:05.038349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:05.038349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:05.038349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:05.038349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:05.038349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 276/574] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:05.038349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8277a67-473e-4ed9-9a5f-410e989c7990 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:05.051871 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6713349-3155-44a5-bca6-5a4cacc7fa6c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:05.077563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:05.085126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729e556-df0c-4185-a5c2-e48b014e812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:05.085689 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:05.085896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729e556-df0c-4185-a5c2-e48b014e812f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:05.086039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729e556-df0c-4185-a5c2-e48b014e812f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:05.086316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729e556-df0c-4185-a5c2-e48b014e812f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:05.096964 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729e556-df0c-4185-a5c2-e48b014e812f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:05.098443 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729e556-df0c-4185-a5c2-e48b014e812f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:05.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1729e556-df0c-4185-a5c2-e48b014e812f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:05.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:05.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:05.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:05.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:05.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:05.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:05.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:05.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:05.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:05.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:05.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:05.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:05.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:05.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:05.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:05.114067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:05.115066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:05.115066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:05.115066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:05.115066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 299/575] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:05.115066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729e556-df0c-4185-a5c2-e48b014e812f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:05.143627 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8277a67-473e-4ed9-9a5f-410e989c7990 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:05.178029 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9565672-9089-4183-a8df-2ab50ff5d384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:05.178672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9565672-9089-4183-a8df-2ab50ff5d384 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:05.178938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9565672-9089-4183-a8df-2ab50ff5d384 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:05.179207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9565672-9089-4183-a8df-2ab50ff5d384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:05.189706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9565672-9089-4183-a8df-2ab50ff5d384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:05.191177 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9565672-9089-4183-a8df-2ab50ff5d384 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:05.205545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-f9565672-9089-4183-a8df-2ab50ff5d384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:05.205545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:05.205545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:05.205545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:05.205545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:05.205545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:05.205545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:05.205545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:05.205545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:05.205545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:05.205545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:05.205545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:05.205545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:05.205545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:05.205545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:05.205545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:05.206736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:05.207922 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:05.207922 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:05.207922 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:05.209285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 277/576] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:05.213903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9565672-9089-4183-a8df-2ab50ff5d384 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:05.214643 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729e556-df0c-4185-a5c2-e48b014e812f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:05.248398 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbf88a-0394-4194-8de3-a99c5aebd2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:05.248917 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbf88a-0394-4194-8de3-a99c5aebd2cb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:05.249197 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbf88a-0394-4194-8de3-a99c5aebd2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:05.249470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbf88a-0394-4194-8de3-a99c5aebd2cb None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:05.250140 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbf88a-0394-4194-8de3-a99c5aebd2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:05.250442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbf88a-0394-4194-8de3-a99c5aebd2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:05.251826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbf88a-0394-4194-8de3-a99c5aebd2cb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:05.263278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 300/577] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:05.264070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbf88a-0394-4194-8de3-a99c5aebd2cb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:05.305319 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:05.306431 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:05.311082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9565672-9089-4183-a8df-2ab50ff5d384 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:05.344811 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580c051-42fa-4179-b7c8-3c6c6968c7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:05.345462 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580c051-42fa-4179-b7c8-3c6c6968c7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:05.345908 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580c051-42fa-4179-b7c8-3c6c6968c7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:05.346604 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580c051-42fa-4179-b7c8-3c6c6968c7d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:05.357077 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580c051-42fa-4179-b7c8-3c6c6968c7d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:05.358536 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580c051-42fa-4179-b7c8-3c6c6968c7d3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:05.364187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbf88a-0394-4194-8de3-a99c5aebd2cb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:05.373956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a580c051-42fa-4179-b7c8-3c6c6968c7d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:05.373956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:05.373956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:05.373956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:05.373956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:05.373956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:05.373956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:05.373956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:05.373956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:05.373956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:05.373956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:05.373956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:05.373956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:05.373956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:05.373956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:05.373956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:05.376707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:05.377854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:05.377854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:05.377854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:05.377854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 278/578] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:05.377854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580c051-42fa-4179-b7c8-3c6c6968c7d3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:05.399661 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad0310-351a-4ca4-9f33-8763785e0c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:05.400261 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad0310-351a-4ca4-9f33-8763785e0c0e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:05.400534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad0310-351a-4ca4-9f33-8763785e0c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:05.400808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad0310-351a-4ca4-9f33-8763785e0c0e None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:05.401656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad0310-351a-4ca4-9f33-8763785e0c0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:05.401994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad0310-351a-4ca4-9f33-8763785e0c0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:05.403457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad0310-351a-4ca4-9f33-8763785e0c0e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:05.414979 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 301/579] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:05.415999 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad0310-351a-4ca4-9f33-8763785e0c0e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:05.480241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580c051-42fa-4179-b7c8-3c6c6968c7d3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:05.510526 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:05.513142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202f780-ad4f-4cbf-9f7d-f50f78330686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:05.513692 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad0310-351a-4ca4-9f33-8763785e0c0e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:05.513827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202f780-ad4f-4cbf-9f7d-f50f78330686 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:05.514042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202f780-ad4f-4cbf-9f7d-f50f78330686 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:05.514310 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202f780-ad4f-4cbf-9f7d-f50f78330686 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:05.514942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202f780-ad4f-4cbf-9f7d-f50f78330686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:05.515245 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202f780-ad4f-4cbf-9f7d-f50f78330686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:05.516617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202f780-ad4f-4cbf-9f7d-f50f78330686 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:05.529146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 279/580] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:05.530118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202f780-ad4f-4cbf-9f7d-f50f78330686 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:05.540936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:05.547683 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cca8cf-c582-4094-821f-dde56d10652e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:05.548295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cca8cf-c582-4094-821f-dde56d10652e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:05.548573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cca8cf-c582-4094-821f-dde56d10652e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:05.548842 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cca8cf-c582-4094-821f-dde56d10652e None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:05.549475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cca8cf-c582-4094-821f-dde56d10652e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:05.549806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cca8cf-c582-4094-821f-dde56d10652e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:05.551195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cca8cf-c582-4094-821f-dde56d10652e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:05.563140 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 302/581] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:05.565054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cca8cf-c582-4094-821f-dde56d10652e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:05.630002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202f780-ad4f-4cbf-9f7d-f50f78330686 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:05.663406 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cca8cf-c582-4094-821f-dde56d10652e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:05.664393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df564bb-e548-4363-9422-4192a2aae9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:05.665018 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df564bb-e548-4363-9422-4192a2aae9ea None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:05.665296 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df564bb-e548-4363-9422-4192a2aae9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:05.665569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df564bb-e548-4363-9422-4192a2aae9ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:05.673184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df564bb-e548-4363-9422-4192a2aae9ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:05.674723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df564bb-e548-4363-9422-4192a2aae9ea None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:05.687850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-6df564bb-e548-4363-9422-4192a2aae9ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:10:05.687850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:05.687850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:05.687850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:05.687850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:05.687850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:05.687850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:05.687850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:05.687850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:05.687850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:05.687850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:05.687850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:05.687850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:05.687850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:05.687850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:05.687850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:05.689009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:05.690697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:05.690697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:05.690697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:05.690697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:05.690697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:05.690697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:05.690697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:05.690697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:05.690697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:10:05.690697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:05.690697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 280/582] 10.222.0.82 () {56 vars in 1093 bytes} [Fri Sep 23 15:10:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:05.690697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df564bb-e548-4363-9422-4192a2aae9ea None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:05.704273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd3f11-9a0d-48a7-b906-04ec62a57365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:05.704873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd3f11-9a0d-48a7-b906-04ec62a57365 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:05.705145 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd3f11-9a0d-48a7-b906-04ec62a57365 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:05.705408 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd3f11-9a0d-48a7-b906-04ec62a57365 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:05.706082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd3f11-9a0d-48a7-b906-04ec62a57365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:05.706377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd3f11-9a0d-48a7-b906-04ec62a57365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:05.707755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd3f11-9a0d-48a7-b906-04ec62a57365 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:05.723472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 303/583] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:05.723472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd3f11-9a0d-48a7-b906-04ec62a57365 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:05.743342 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:05.757234 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:05.790614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df564bb-e548-4363-9422-4192a2aae9ea None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:05.819291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd3f11-9a0d-48a7-b906-04ec62a57365 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:05.826324 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563098b4-5534-447f-aaf1-e79b7270fdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:05.826986 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563098b4-5534-447f-aaf1-e79b7270fdd6 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:05.827266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563098b4-5534-447f-aaf1-e79b7270fdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:05.827580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563098b4-5534-447f-aaf1-e79b7270fdd6 None admin] PATH_INFO: `/v3/projects/718a472b7d564c429849b127a44aaaad/users/47bd08ee89014df281d0c0d5f8f6cabc/roles/118b4b27bab54b429c3a70924d659c72` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:05.845671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563098b4-5534-447f-aaf1-e79b7270fdd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=718a472b7d564c429849b127a44aaaad, user_id=47bd08ee89014df281d0c0d5f8f6cabc, role_id=118b4b27bab54b429c3a70924d659c72)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:05.847277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563098b4-5534-447f-aaf1-e79b7270fdd6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:05.854621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be391eb0-3e0d-4d9c-8d54-c7aa40c2080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:05.855251 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be391eb0-3e0d-4d9c-8d54-c7aa40c2080b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:05.855529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be391eb0-3e0d-4d9c-8d54-c7aa40c2080b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:05.855800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be391eb0-3e0d-4d9c-8d54-c7aa40c2080b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:05.862345 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be391eb0-3e0d-4d9c-8d54-c7aa40c2080b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:05.863773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be391eb0-3e0d-4d9c-8d54-c7aa40c2080b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:05.875191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-be391eb0-3e0d-4d9c-8d54-c7aa40c2080b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:05.875191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:05.875191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:05.875191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:05.875191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:05.875191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:05.875191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:05.875191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:05.875191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:05.875191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:05.875191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:05.875191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:05.875191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:05.875191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:05.875191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:05.876245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:05.882014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:05.882014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:05.882014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:05.882014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:05.882014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:05.882014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:05.882014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:05.882014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:05.882014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 304/584] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:05.882014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be391eb0-3e0d-4d9c-8d54-c7aa40c2080b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:05.927601 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 281/585] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:10:05 2022] PUT /identity/v3/projects/718a472b7d564c429849b127a44aaaad/users/47bd08ee89014df281d0c0d5f8f6cabc/roles/118b4b27bab54b429c3a70924d659c72 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:10:05.928432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563098b4-5534-447f-aaf1-e79b7270fdd6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:05.972907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:06.000220 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be391eb0-3e0d-4d9c-8d54-c7aa40c2080b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:06.038920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf35e7f-b5e2-4c37-bb6c-2f50c638822c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:06.039947 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf35e7f-b5e2-4c37-bb6c-2f50c638822c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:06.040179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf35e7f-b5e2-4c37-bb6c-2f50c638822c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:06.040520 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf35e7f-b5e2-4c37-bb6c-2f50c638822c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:06.049535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563098b4-5534-447f-aaf1-e79b7270fdd6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:06.050268 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf35e7f-b5e2-4c37-bb6c-2f50c638822c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:06.051740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf35e7f-b5e2-4c37-bb6c-2f50c638822c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:06.064732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-fdf35e7f-b5e2-4c37-bb6c-2f50c638822c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 23 15:10:06.064732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:06.064732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:06.064732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:06.064732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:06.064732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:06.064732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:06.064732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:06.064732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:06.064732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:06.064732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:06.064732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:06.064732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:06.064732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:06.064732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:06.064732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:06.065794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:06.066768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:06.066768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:06.066768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:06.066768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:06.066768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:06.066768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:06.066768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:06.066768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:06.066768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 23 15:10:06.066768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:06.066768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 305/586] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:10:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:06.066768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf35e7f-b5e2-4c37-bb6c-2f50c638822c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:06.074617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:06.096577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6e17f-8e65-4b78-a2d7-bc15fcc04ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:06.097367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6e17f-8e65-4b78-a2d7-bc15fcc04ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:06.097774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6e17f-8e65-4b78-a2d7-bc15fcc04ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:06.098310 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6e17f-8e65-4b78-a2d7-bc15fcc04ab9 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:06.099519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6e17f-8e65-4b78-a2d7-bc15fcc04ab9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:06.100086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6e17f-8e65-4b78-a2d7-bc15fcc04ab9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:06.101676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6e17f-8e65-4b78-a2d7-bc15fcc04ab9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:06.146927 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 282/587] 10.222.0.82 () {56 vars in 1133 bytes} [Fri Sep 23 15:10:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:06.148006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6e17f-8e65-4b78-a2d7-bc15fcc04ab9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:06.186316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf35e7f-b5e2-4c37-bb6c-2f50c638822c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:06.225402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13361721-ed17-47d6-bc15-0ea2b4f74dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:06.226072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13361721-ed17-47d6-bc15-0ea2b4f74dbf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:06.226350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13361721-ed17-47d6-bc15-0ea2b4f74dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:06.226621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13361721-ed17-47d6-bc15-0ea2b4f74dbf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:06.235814 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13361721-ed17-47d6-bc15-0ea2b4f74dbf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:06.237535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13361721-ed17-47d6-bc15-0ea2b4f74dbf None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:06.240640 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:06.251676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-13361721-ed17-47d6-bc15-0ea2b4f74dbf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 15:10:06.251676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:06.251676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:06.251676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:06.251676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:06.251676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:06.251676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:06.251676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:06.251676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:06.251676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:06.251676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:06.251676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:06.251676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:06.251676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:06.251676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:06.251676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:06.255239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:06.256476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:06.256476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:06.256476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:06.256476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:06.256476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:06.256476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:06.256476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:06.256476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:06.256476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 15:10:06.256476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:06.257250 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6e17f-8e65-4b78-a2d7-bc15fcc04ab9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:06.257356 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 306/588] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:10:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:06.257356 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13361721-ed17-47d6-bc15-0ea2b4f74dbf None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:06.291907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04194e8f-6949-465c-b1d3-a61c6871b1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:06.292614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04194e8f-6949-465c-b1d3-a61c6871b1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:06.292890 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04194e8f-6949-465c-b1d3-a61c6871b1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:06.293161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04194e8f-6949-465c-b1d3-a61c6871b1a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:06.294650 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04194e8f-6949-465c-b1d3-a61c6871b1a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:06.294953 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04194e8f-6949-465c-b1d3-a61c6871b1a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:06.296388 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04194e8f-6949-465c-b1d3-a61c6871b1a4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:06.308012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 283/589] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:06.308752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04194e8f-6949-465c-b1d3-a61c6871b1a4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:06.349340 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:06.375844 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13361721-ed17-47d6-bc15-0ea2b4f74dbf None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:06.412175 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9260e5-53de-45e0-b9b2-13c22a74d3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:06.413041 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9260e5-53de-45e0-b9b2-13c22a74d3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:06.413322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9260e5-53de-45e0-b9b2-13c22a74d3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:06.413603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9260e5-53de-45e0-b9b2-13c22a74d3d6 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:06.414357 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9260e5-53de-45e0-b9b2-13c22a74d3d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:06.414666 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9260e5-53de-45e0-b9b2-13c22a74d3d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:06.416132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9260e5-53de-45e0-b9b2-13c22a74d3d6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:06.426752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04194e8f-6949-465c-b1d3-a61c6871b1a4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:06.442022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 307/590] 10.222.0.82 () {56 vars in 1137 bytes} [Fri Sep 23 15:10:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:06.442917 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9260e5-53de-45e0-b9b2-13c22a74d3d6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:06.461692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae513d3-b3ee-4a89-9127-103bc54b5df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:06.462350 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae513d3-b3ee-4a89-9127-103bc54b5df8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:06.462626 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae513d3-b3ee-4a89-9127-103bc54b5df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:06.462895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae513d3-b3ee-4a89-9127-103bc54b5df8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:06.474445 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae513d3-b3ee-4a89-9127-103bc54b5df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:06.475889 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae513d3-b3ee-4a89-9127-103bc54b5df8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:06.490669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-eae513d3-b3ee-4a89-9127-103bc54b5df8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:06.490669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:06.490669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:06.490669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:06.490669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:06.490669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:06.490669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:06.490669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:06.490669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:06.490669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:06.490669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:06.490669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:06.490669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:06.490669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:06.490669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:06.490669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:06.491852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:06.492931 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:06.492931 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:06.492931 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:06.492931 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 284/591] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:06.497108 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae513d3-b3ee-4a89-9127-103bc54b5df8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:06.509184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:06.553610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9260e5-53de-45e0-b9b2-13c22a74d3d6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:06.590018 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e1d37-5631-4ca0-bad1-30bb2daaff66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:06.591213 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e1d37-5631-4ca0-bad1-30bb2daaff66 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:06.591574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e1d37-5631-4ca0-bad1-30bb2daaff66 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:06.591919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e1d37-5631-4ca0-bad1-30bb2daaff66 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:06.592712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e1d37-5631-4ca0-bad1-30bb2daaff66 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:06.593077 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e1d37-5631-4ca0-bad1-30bb2daaff66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:06.594613 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e1d37-5631-4ca0-bad1-30bb2daaff66 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:06.605327 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:06.617469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 308/592] 10.222.0.82 () {56 vars in 1139 bytes} [Fri Sep 23 15:10:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:06.617469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e1d37-5631-4ca0-bad1-30bb2daaff66 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:06.623138 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae513d3-b3ee-4a89-9127-103bc54b5df8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:06.658914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb08af6-6366-45d5-a827-37624a3f0be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:06.659617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb08af6-6366-45d5-a827-37624a3f0be3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:06.659955 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb08af6-6366-45d5-a827-37624a3f0be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:06.660293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb08af6-6366-45d5-a827-37624a3f0be3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:06.661232 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb08af6-6366-45d5-a827-37624a3f0be3 None admin] RBAC: Adding query filter params (role.id=118b4b27bab54b429c3a70924d659c72, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=b22406c522e149d8bc462ff2feeec44c) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:06.661602 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb08af6-6366-45d5-a827-37624a3f0be3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:06.663168 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb08af6-6366-45d5-a827-37624a3f0be3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:06.669355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 285/593] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:06 2022] GET /identity/v3/role_assignments?user.id=b22406c522e149d8bc462ff2feeec44c&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=118b4b27bab54b429c3a70924d659c72 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:06.669355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb08af6-6366-45d5-a827-37624a3f0be3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:06.736612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e1d37-5631-4ca0-bad1-30bb2daaff66 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:06.756033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:06.785164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb1152-0f7a-42a5-a4e8-ba2ece301a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:06.786232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb1152-0f7a-42a5-a4e8-ba2ece301a16 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:06.786575 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb1152-0f7a-42a5-a4e8-ba2ece301a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:06.787425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb1152-0f7a-42a5-a4e8-ba2ece301a16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:06.803016 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb1152-0f7a-42a5-a4e8-ba2ece301a16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:06.804867 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb1152-0f7a-42a5-a4e8-ba2ece301a16 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:06.809450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb08af6-6366-45d5-a827-37624a3f0be3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:06.825592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-5fdb1152-0f7a-42a5-a4e8-ba2ece301a16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:06.825592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:06.825592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:06.825592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:06.825592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:06.825592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:06.825592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:06.825592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:06.825592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:06.825592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:06.825592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:06.825592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:06.825592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:06.825592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:06.825592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:06.825592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:06.826819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:06.827934 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:06.827934 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:06.827934 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:06.829918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 309/594] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:06.830975 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb1152-0f7a-42a5-a4e8-ba2ece301a16 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:06.860072 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ebb33-6995-43da-9281-88a402ed1bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:06.860607 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ebb33-6995-43da-9281-88a402ed1bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:06.860977 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ebb33-6995-43da-9281-88a402ed1bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:06.861252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ebb33-6995-43da-9281-88a402ed1bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:06.861930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ebb33-6995-43da-9281-88a402ed1bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:06.862233 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ebb33-6995-43da-9281-88a402ed1bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:06.863614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ebb33-6995-43da-9281-88a402ed1bf0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:06.878588 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 286/595] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:06.880758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ebb33-6995-43da-9281-88a402ed1bf0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:06.897762 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:06.945971 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb1152-0f7a-42a5-a4e8-ba2ece301a16 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:06.992315 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e252ad-9767-40ce-a764-634aa8521d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:06.993296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e252ad-9767-40ce-a764-634aa8521d0b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:06.993619 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e252ad-9767-40ce-a764-634aa8521d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:06.994075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e252ad-9767-40ce-a764-634aa8521d0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:07.003077 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ebb33-6995-43da-9281-88a402ed1bf0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:07.012935 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e252ad-9767-40ce-a764-634aa8521d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:07.015183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e252ad-9767-40ce-a764-634aa8521d0b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:07.035664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-f0e252ad-9767-40ce-a764-634aa8521d0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:07.035664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:07.035664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:07.035664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:07.035664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:07.035664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:07.035664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:07.035664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:07.035664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:07.035664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:07.035664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:07.035664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:07.035664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:07.035664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:07.035664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:07.035664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:07.036708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:07.038260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:07.038260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:07.038260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:07.038260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 310/596] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:07.038260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e252ad-9767-40ce-a764-634aa8521d0b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:07.044197 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437eb6d-c4bc-4891-a677-0811976355a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:07.044879 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437eb6d-c4bc-4891-a677-0811976355a4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:07.045230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437eb6d-c4bc-4891-a677-0811976355a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:07.045512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437eb6d-c4bc-4891-a677-0811976355a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:07.046255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437eb6d-c4bc-4891-a677-0811976355a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:07.046615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437eb6d-c4bc-4891-a677-0811976355a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:07.048029 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437eb6d-c4bc-4891-a677-0811976355a4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:07.060959 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 287/597] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:07.062187 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437eb6d-c4bc-4891-a677-0811976355a4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:07.070206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:07.143534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:07.162756 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e252ad-9767-40ce-a764-634aa8521d0b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:07.176519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437eb6d-c4bc-4891-a677-0811976355a4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:07.201105 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37ffad-25d7-4c62-8f9a-6c71323c2b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:07.201785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37ffad-25d7-4c62-8f9a-6c71323c2b09 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:07.202136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37ffad-25d7-4c62-8f9a-6c71323c2b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:07.202382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37ffad-25d7-4c62-8f9a-6c71323c2b09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:07.210799 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37ffad-25d7-4c62-8f9a-6c71323c2b09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:07.212254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37ffad-25d7-4c62-8f9a-6c71323c2b09 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:07.216108 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e8ef7-b34a-45f4-a80e-c1889c3227a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:07.216910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8ef7-b34a-45f4-a80e-c1889c3227a6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:07.217352 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8ef7-b34a-45f4-a80e-c1889c3227a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:07.217844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8ef7-b34a-45f4-a80e-c1889c3227a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:07.218734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e8ef7-b34a-45f4-a80e-c1889c3227a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:07.219186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e8ef7-b34a-45f4-a80e-c1889c3227a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:07.220774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e8ef7-b34a-45f4-a80e-c1889c3227a6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:07.225891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8f37ffad-25d7-4c62-8f9a-6c71323c2b09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:07.225891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:07.225891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:07.225891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:07.225891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:07.225891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:07.225891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:07.225891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:07.225891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:07.225891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:07.225891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:07.225891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:07.225891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:07.225891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:07.225891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:07.226989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:07.227908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:07.227908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:07.227908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:07.227908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:07.227908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:07.227908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:07.227908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:07.227908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:07.227908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 311/598] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:07.228410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37ffad-25d7-4c62-8f9a-6c71323c2b09 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:07.242016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 288/599] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:07.243147 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e8ef7-b34a-45f4-a80e-c1889c3227a6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:07.319465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:07.341676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37ffad-25d7-4c62-8f9a-6c71323c2b09 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:07.349975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e8ef7-b34a-45f4-a80e-c1889c3227a6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:07.381104 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:07.384130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aff8f-3462-4265-ab7a-ba58f8d8db03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:07.384848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aff8f-3462-4265-ab7a-ba58f8d8db03 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:07.385129 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aff8f-3462-4265-ab7a-ba58f8d8db03 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:07.385498 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aff8f-3462-4265-ab7a-ba58f8d8db03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:07.388008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e7912-d49a-41fc-b290-fce150e9925e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:07.392164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e7912-d49a-41fc-b290-fce150e9925e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:07.392164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e7912-d49a-41fc-b290-fce150e9925e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:07.392164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e7912-d49a-41fc-b290-fce150e9925e None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:07.392164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e7912-d49a-41fc-b290-fce150e9925e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:07.392164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e7912-d49a-41fc-b290-fce150e9925e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:07.392164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e7912-d49a-41fc-b290-fce150e9925e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:07.394655 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2aff8f-3462-4265-ab7a-ba58f8d8db03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:07.396590 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2aff8f-3462-4265-ab7a-ba58f8d8db03 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:07.406707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 289/600] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:07.407956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e7912-d49a-41fc-b290-fce150e9925e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:07.410457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ac2aff8f-3462-4265-ab7a-ba58f8d8db03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:07.410457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:07.410457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:07.410457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:07.410457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:07.410457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:07.410457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:07.410457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:07.410457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:07.410457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:07.410457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:07.410457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:07.410457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:07.410457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:07.410457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:07.411346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:07.412248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:07.412248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:07.412248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:07.412248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:07.412248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:07.412248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:07.412248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:07.412248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:07.412248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 312/601] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:07.412739 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aff8f-3462-4265-ab7a-ba58f8d8db03 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:07.523341 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e7912-d49a-41fc-b290-fce150e9925e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:07.546274 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aff8f-3462-4265-ab7a-ba58f8d8db03 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:07.568738 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc7225-8cbc-4082-a71a-36aba8e0ebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:07.569397 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc7225-8cbc-4082-a71a-36aba8e0ebe7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:07.569680 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc7225-8cbc-4082-a71a-36aba8e0ebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:07.569978 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc7225-8cbc-4082-a71a-36aba8e0ebe7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:07.579097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc7225-8cbc-4082-a71a-36aba8e0ebe7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:07.580712 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc7225-8cbc-4082-a71a-36aba8e0ebe7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:07.584301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e3023-9e1d-4bd0-8133-4dab7fb402ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:07.585205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e3023-9e1d-4bd0-8133-4dab7fb402ac None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:07.585685 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e3023-9e1d-4bd0-8133-4dab7fb402ac None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:07.586191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e3023-9e1d-4bd0-8133-4dab7fb402ac None admin] PATH_INFO: `/v3/projects/718a472b7d564c429849b127a44aaaad/users/6dbf682960cc447099c11862afa3206b/roles/118b4b27bab54b429c3a70924d659c72` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:07.594873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0abc7225-8cbc-4082-a71a-36aba8e0ebe7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:07.594873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:07.594873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:07.594873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:07.594873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:07.594873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:07.594873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:07.594873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:07.594873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:07.594873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:07.594873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:07.594873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:07.594873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:07.594873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:07.594873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:07.595776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:07.596677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:07.596677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:07.596677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:07.596677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:07.596677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:07.596677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:07.596677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:07.596677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:07.601334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 290/602] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:07.602387 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc7225-8cbc-4082-a71a-36aba8e0ebe7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:07.604719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:07.610272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e3023-9e1d-4bd0-8133-4dab7fb402ac None admin] RBAC: Authorizing `identity:create_grant(project_id=718a472b7d564c429849b127a44aaaad, user_id=6dbf682960cc447099c11862afa3206b, role_id=118b4b27bab54b429c3a70924d659c72)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:07.612098 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e3023-9e1d-4bd0-8133-4dab7fb402ac None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:07.662648 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:07.714744 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc7225-8cbc-4082-a71a-36aba8e0ebe7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:07.722251 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 313/603] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:10:07 2022] PUT /identity/v3/projects/718a472b7d564c429849b127a44aaaad/users/6dbf682960cc447099c11862afa3206b/roles/118b4b27bab54b429c3a70924d659c72 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:10:07.724115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e3023-9e1d-4bd0-8133-4dab7fb402ac None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:07.783885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f742454-03b2-4847-b23e-73090924d46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:07.784517 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f742454-03b2-4847-b23e-73090924d46d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:07.784800 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f742454-03b2-4847-b23e-73090924d46d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:07.785078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f742454-03b2-4847-b23e-73090924d46d None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:07.787349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f742454-03b2-4847-b23e-73090924d46d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:07.787664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f742454-03b2-4847-b23e-73090924d46d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:07.789164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f742454-03b2-4847-b23e-73090924d46d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:07.811947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 291/604] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:07.818904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f742454-03b2-4847-b23e-73090924d46d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:07.959811 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f742454-03b2-4847-b23e-73090924d46d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:07.975501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e3023-9e1d-4bd0-8133-4dab7fb402ac None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:07.981674 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:08.016647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a4323-6849-4b97-b3bf-2d74252a0603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:08.017714 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a4323-6849-4b97-b3bf-2d74252a0603 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:08.018525 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a4323-6849-4b97-b3bf-2d74252a0603 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:08.019773 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a4323-6849-4b97-b3bf-2d74252a0603 None admin] PATH_INFO: `/v3/projects/718a472b7d564c429849b127a44aaaad/users/1879a3ad7be74303b9feceff75f62979/roles/118b4b27bab54b429c3a70924d659c72` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:08.032576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1d6cc-f4e2-4693-85ad-555398f49a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:08.035522 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1d6cc-f4e2-4693-85ad-555398f49a22 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:08.036074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1d6cc-f4e2-4693-85ad-555398f49a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:08.036610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1d6cc-f4e2-4693-85ad-555398f49a22 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:08.037533 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1d6cc-f4e2-4693-85ad-555398f49a22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:08.039858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1d6cc-f4e2-4693-85ad-555398f49a22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:08.041819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1d6cc-f4e2-4693-85ad-555398f49a22 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:08.055018 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a4323-6849-4b97-b3bf-2d74252a0603 None admin] RBAC: Authorizing `identity:create_grant(project_id=718a472b7d564c429849b127a44aaaad, user_id=1879a3ad7be74303b9feceff75f62979, role_id=118b4b27bab54b429c3a70924d659c72)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:08.056465 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a4323-6849-4b97-b3bf-2d74252a0603 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:08.063105 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 314/605] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:08.070350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1d6cc-f4e2-4693-85ad-555398f49a22 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:08.126914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:08.167329 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 292/606] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:10:07 2022] PUT /identity/v3/projects/718a472b7d564c429849b127a44aaaad/users/1879a3ad7be74303b9feceff75f62979/roles/118b4b27bab54b429c3a70924d659c72 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:10:08.169418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2e09-04e8-4da6-887f-ee55a1abf0d3 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:08.169703 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2e09-04e8-4da6-887f-ee55a1abf0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:08.177797 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2e09-04e8-4da6-887f-ee55a1abf0d3 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:08.179325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 293/607] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:08 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:08.186539 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c78a0-11f2-4363-a9f9-2818db7a4874 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:08.186841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c78a0-11f2-4363-a9f9-2818db7a4874 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:08.187100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c78a0-11f2-4363-a9f9-2818db7a4874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:08.189564 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1d6cc-f4e2-4693-85ad-555398f49a22 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:08.222339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4e5c78a0-11f2-4363-a9f9-2818db7a4874 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:08.223578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4e5c78a0-11f2-4363-a9f9-2818db7a4874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:08.240242 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05f4e5-59aa-4590-9fc5-7ec84246e09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:08.240997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05f4e5-59aa-4590-9fc5-7ec84246e09c None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:08.241285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05f4e5-59aa-4590-9fc5-7ec84246e09c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:08.241558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05f4e5-59aa-4590-9fc5-7ec84246e09c None admin] PATH_INFO: `/v3/projects/718a472b7d564c429849b127a44aaaad/users/defbff3e8f934dab9c800c7207c1d539/roles/118b4b27bab54b429c3a70924d659c72` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:08.283382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05f4e5-59aa-4590-9fc5-7ec84246e09c None admin] RBAC: Authorizing `identity:create_grant(project_id=718a472b7d564c429849b127a44aaaad, user_id=defbff3e8f934dab9c800c7207c1d539, role_id=118b4b27bab54b429c3a70924d659c72)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:08.284898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05f4e5-59aa-4590-9fc5-7ec84246e09c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:08.334397 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 294/608] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:08.380372 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 315/609] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:10:08 2022] PUT /identity/v3/projects/718a472b7d564c429849b127a44aaaad/users/defbff3e8f934dab9c800c7207c1d539/roles/118b4b27bab54b429c3a70924d659c72 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:10:08.620853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c78a0-11f2-4363-a9f9-2818db7a4874 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:08.743860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:08.754372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c78a0-11f2-4363-a9f9-2818db7a4874 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:08.809707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87e851-8e9e-4381-b559-c8e16d147bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:08.810488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87e851-8e9e-4381-b559-c8e16d147bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:08.810782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87e851-8e9e-4381-b559-c8e16d147bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:08.811061 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87e851-8e9e-4381-b559-c8e16d147bd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:08.830689 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87e851-8e9e-4381-b559-c8e16d147bd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:08.838533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-5b87e851-8e9e-4381-b559-c8e16d147bd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:08.838533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:08.838533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:08.838533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:08.838533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:08.838533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:08.838533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:08.838533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:08.838533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:08.838533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:08.838533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:08.838533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:08.838533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:08.838533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:08.838533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:08.838533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:08.839477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:08.839477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:08.839477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:08.839477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:08.839477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:08.839477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:08.839477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:08.839477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:08.839477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:08.839477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:08.839477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:08.839477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:08.839477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:08.839477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:08.839477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:08.839477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:08.840915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:08.840915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:08.840915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:08.840915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:08.840915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:08.840915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:08.840915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:08.840915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:08.840915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:08.840915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:08.840915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:08.840915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:08.840915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 295/610] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:10:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:08.845548 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05f4e5-59aa-4590-9fc5-7ec84246e09c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:08.989273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:08.992514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05f4e5-59aa-4590-9fc5-7ec84246e09c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:09.046522 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa796229-6f02-4d23-a125-a029d79cd494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:09.047174 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa796229-6f02-4d23-a125-a029d79cd494 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:09.047477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa796229-6f02-4d23-a125-a029d79cd494 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:09.047745 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa796229-6f02-4d23-a125-a029d79cd494 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:09.048417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa796229-6f02-4d23-a125-a029d79cd494 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:09.048718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa796229-6f02-4d23-a125-a029d79cd494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:09.050125 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa796229-6f02-4d23-a125-a029d79cd494 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:09.059571 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 316/611] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:10:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:09.065222 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87e851-8e9e-4381-b559-c8e16d147bd8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:09.129323 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c582a09-caff-418f-91af-8bfa3b621f20 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:09.129633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c582a09-caff-418f-91af-8bfa3b621f20 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:09.129903 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c582a09-caff-418f-91af-8bfa3b621f20 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:09.131520 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 317/612] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:09.136958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513b8da-2dc1-4a7b-809b-4b965e56009f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:09.137230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513b8da-2dc1-4a7b-809b-4b965e56009f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:09.137505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513b8da-2dc1-4a7b-809b-4b965e56009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:09.155486 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8513b8da-2dc1-4a7b-809b-4b965e56009f None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:09.158995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8513b8da-2dc1-4a7b-809b-4b965e56009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:09.223000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87e851-8e9e-4381-b559-c8e16d147bd8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:09.285127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 318/613] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:10:09.290574 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdd9b9-0db6-48bf-aa12-fb69c626772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:09.291236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdd9b9-0db6-48bf-aa12-fb69c626772e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:09.291520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdd9b9-0db6-48bf-aa12-fb69c626772e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:09.291793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdd9b9-0db6-48bf-aa12-fb69c626772e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:09.311901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdd9b9-0db6-48bf-aa12-fb69c626772e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:09.313357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdd9b9-0db6-48bf-aa12-fb69c626772e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:09.335075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-d5fdd9b9-0db6-48bf-aa12-fb69c626772e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:09.335075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:09.335075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:09.335075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:09.335075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:09.335075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:09.335075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:09.335075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:09.335075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:09.335075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:09.335075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:09.335075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:09.335075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:09.335075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:09.335075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:09.335075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:09.336089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:09.337624 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:09.337624 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:09.337624 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:09.337624 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 296/614] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:09.342223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513b8da-2dc1-4a7b-809b-4b965e56009f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:09.473678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:09.488745 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513b8da-2dc1-4a7b-809b-4b965e56009f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:09.540026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a725aaa-8094-406d-bee4-79d7e27c1d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:09.541007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725aaa-8094-406d-bee4-79d7e27c1d23 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:09.541480 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725aaa-8094-406d-bee4-79d7e27c1d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:09.541985 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725aaa-8094-406d-bee4-79d7e27c1d23 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:09.542823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a725aaa-8094-406d-bee4-79d7e27c1d23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:09.544214 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a725aaa-8094-406d-bee4-79d7e27c1d23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:09.545789 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a725aaa-8094-406d-bee4-79d7e27c1d23 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:09.562799 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 319/615] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:09.568304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdd9b9-0db6-48bf-aa12-fb69c626772e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:09.575307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:09.711580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdd9b9-0db6-48bf-aa12-fb69c626772e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:09.726672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a725aaa-8094-406d-bee4-79d7e27c1d23 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:09.758172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b47865-6329-4ebc-821d-28ae831b0ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:09.758815 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b47865-6329-4ebc-821d-28ae831b0ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:09.759093 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b47865-6329-4ebc-821d-28ae831b0ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:09.759365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b47865-6329-4ebc-821d-28ae831b0ac2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:09.768170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b47865-6329-4ebc-821d-28ae831b0ac2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:09.769628 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b47865-6329-4ebc-821d-28ae831b0ac2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:09.795671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-b0b47865-6329-4ebc-821d-28ae831b0ac2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 15:10:09.795671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:09.795671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:09.795671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:09.795671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:09.795671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:09.795671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:09.795671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:09.795671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:09.795671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:09.795671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:09.795671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:09.795671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:09.795671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:09.795671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:09.795671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:09.796671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:09.798057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:09.798057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:09.798057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:09.798057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:09.798057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:09.798057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:09.798057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:09.798057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:09.798057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 15:10:09.798057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:09.798057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 297/616] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:10:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:09.808845 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b47865-6329-4ebc-821d-28ae831b0ac2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:09.842094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a725aaa-8094-406d-bee4-79d7e27c1d23 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:09.890371 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523d340-6e6c-45d8-9474-76c6a578c19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:09.891022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523d340-6e6c-45d8-9474-76c6a578c19f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:09.891296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523d340-6e6c-45d8-9474-76c6a578c19f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:09.891563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523d340-6e6c-45d8-9474-76c6a578c19f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:09.914463 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523d340-6e6c-45d8-9474-76c6a578c19f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:09.920033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8523d340-6e6c-45d8-9474-76c6a578c19f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:09.920033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:09.920033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:09.920033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:09.920033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:09.920033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:09.920033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:09.920033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:09.920033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:09.920033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:09.920033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:09.920033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:09.920033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:09.920033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:09.920033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:09.920033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:09.920966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:09.920966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:09.920966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:09.920966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:09.920966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:09.920966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:09.920966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:09.920966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:09.920966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:09.920966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:09.920966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:09.920966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:09.920966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:09.920966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:09.920966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:09.920966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:09.922567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:09.922567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:09.922567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:09.922567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:09.922567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:09.922567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:09.922567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:09.922567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:09.922567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:09.922567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:09.922567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:09.922567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:09.922567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 320/617] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:10:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:09.931236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523d340-6e6c-45d8-9474-76c6a578c19f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:09.938117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:09.961908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:10.002167 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b47865-6329-4ebc-821d-28ae831b0ac2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:10.047942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66403f-1107-49f5-bda7-e58c4c1584fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:10.048559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66403f-1107-49f5-bda7-e58c4c1584fc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:10.048838 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66403f-1107-49f5-bda7-e58c4c1584fc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:10.049109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66403f-1107-49f5-bda7-e58c4c1584fc None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:10.049886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66403f-1107-49f5-bda7-e58c4c1584fc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:10.050193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66403f-1107-49f5-bda7-e58c4c1584fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:10.051747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66403f-1107-49f5-bda7-e58c4c1584fc None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:10.070633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 298/618] 10.222.0.82 () {56 vars in 1137 bytes} [Fri Sep 23 15:10:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:10.077797 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66403f-1107-49f5-bda7-e58c4c1584fc None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:10.147258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523d340-6e6c-45d8-9474-76c6a578c19f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:10.202432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee947432-2eae-42d0-b3d3-ba899d6b44f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:10.203041 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee947432-2eae-42d0-b3d3-ba899d6b44f5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:10.203318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee947432-2eae-42d0-b3d3-ba899d6b44f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:10.203756 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee947432-2eae-42d0-b3d3-ba899d6b44f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:10.204426 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee947432-2eae-42d0-b3d3-ba899d6b44f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:10.204728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee947432-2eae-42d0-b3d3-ba899d6b44f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:10.207765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee947432-2eae-42d0-b3d3-ba899d6b44f5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:10.224692 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 321/619] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:10:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:10.230445 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee947432-2eae-42d0-b3d3-ba899d6b44f5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:10.263949 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66403f-1107-49f5-bda7-e58c4c1584fc None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:10.294127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:10.302233 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c48a4-957b-498f-8c60-01f393d43f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:10.302867 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c48a4-957b-498f-8c60-01f393d43f7f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:10.303192 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c48a4-957b-498f-8c60-01f393d43f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:10.303905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c48a4-957b-498f-8c60-01f393d43f7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:10.386173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c48a4-957b-498f-8c60-01f393d43f7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:10.389148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c48a4-957b-498f-8c60-01f393d43f7f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:10.405759 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:10.454332 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee947432-2eae-42d0-b3d3-ba899d6b44f5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:10.503348 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fdf09-e56a-4b2d-b48f-21082147a344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:10.503988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fdf09-e56a-4b2d-b48f-21082147a344 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:10.504438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fdf09-e56a-4b2d-b48f-21082147a344 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:10.504718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fdf09-e56a-4b2d-b48f-21082147a344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:10.515259 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 299/620] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:10:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:10:10.517058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74cbfa-1cc0-4081-959b-09c62934e5e3 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:10.517548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74cbfa-1cc0-4081-959b-09c62934e5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:10.518194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74cbfa-1cc0-4081-959b-09c62934e5e3 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:10.518303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fdf09-e56a-4b2d-b48f-21082147a344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:10.519874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fdf09-e56a-4b2d-b48f-21082147a344 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:10.520261 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 300/621] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:10.521169 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74cbfa-1cc0-4081-959b-09c62934e5e3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:10.542765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e16fdf09-e56a-4b2d-b48f-21082147a344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:10.542765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:10.542765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:10.542765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:10.542765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:10.542765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:10.542765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:10.542765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:10.542765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:10.542765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:10.542765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:10.542765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:10.542765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:10.542765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:10.542765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:10.542765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:10.544588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:10.545501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:10.545501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:10.545501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:10.545501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 322/622] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:10.550455 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffe9a8-bad6-4b6b-a144-a771c60a9622 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:10.550940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffe9a8-bad6-4b6b-a144-a771c60a9622 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:10.551215 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffe9a8-bad6-4b6b-a144-a771c60a9622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:10.564032 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:10.570233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-84ffe9a8-bad6-4b6b-a144-a771c60a9622 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:10.571497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-84ffe9a8-bad6-4b6b-a144-a771c60a9622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:10.645679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74cbfa-1cc0-4081-959b-09c62934e5e3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:10.665815 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 323/623] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:10.666749 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffe9a8-bad6-4b6b-a144-a771c60a9622 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:10.688362 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0189cc-cf3a-4527-985f-829274964429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:10.689356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0189cc-cf3a-4527-985f-829274964429 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:10.689990 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0189cc-cf3a-4527-985f-829274964429 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:10.690468 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0189cc-cf3a-4527-985f-829274964429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:10.701807 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0189cc-cf3a-4527-985f-829274964429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:10.703912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0189cc-cf3a-4527-985f-829274964429 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:10.721100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0b0189cc-cf3a-4527-985f-829274964429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:10.721100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:10.721100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:10.721100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:10.721100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:10.721100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:10.721100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:10.721100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:10.721100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:10.721100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:10.721100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:10.721100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:10.721100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:10.721100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:10.721100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:10.721100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:10.722427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:10.723359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:10.723359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:10.723359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:10.726087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 301/624] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:10.735011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0189cc-cf3a-4527-985f-829274964429 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:10.781110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:10.844210 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffe9a8-bad6-4b6b-a144-a771c60a9622 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:10.890351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c7acf-3755-4714-8ad8-ff66566fbf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:10.893241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c7acf-3755-4714-8ad8-ff66566fbf3d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:10.893869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c7acf-3755-4714-8ad8-ff66566fbf3d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:10.894352 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c7acf-3755-4714-8ad8-ff66566fbf3d None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:10.896203 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c7acf-3755-4714-8ad8-ff66566fbf3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:10.897352 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c7acf-3755-4714-8ad8-ff66566fbf3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:10.900601 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c7acf-3755-4714-8ad8-ff66566fbf3d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:10.925306 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:10.941549 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 324/625] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:10.942529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c7acf-3755-4714-8ad8-ff66566fbf3d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:10.968375 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0189cc-cf3a-4527-985f-829274964429 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:11.009821 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adae0a-ef8f-4586-bfb1-4bd3f106538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:11.010437 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adae0a-ef8f-4586-bfb1-4bd3f106538d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:11.010723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adae0a-ef8f-4586-bfb1-4bd3f106538d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:11.010986 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adae0a-ef8f-4586-bfb1-4bd3f106538d None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:11.012293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89adae0a-ef8f-4586-bfb1-4bd3f106538d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:11.012597 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89adae0a-ef8f-4586-bfb1-4bd3f106538d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:11.014041 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89adae0a-ef8f-4586-bfb1-4bd3f106538d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:11.025791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 302/626] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:11.026968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09c479-5d8e-461b-bec3-090d478f2759 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:11.027273 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09c479-5d8e-461b-bec3-090d478f2759 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:11.027546 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09c479-5d8e-461b-bec3-090d478f2759 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:11.028841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 303/627] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:11.029526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09c479-5d8e-461b-bec3-090d478f2759 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:11.065429 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c7acf-3755-4714-8ad8-ff66566fbf3d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:11.082664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:11.100463 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720edb2-c475-4d46-bffc-7be6b0a7a3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:11.101090 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720edb2-c475-4d46-bffc-7be6b0a7a3bc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:11.101367 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720edb2-c475-4d46-bffc-7be6b0a7a3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:11.101634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720edb2-c475-4d46-bffc-7be6b0a7a3bc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:11.108920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720edb2-c475-4d46-bffc-7be6b0a7a3bc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:11.110387 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720edb2-c475-4d46-bffc-7be6b0a7a3bc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:11.121667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-5720edb2-c475-4d46-bffc-7be6b0a7a3bc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 15:10:11.121667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:11.121667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:11.121667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:11.121667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:11.121667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:11.121667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:11.121667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:11.121667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:11.121667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:11.121667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:11.121667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:11.121667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:11.121667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:11.121667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:11.121667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:11.122670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:11.123632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:11.123632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:11.123632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:11.123632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:11.123632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:11.123632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:11.123632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:11.123632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:11.123632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 15:10:11.123632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:11.123632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 325/628] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:10:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:11.124242 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ed8a6-1503-4ca4-87de-2b165a4a6b42 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:11.124311 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ed8a6-1503-4ca4-87de-2b165a4a6b42 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:11.124585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ed8a6-1503-4ca4-87de-2b165a4a6b42 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:11.128720 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 326/629] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:11.129421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ed8a6-1503-4ca4-87de-2b165a4a6b42 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:11.138765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09c479-5d8e-461b-bec3-090d478f2759 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:11.172573 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c8310-fa79-48a6-8b22-14d56b3b0174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:11.173201 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c8310-fa79-48a6-8b22-14d56b3b0174 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:11.173477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c8310-fa79-48a6-8b22-14d56b3b0174 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:11.173776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c8310-fa79-48a6-8b22-14d56b3b0174 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:11.175720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:11.184767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c8310-fa79-48a6-8b22-14d56b3b0174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:11.189695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-835c8310-fa79-48a6-8b22-14d56b3b0174 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:11.189695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:11.189695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:11.189695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:11.189695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:11.189695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:11.189695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:11.189695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:11.189695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:11.189695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:11.189695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:11.189695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:11.189695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:11.189695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:11.189695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:11.189695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:11.190733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:11.190733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:11.190733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:11.190733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:11.190733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:11.190733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:11.190733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:11.190733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:11.190733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:11.190733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:11.190733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:11.190733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:11.190733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:11.190733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:11.190733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:11.190733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:11.191575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:11.191575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:11.191575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:11.191575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:11.191575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:11.191575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:11.191575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:11.191575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:11.191575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:11.191575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:11.191575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:11.191575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:11.191575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 304/630] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:10:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:11.193712 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49ce4-c1d2-44a8-82fc-7adbc59c51d9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:11.194184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49ce4-c1d2-44a8-82fc-7adbc59c51d9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:11.194445 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49ce4-c1d2-44a8-82fc-7adbc59c51d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:11.211980 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b1f49ce4-c1d2-44a8-82fc-7adbc59c51d9 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:11.214287 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b1f49ce4-c1d2-44a8-82fc-7adbc59c51d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:11.237184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ed8a6-1503-4ca4-87de-2b165a4a6b42 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:11.271638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbaad6-979c-4db6-82ba-c4dcd1382352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:11.272289 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbaad6-979c-4db6-82ba-c4dcd1382352 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:11.272568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbaad6-979c-4db6-82ba-c4dcd1382352 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:11.272840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbaad6-979c-4db6-82ba-c4dcd1382352 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:11.279896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbaad6-979c-4db6-82ba-c4dcd1382352 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:11.281440 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbaad6-979c-4db6-82ba-c4dcd1382352 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:11.288277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 305/631] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:11.289153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f49ce4-c1d2-44a8-82fc-7adbc59c51d9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:11.293956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-9dbbaad6-979c-4db6-82ba-c4dcd1382352 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:11.293956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:11.293956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:11.293956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:11.293956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:11.293956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:11.293956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:11.293956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:11.293956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:11.293956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:11.293956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:11.293956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:11.293956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:11.293956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:11.293956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:11.294845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:11.296285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:11.296285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:11.296285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:11.296285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:11.296285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:11.296285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:11.296285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:11.296285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:11.296285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 327/632] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:11.296788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8466e5d-9e69-41a3-bbcd-73c118188cd5 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:11.296788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8466e5d-9e69-41a3-bbcd-73c118188cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:11.297105 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8466e5d-9e69-41a3-bbcd-73c118188cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:11.317247 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c8466e5d-9e69-41a3-bbcd-73c118188cd5 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:11.318494 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c8466e5d-9e69-41a3-bbcd-73c118188cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:11.354671 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:11.396898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 328/633] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:11.398182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8466e5d-9e69-41a3-bbcd-73c118188cd5 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:11.419409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f49ce4-c1d2-44a8-82fc-7adbc59c51d9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:11.443780 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:11.455601 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc1d19-0797-4d5b-8100-5ff7d485c2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:11.456445 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1d19-0797-4d5b-8100-5ff7d485c2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:11.456860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1d19-0797-4d5b-8100-5ff7d485c2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:11.457207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1d19-0797-4d5b-8100-5ff7d485c2c0 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:11.458066 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc1d19-0797-4d5b-8100-5ff7d485c2c0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:11.458442 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc1d19-0797-4d5b-8100-5ff7d485c2c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:11.460222 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc1d19-0797-4d5b-8100-5ff7d485c2c0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:11.484798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 306/634] 10.222.0.82 () {56 vars in 1135 bytes} [Fri Sep 23 15:10:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:11.486359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc1d19-0797-4d5b-8100-5ff7d485c2c0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:11.548742 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8466e5d-9e69-41a3-bbcd-73c118188cd5 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:11.592319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b7283-cb48-4d81-abcd-f4ba147d9f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:11.592958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b7283-cb48-4d81-abcd-f4ba147d9f7b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:11.593238 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b7283-cb48-4d81-abcd-f4ba147d9f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:11.593515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b7283-cb48-4d81-abcd-f4ba147d9f7b None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:11.594232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b7283-cb48-4d81-abcd-f4ba147d9f7b None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:11.594537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b7283-cb48-4d81-abcd-f4ba147d9f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:11.594691 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc1d19-0797-4d5b-8100-5ff7d485c2c0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:11.596118 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b7283-cb48-4d81-abcd-f4ba147d9f7b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:11.609157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 329/635] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:10:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:11.609157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b7283-cb48-4d81-abcd-f4ba147d9f7b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:11.633778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3d8b6-a34a-429d-a778-45965793fd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:11.634582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3d8b6-a34a-429d-a778-45965793fd6c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:11.634889 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3d8b6-a34a-429d-a778-45965793fd6c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:11.635168 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3d8b6-a34a-429d-a778-45965793fd6c None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:11.635859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3d8b6-a34a-429d-a778-45965793fd6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:11.636167 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3d8b6-a34a-429d-a778-45965793fd6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:11.638179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3d8b6-a34a-429d-a778-45965793fd6c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:11.640275 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:11.655400 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 307/636] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:11.655400 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3d8b6-a34a-429d-a778-45965793fd6c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:11.700308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:11.723955 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b7283-cb48-4d81-abcd-f4ba147d9f7b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:11.756589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3d8b6-a34a-429d-a778-45965793fd6c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:11.758057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ec91d-4066-4ecf-9d1d-a12bd7af0f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:11.758683 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ec91d-4066-4ecf-9d1d-a12bd7af0f7e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:11.758974 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ec91d-4066-4ecf-9d1d-a12bd7af0f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:11.759245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ec91d-4066-4ecf-9d1d-a12bd7af0f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:11.770639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ec91d-4066-4ecf-9d1d-a12bd7af0f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:11.772119 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ec91d-4066-4ecf-9d1d-a12bd7af0f7e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:11.786096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-812ec91d-4066-4ecf-9d1d-a12bd7af0f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:11.786096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:11.786096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:11.786096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:11.786096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:11.786096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:11.786096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:11.786096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:11.786096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:11.786096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:11.786096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:11.786096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:11.786096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:11.786096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:11.786096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:11.786096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:11.787074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:11.787961 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:11.787961 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:11.787961 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:11.787961 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 330/637] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:11.787961 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ec91d-4066-4ecf-9d1d-a12bd7af0f7e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:11.794605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f1632-887c-4c98-a6e8-5a2d6027cc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:11.795243 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f1632-887c-4c98-a6e8-5a2d6027cc28 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:11.795523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f1632-887c-4c98-a6e8-5a2d6027cc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:11.795794 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f1632-887c-4c98-a6e8-5a2d6027cc28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:11.806134 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f1632-887c-4c98-a6e8-5a2d6027cc28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:11.811817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-184f1632-887c-4c98-a6e8-5a2d6027cc28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:11.811817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:11.811817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:11.811817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:11.811817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:11.811817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:11.811817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:11.811817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:11.811817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:11.811817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:11.811817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:11.811817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:11.811817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:11.811817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:11.811817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:11.811817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:11.812776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:11.812776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:11.812776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:11.812776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:11.812776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:11.812776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:11.812776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:11.812776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:11.812776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:11.812776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:11.812776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:11.812776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:11.812776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:11.812776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:11.812776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:11.812776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:11.813649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:11.813649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:11.813649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:11.813649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:11.813649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:11.813649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:11.813649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:11.813649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:11.813649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:11.813649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:11.813649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:11.813649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:11.813649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 308/638] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:10:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:11.813649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f1632-887c-4c98-a6e8-5a2d6027cc28 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:11.871665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:11.891115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ec91d-4066-4ecf-9d1d-a12bd7af0f7e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:11.914802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f1632-887c-4c98-a6e8-5a2d6027cc28 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:11.916291 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:11.926465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5fed3-0885-4cc3-a191-d10d783562fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:11.927088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5fed3-0885-4cc3-a191-d10d783562fb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:11.927366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5fed3-0885-4cc3-a191-d10d783562fb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:11.927635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5fed3-0885-4cc3-a191-d10d783562fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:11.938882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5fed3-0885-4cc3-a191-d10d783562fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:11.940351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5fed3-0885-4cc3-a191-d10d783562fb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:11.950495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4fa0c-714a-4ca9-afb9-225e155465d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:11.951086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4fa0c-714a-4ca9-afb9-225e155465d4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:11.951361 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4fa0c-714a-4ca9-afb9-225e155465d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:11.951631 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4fa0c-714a-4ca9-afb9-225e155465d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:11.952355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4fa0c-714a-4ca9-afb9-225e155465d4 None admin] RBAC: Adding query filter params (role.id=118b4b27bab54b429c3a70924d659c72, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=47bd08ee89014df281d0c0d5f8f6cabc) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:11.952657 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4fa0c-714a-4ca9-afb9-225e155465d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:11.954090 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4fa0c-714a-4ca9-afb9-225e155465d4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:11.954627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1ae5fed3-0885-4cc3-a191-d10d783562fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:11.954627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:11.954627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:11.954627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:11.954627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:11.954627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:11.954627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:11.954627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:11.954627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:11.954627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:11.954627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:11.954627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:11.954627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:11.954627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:11.954627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:11.954627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:11.955719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:11.956766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:11.956766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:11.956766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:11.956766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 331/639] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:11.956766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5fed3-0885-4cc3-a191-d10d783562fb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:11.967890 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 309/640] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:11 2022] GET /identity/v3/role_assignments?user.id=47bd08ee89014df281d0c0d5f8f6cabc&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=118b4b27bab54b429c3a70924d659c72 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:11.969131 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4fa0c-714a-4ca9-afb9-225e155465d4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:12.075838 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5fed3-0885-4cc3-a191-d10d783562fb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:12.096718 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4fa0c-714a-4ca9-afb9-225e155465d4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:12.111178 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:12.116325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f5acc-3bb7-4056-b4bf-8e90381c29c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:12.119270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f5acc-3bb7-4056-b4bf-8e90381c29c7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:12.119270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f5acc-3bb7-4056-b4bf-8e90381c29c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:12.119270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f5acc-3bb7-4056-b4bf-8e90381c29c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:12.131933 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f5acc-3bb7-4056-b4bf-8e90381c29c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:12.135374 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24386db5-a410-42ee-9924-a619e9269924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:12.136150 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24386db5-a410-42ee-9924-a619e9269924 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:12.136625 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24386db5-a410-42ee-9924-a619e9269924 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:12.136783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-344f5acc-3bb7-4056-b4bf-8e90381c29c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:12.136783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:12.136783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:12.136783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:12.136783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:12.136783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:12.136783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:12.136783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:12.136783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:12.136783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:12.136783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:12.136783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:12.136783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:12.136783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:12.136783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:12.136783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:12.137938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:12.137938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:12.137938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:12.137938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:12.137938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:12.137938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:12.137938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:12.137938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:12.137938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:12.137938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:12.137938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:12.137938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:12.137938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:12.137938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:12.137938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:12.137938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:12.138784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:12.138784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:12.138784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:12.138784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:12.138784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:12.138784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:12.138784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:12.138784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:12.138784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:12.138784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:12.138784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:12.138784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:12.139423 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 332/641] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:10:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:12.139885 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f5acc-3bb7-4056-b4bf-8e90381c29c7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:12.142655 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24386db5-a410-42ee-9924-a619e9269924 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:12.142777 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24386db5-a410-42ee-9924-a619e9269924 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:12.143356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24386db5-a410-42ee-9924-a619e9269924 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:12.144760 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24386db5-a410-42ee-9924-a619e9269924 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:12.158369 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 310/642] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:12.159211 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24386db5-a410-42ee-9924-a619e9269924 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:12.195105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:12.257625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f5acc-3bb7-4056-b4bf-8e90381c29c7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:12.279022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24386db5-a410-42ee-9924-a619e9269924 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:12.292515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f417b3-97a9-46f1-8f38-1bca684c3912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:12.294319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f417b3-97a9-46f1-8f38-1bca684c3912 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:12.294600 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f417b3-97a9-46f1-8f38-1bca684c3912 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:12.294869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f417b3-97a9-46f1-8f38-1bca684c3912 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:12.295512 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f417b3-97a9-46f1-8f38-1bca684c3912 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:12.295810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f417b3-97a9-46f1-8f38-1bca684c3912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:12.297182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f417b3-97a9-46f1-8f38-1bca684c3912 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:12.305234 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 333/643] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:10:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:12.306049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f417b3-97a9-46f1-8f38-1bca684c3912 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:12.320819 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cb91a-a732-445b-9cae-af762643fecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:12.321434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cb91a-a732-445b-9cae-af762643fecb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:12.321714 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cb91a-a732-445b-9cae-af762643fecb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:12.322028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cb91a-a732-445b-9cae-af762643fecb None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:12.322656 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cb91a-a732-445b-9cae-af762643fecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:12.322960 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cb91a-a732-445b-9cae-af762643fecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:12.324547 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cb91a-a732-445b-9cae-af762643fecb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:12.337656 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 311/644] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:12.342679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cb91a-a732-445b-9cae-af762643fecb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:12.366301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:12.412314 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f417b3-97a9-46f1-8f38-1bca684c3912 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:12.435797 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:12.449314 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6baee54-48b7-448c-b80a-a4e2b2d91b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:12.450001 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cb91a-a732-445b-9cae-af762643fecb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:12.450146 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6baee54-48b7-448c-b80a-a4e2b2d91b68 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:12.450324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6baee54-48b7-448c-b80a-a4e2b2d91b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:12.450558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6baee54-48b7-448c-b80a-a4e2b2d91b68 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:12.451218 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6baee54-48b7-448c-b80a-a4e2b2d91b68 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:12.451514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6baee54-48b7-448c-b80a-a4e2b2d91b68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:12.452940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6baee54-48b7-448c-b80a-a4e2b2d91b68 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:12.466184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 334/645] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:10:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:12.466184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6baee54-48b7-448c-b80a-a4e2b2d91b68 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:12.491480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543ffc8-1154-40a5-8664-e6b6f0fa7ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:12.492276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543ffc8-1154-40a5-8664-e6b6f0fa7ced None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:12.492558 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543ffc8-1154-40a5-8664-e6b6f0fa7ced None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:12.492829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543ffc8-1154-40a5-8664-e6b6f0fa7ced None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:12.500645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543ffc8-1154-40a5-8664-e6b6f0fa7ced None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:12.502186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543ffc8-1154-40a5-8664-e6b6f0fa7ced None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:12.514051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-f543ffc8-1154-40a5-8664-e6b6f0fa7ced None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:12.514051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:12.514051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:12.514051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:12.514051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:12.514051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:12.514051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:12.514051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:12.514051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:12.514051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:12.514051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:12.514051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:12.514051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:12.514051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:12.514051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:12.515207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:12.516540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:12.516540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:12.516540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:12.516540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:12.516540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:12.516540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:12.516540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:12.516540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:12.519981 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 312/646] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:12.520875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543ffc8-1154-40a5-8664-e6b6f0fa7ced None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:12.578662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6baee54-48b7-448c-b80a-a4e2b2d91b68 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:12.596290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:12.614532 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f9872-8708-465f-930e-ecc5d7f0652d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:12.615155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f9872-8708-465f-930e-ecc5d7f0652d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:12.615434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f9872-8708-465f-930e-ecc5d7f0652d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:12.615700 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f9872-8708-465f-930e-ecc5d7f0652d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:12.625969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543ffc8-1154-40a5-8664-e6b6f0fa7ced None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:12.626232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f9872-8708-465f-930e-ecc5d7f0652d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:12.627675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f9872-8708-465f-930e-ecc5d7f0652d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:12.643362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-851f9872-8708-465f-930e-ecc5d7f0652d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:12.643362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:12.643362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:12.643362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:12.643362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:12.643362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:12.643362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:12.643362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:12.643362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:12.643362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:12.643362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:12.643362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:12.643362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:12.643362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:12.643362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:12.643362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:12.644392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:12.645291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:12.645291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:12.645291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:12.649118 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 335/647] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:12.649849 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f9872-8708-465f-930e-ecc5d7f0652d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:12.663810 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448c98f-4f81-4e3e-8bbc-4b195de6489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:12.664323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448c98f-4f81-4e3e-8bbc-4b195de6489d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:12.664602 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448c98f-4f81-4e3e-8bbc-4b195de6489d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:12.664867 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448c98f-4f81-4e3e-8bbc-4b195de6489d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:12.673459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448c98f-4f81-4e3e-8bbc-4b195de6489d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:12.674926 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448c98f-4f81-4e3e-8bbc-4b195de6489d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:12.689848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-9448c98f-4f81-4e3e-8bbc-4b195de6489d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:10:12.689848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:12.689848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:12.689848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:12.689848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:12.689848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:12.689848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:12.689848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:12.689848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:12.689848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:12.689848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:12.689848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:12.689848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:12.689848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:12.689848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:12.689848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:12.690858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:12.696832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:12.696832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:12.696832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:12.696832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:12.696832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:12.696832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:12.696832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:12.696832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:12.696832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:10:12.696832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:12.696832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 313/648] 10.222.0.82 () {56 vars in 1093 bytes} [Fri Sep 23 15:10:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:12.696832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448c98f-4f81-4e3e-8bbc-4b195de6489d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:12.708543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:12.757297 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f9872-8708-465f-930e-ecc5d7f0652d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:12.793885 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b49f5-5b20-45b0-972f-b671faf3625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:12.794516 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b49f5-5b20-45b0-972f-b671faf3625f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:12.794826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b49f5-5b20-45b0-972f-b671faf3625f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:12.795191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b49f5-5b20-45b0-972f-b671faf3625f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:12.805790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b49f5-5b20-45b0-972f-b671faf3625f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:12.807346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b49f5-5b20-45b0-972f-b671faf3625f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:12.815444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448c98f-4f81-4e3e-8bbc-4b195de6489d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:12.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-3b7b49f5-5b20-45b0-972f-b671faf3625f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:12.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:12.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:12.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:12.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:12.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:12.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:12.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:12.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:12.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:12.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:12.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:12.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:12.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:12.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:12.821157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:12.822165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:12.828572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:12.828572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:12.828572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:12.828572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 336/649] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:12.828572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b49f5-5b20-45b0-972f-b671faf3625f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:12.846740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:12.860849 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3441b5-1a6b-4405-ac36-cfa0012ce290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:12.861448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3441b5-1a6b-4405-ac36-cfa0012ce290 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:12.861723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3441b5-1a6b-4405-ac36-cfa0012ce290 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:12.862018 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3441b5-1a6b-4405-ac36-cfa0012ce290 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:12.862705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3441b5-1a6b-4405-ac36-cfa0012ce290 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:12.863003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3441b5-1a6b-4405-ac36-cfa0012ce290 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:12.864427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3441b5-1a6b-4405-ac36-cfa0012ce290 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:12.880399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 314/650] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:12.881463 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3441b5-1a6b-4405-ac36-cfa0012ce290 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:12.942383 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b49f5-5b20-45b0-972f-b671faf3625f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:12.959734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:12.988861 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96847f5a-84d1-4d78-9ce9-8985a7e45f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:12.988861 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96847f5a-84d1-4d78-9ce9-8985a7e45f79 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:12.988861 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96847f5a-84d1-4d78-9ce9-8985a7e45f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:12.988861 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96847f5a-84d1-4d78-9ce9-8985a7e45f79 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:12.989329 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96847f5a-84d1-4d78-9ce9-8985a7e45f79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:12.989636 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96847f5a-84d1-4d78-9ce9-8985a7e45f79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:12.991060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96847f5a-84d1-4d78-9ce9-8985a7e45f79 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:13.008249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 337/651] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:13.008249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96847f5a-84d1-4d78-9ce9-8985a7e45f79 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:13.015169 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3441b5-1a6b-4405-ac36-cfa0012ce290 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:13.053390 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fc052-6316-4d06-b19a-eb988ac3351d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:13.053763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fc052-6316-4d06-b19a-eb988ac3351d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:13.054040 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fc052-6316-4d06-b19a-eb988ac3351d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:13.054309 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fc052-6316-4d06-b19a-eb988ac3351d None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:13.055022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fc052-6316-4d06-b19a-eb988ac3351d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:13.055322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fc052-6316-4d06-b19a-eb988ac3351d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:13.056766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fc052-6316-4d06-b19a-eb988ac3351d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:13.075610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 315/652] 10.222.0.82 () {56 vars in 1133 bytes} [Fri Sep 23 15:10:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:13.076290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fc052-6316-4d06-b19a-eb988ac3351d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:13.100175 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:13.120085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96847f5a-84d1-4d78-9ce9-8985a7e45f79 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:13.156063 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a32ba8-082b-4dd3-a1b9-fe8f881afb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:13.156676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a32ba8-082b-4dd3-a1b9-fe8f881afb67 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:13.156951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a32ba8-082b-4dd3-a1b9-fe8f881afb67 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:13.157219 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a32ba8-082b-4dd3-a1b9-fe8f881afb67 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:13.157895 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a32ba8-082b-4dd3-a1b9-fe8f881afb67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:13.158201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a32ba8-082b-4dd3-a1b9-fe8f881afb67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:13.159589 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a32ba8-082b-4dd3-a1b9-fe8f881afb67 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:13.171265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 338/653] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:13.172065 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a32ba8-082b-4dd3-a1b9-fe8f881afb67 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:13.191944 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fc052-6316-4d06-b19a-eb988ac3351d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:13.218611 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:13.230905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e752ae-e592-4b9f-8ff7-6de09805e756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:13.231571 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e752ae-e592-4b9f-8ff7-6de09805e756 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:13.231852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e752ae-e592-4b9f-8ff7-6de09805e756 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:13.232126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e752ae-e592-4b9f-8ff7-6de09805e756 None admin] PATH_INFO: `/v3/projects/718a472b7d564c429849b127a44aaaad/users/b22406c522e149d8bc462ff2feeec44c/roles/118b4b27bab54b429c3a70924d659c72` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:13.247394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e752ae-e592-4b9f-8ff7-6de09805e756 None admin] RBAC: Authorizing `identity:create_grant(project_id=718a472b7d564c429849b127a44aaaad, user_id=b22406c522e149d8bc462ff2feeec44c, role_id=118b4b27bab54b429c3a70924d659c72)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:13.248831 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e752ae-e592-4b9f-8ff7-6de09805e756 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:13.280443 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a32ba8-082b-4dd3-a1b9-fe8f881afb67 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:13.315161 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ae928-99fe-4b6c-88d3-eec0248b4220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:13.315791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ae928-99fe-4b6c-88d3-eec0248b4220 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:13.316073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ae928-99fe-4b6c-88d3-eec0248b4220 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:13.316346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ae928-99fe-4b6c-88d3-eec0248b4220 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:13.324940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ae928-99fe-4b6c-88d3-eec0248b4220 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:13.326527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ae928-99fe-4b6c-88d3-eec0248b4220 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:13.329268 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:13.341392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 316/654] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:10:13 2022] PUT /identity/v3/projects/718a472b7d564c429849b127a44aaaad/users/b22406c522e149d8bc462ff2feeec44c/roles/118b4b27bab54b429c3a70924d659c72 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:10:13.341392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e752ae-e592-4b9f-8ff7-6de09805e756 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:13.342022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-9d7ae928-99fe-4b6c-88d3-eec0248b4220 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 15:10:13.342022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:13.342022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:13.342022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:13.342022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:13.342022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:13.342022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:13.342022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:13.342022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:13.342022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:13.342022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:13.342022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:13.342022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:13.342022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:13.342022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:13.342022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:13.343095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:13.344258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:13.344258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:13.344258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:13.344258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:13.344258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:13.344258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:13.344258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:13.344258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:13.344258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 15:10:13.344258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:13.344258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 339/655] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:10:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:13.344258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ae928-99fe-4b6c-88d3-eec0248b4220 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:13.472993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ae928-99fe-4b6c-88d3-eec0248b4220 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:13.500737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e752ae-e592-4b9f-8ff7-6de09805e756 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:13.531491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7570604-df2b-4db7-85be-3ad5a205acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:13.532137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7570604-df2b-4db7-85be-3ad5a205acc8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:13.532473 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7570604-df2b-4db7-85be-3ad5a205acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:13.532742 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7570604-df2b-4db7-85be-3ad5a205acc8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:13.545371 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7570604-df2b-4db7-85be-3ad5a205acc8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:13.547926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7570604-df2b-4db7-85be-3ad5a205acc8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:13.550987 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf65c3-9bb2-4afa-ace1-50cae517a547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:13.552139 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf65c3-9bb2-4afa-ace1-50cae517a547 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:13.552420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf65c3-9bb2-4afa-ace1-50cae517a547 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:13.552695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf65c3-9bb2-4afa-ace1-50cae517a547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:13.562067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d7570604-df2b-4db7-85be-3ad5a205acc8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 23 15:10:13.562067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:13.562067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:13.562067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:13.562067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:13.562067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:13.562067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:13.562067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:13.562067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:13.562067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:13.562067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:13.562067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:13.562067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:13.562067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:13.562067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:13.562067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:13.563068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:13.564432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:13.564432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:13.564432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:13.564432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:13.564432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:13.564432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:13.564432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:13.564432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:13.564432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 23 15:10:13.564432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:13.564432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 340/656] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:10:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:13.565351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7570604-df2b-4db7-85be-3ad5a205acc8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:13.608895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:13.637888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf65c3-9bb2-4afa-ace1-50cae517a547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:13.638624 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:13.640909 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf65c3-9bb2-4afa-ace1-50cae517a547 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:13.689654 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7570604-df2b-4db7-85be-3ad5a205acc8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:13.734561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031501dd-01a5-404a-9a4b-05aab333f335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:13.735096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031501dd-01a5-404a-9a4b-05aab333f335 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:13.735372 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031501dd-01a5-404a-9a4b-05aab333f335 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:13.735643 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031501dd-01a5-404a-9a4b-05aab333f335 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:13.736546 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031501dd-01a5-404a-9a4b-05aab333f335 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:13.736853 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031501dd-01a5-404a-9a4b-05aab333f335 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:13.739053 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031501dd-01a5-404a-9a4b-05aab333f335 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:13.768156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 317/658] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:10:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:10:13.768156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf65c3-9bb2-4afa-ace1-50cae517a547 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:13.768635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 341/658] 10.222.0.82 () {56 vars in 1139 bytes} [Fri Sep 23 15:10:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:13.770400 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031501dd-01a5-404a-9a4b-05aab333f335 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:13.854333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:13.880173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf65c3-9bb2-4afa-ace1-50cae517a547 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:13.910801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031501dd-01a5-404a-9a4b-05aab333f335 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:13.917289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2882ea-349b-4e93-bc55-ff24099d7498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:13.918731 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2882ea-349b-4e93-bc55-ff24099d7498 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:13.919012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2882ea-349b-4e93-bc55-ff24099d7498 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:13.919286 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2882ea-349b-4e93-bc55-ff24099d7498 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:13.920239 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2882ea-349b-4e93-bc55-ff24099d7498 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:13.921089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2882ea-349b-4e93-bc55-ff24099d7498 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:13.922943 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2882ea-349b-4e93-bc55-ff24099d7498 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:13.939227 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:13.946474 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 318/659] 10.222.0.82 () {56 vars in 1137 bytes} [Fri Sep 23 15:10:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:13.947410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2882ea-349b-4e93-bc55-ff24099d7498 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:13.966151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02a589-5a54-4d33-b701-43698472896c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:13.966814 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02a589-5a54-4d33-b701-43698472896c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:13.967122 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02a589-5a54-4d33-b701-43698472896c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:13.970328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02a589-5a54-4d33-b701-43698472896c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:14.047920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02a589-5a54-4d33-b701-43698472896c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:14.049393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02a589-5a54-4d33-b701-43698472896c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:14.063957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2882ea-349b-4e93-bc55-ff24099d7498 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:14.096790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:14.102280 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bd52f-9d1c-4fea-9390-51e805c6d0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:14.103062 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bd52f-9d1c-4fea-9390-51e805c6d0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:14.103388 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bd52f-9d1c-4fea-9390-51e805c6d0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:14.103667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bd52f-9d1c-4fea-9390-51e805c6d0f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:14.118583 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bd52f-9d1c-4fea-9390-51e805c6d0f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:14.120451 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bd52f-9d1c-4fea-9390-51e805c6d0f0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:14.137614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-567bd52f-9d1c-4fea-9390-51e805c6d0f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:14.137614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:14.137614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:14.137614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:14.137614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:14.137614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:14.137614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:14.137614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:14.137614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:14.137614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:14.137614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:14.137614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:14.137614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:14.137614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:14.137614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:14.137614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:14.138847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:14.139970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:14.139970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:14.139970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:14.143473 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 319/660] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:14.144639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bd52f-9d1c-4fea-9390-51e805c6d0f0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:14.167059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 342/661] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:10:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:10:14.169087 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02a589-5a54-4d33-b701-43698472896c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:14.189037 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:14.260831 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bd52f-9d1c-4fea-9390-51e805c6d0f0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:14.273603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02a589-5a54-4d33-b701-43698472896c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:14.300170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5508c57-d63a-426e-9144-cf1629dfe21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:14.300707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5508c57-d63a-426e-9144-cf1629dfe21f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:14.300990 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5508c57-d63a-426e-9144-cf1629dfe21f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:14.301306 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5508c57-d63a-426e-9144-cf1629dfe21f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:14.309700 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb1ae6-cddf-42f3-b55d-b421e3e85d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:14.310744 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb1ae6-cddf-42f3-b55d-b421e3e85d9a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:14.311026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb1ae6-cddf-42f3-b55d-b421e3e85d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:14.311298 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb1ae6-cddf-42f3-b55d-b421e3e85d9a None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:14.311941 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb1ae6-cddf-42f3-b55d-b421e3e85d9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:14.312241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb1ae6-cddf-42f3-b55d-b421e3e85d9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:14.314351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb1ae6-cddf-42f3-b55d-b421e3e85d9a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:14.331276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 343/662] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:14.331276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd11614-1207-43be-b1e8-5bc627535e7a None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:14.331276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd11614-1207-43be-b1e8-5bc627535e7a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:14.331276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd11614-1207-43be-b1e8-5bc627535e7a None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:14.334127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 344/663] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:14.335080 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd11614-1207-43be-b1e8-5bc627535e7a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:14.367039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:14.385481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5508c57-d63a-426e-9144-cf1629dfe21f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:14.387592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5508c57-d63a-426e-9144-cf1629dfe21f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:14.418124 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:14.439540 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd11614-1207-43be-b1e8-5bc627535e7a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:14.474074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d84d2-26a8-4aca-b1cb-429e9cc9ad36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:14.474847 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d84d2-26a8-4aca-b1cb-429e9cc9ad36 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:14.475218 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d84d2-26a8-4aca-b1cb-429e9cc9ad36 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:14.475587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d84d2-26a8-4aca-b1cb-429e9cc9ad36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:14.486678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d84d2-26a8-4aca-b1cb-429e9cc9ad36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:14.488168 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d84d2-26a8-4aca-b1cb-429e9cc9ad36 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:14.502419 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 320/664] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:10:14.502419 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5508c57-d63a-426e-9144-cf1629dfe21f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:14.510010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-6f2d84d2-26a8-4aca-b1cb-429e9cc9ad36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:14.510010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:14.510010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:14.510010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:14.510010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:14.510010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:14.510010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:14.510010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:14.510010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:14.510010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:14.510010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:14.510010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:14.510010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:14.510010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:14.510010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:14.510010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:14.511179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:14.512613 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:14.512613 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:14.512613 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:14.512613 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 345/665] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:14.512861 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdf8f6-b57a-44dc-b4cb-809764d575ea None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:14.513120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdf8f6-b57a-44dc-b4cb-809764d575ea None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:14.513511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdf8f6-b57a-44dc-b4cb-809764d575ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:14.532680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fcbdf8f6-b57a-44dc-b4cb-809764d575ea None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:14.533933 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fcbdf8f6-b57a-44dc-b4cb-809764d575ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:14.591413 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:14.609413 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5508c57-d63a-426e-9144-cf1629dfe21f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:14.621547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 346/666] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:14.621547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdf8f6-b57a-44dc-b4cb-809764d575ea None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:14.650284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f840e-77bf-4f53-84ef-777f9072bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:14.651231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f840e-77bf-4f53-84ef-777f9072bfda None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:14.651663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f840e-77bf-4f53-84ef-777f9072bfda None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:14.652719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f840e-77bf-4f53-84ef-777f9072bfda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:14.664357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f840e-77bf-4f53-84ef-777f9072bfda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:14.665860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f840e-77bf-4f53-84ef-777f9072bfda None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:14.677983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-974f840e-77bf-4f53-84ef-777f9072bfda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:14.677983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:14.677983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:14.677983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:14.677983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:14.677983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:14.677983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:14.677983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:14.677983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:14.677983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:14.677983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:14.677983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:14.677983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:14.677983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:14.677983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:14.678888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:14.679782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:14.679782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:14.679782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:14.679782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:14.679782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:14.679782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:14.679782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:14.679782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:14.684349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 321/667] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:14.685262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f840e-77bf-4f53-84ef-777f9072bfda None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:14.702143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:14.747424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdf8f6-b57a-44dc-b4cb-809764d575ea None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:14.792172 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d43d7a-de3a-463a-bcdf-0dd5649eb81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:14.793087 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d43d7a-de3a-463a-bcdf-0dd5649eb81d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:14.793362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d43d7a-de3a-463a-bcdf-0dd5649eb81d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:14.793632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d43d7a-de3a-463a-bcdf-0dd5649eb81d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:14.803946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d43d7a-de3a-463a-bcdf-0dd5649eb81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:14.805509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d43d7a-de3a-463a-bcdf-0dd5649eb81d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:14.807836 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f840e-77bf-4f53-84ef-777f9072bfda None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:14.821273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-a2d43d7a-de3a-463a-bcdf-0dd5649eb81d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:14.821273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:14.821273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:14.821273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:14.821273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:14.821273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:14.821273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:14.821273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:14.821273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:14.821273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:14.821273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:14.821273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:14.821273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:14.821273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:14.821273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:14.821273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:14.822425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:14.823533 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:14.823533 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:14.823533 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:14.829755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 347/668] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:14.829755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d43d7a-de3a-463a-bcdf-0dd5649eb81d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:14.850460 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b531c4-7744-4e23-881c-f8c812fcaa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:14.851241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b531c4-7744-4e23-881c-f8c812fcaa6e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:14.851621 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b531c4-7744-4e23-881c-f8c812fcaa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:14.851993 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b531c4-7744-4e23-881c-f8c812fcaa6e None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:14.852738 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b531c4-7744-4e23-881c-f8c812fcaa6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:14.853145 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b531c4-7744-4e23-881c-f8c812fcaa6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:14.855638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b531c4-7744-4e23-881c-f8c812fcaa6e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:14.869858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 322/669] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:14.871356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b531c4-7744-4e23-881c-f8c812fcaa6e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:14.875193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:14.934685 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d43d7a-de3a-463a-bcdf-0dd5649eb81d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:14.947994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:14.974871 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517898f-e9c6-4d0f-b413-bdcb54745540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:14.975483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517898f-e9c6-4d0f-b413-bdcb54745540 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:14.975762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517898f-e9c6-4d0f-b413-bdcb54745540 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:14.976030 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517898f-e9c6-4d0f-b413-bdcb54745540 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:14.976720 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517898f-e9c6-4d0f-b413-bdcb54745540 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:14.977013 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517898f-e9c6-4d0f-b413-bdcb54745540 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:14.978467 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517898f-e9c6-4d0f-b413-bdcb54745540 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:14.990518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 348/670] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:14.991752 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517898f-e9c6-4d0f-b413-bdcb54745540 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:14.995071 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b531c4-7744-4e23-881c-f8c812fcaa6e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:15.034342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1d390-4bde-4c43-bf0b-b15baa39bd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:15.034947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1d390-4bde-4c43-bf0b-b15baa39bd4e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:15.035222 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1d390-4bde-4c43-bf0b-b15baa39bd4e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:15.035492 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1d390-4bde-4c43-bf0b-b15baa39bd4e None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:15.036136 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1d390-4bde-4c43-bf0b-b15baa39bd4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:15.036437 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1d390-4bde-4c43-bf0b-b15baa39bd4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:15.038250 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1d390-4bde-4c43-bf0b-b15baa39bd4e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:15.051528 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 323/671] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:15.052345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1d390-4bde-4c43-bf0b-b15baa39bd4e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:15.102778 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517898f-e9c6-4d0f-b413-bdcb54745540 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:15.121872 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:15.139622 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb12f32-cf0a-47a7-b65b-b677253dce86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:15.140367 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb12f32-cf0a-47a7-b65b-b677253dce86 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:15.140655 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb12f32-cf0a-47a7-b65b-b677253dce86 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:15.140929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb12f32-cf0a-47a7-b65b-b677253dce86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:15.148055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb12f32-cf0a-47a7-b65b-b677253dce86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:15.149501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb12f32-cf0a-47a7-b65b-b677253dce86 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:15.160623 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1d390-4bde-4c43-bf0b-b15baa39bd4e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:15.161662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-eeb12f32-cf0a-47a7-b65b-b677253dce86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:15.161662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:15.161662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:15.161662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:15.161662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:15.161662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:15.161662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:15.161662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:15.161662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:15.161662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:15.161662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:15.161662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:15.161662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:15.161662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:15.161662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:15.162694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:15.164163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:15.164163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:15.164163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:15.164163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:15.164163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:15.164163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:15.164163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:15.164163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:15.164163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 349/672] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:15.164163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb12f32-cf0a-47a7-b65b-b677253dce86 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:15.198047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:15.205255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3687ce3-97ad-45ba-9cb6-8fd0ccbf23f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:15.205952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3687ce3-97ad-45ba-9cb6-8fd0ccbf23f3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:15.206230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3687ce3-97ad-45ba-9cb6-8fd0ccbf23f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:15.206508 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3687ce3-97ad-45ba-9cb6-8fd0ccbf23f3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:15.207095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3687ce3-97ad-45ba-9cb6-8fd0ccbf23f3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:15.208475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3687ce3-97ad-45ba-9cb6-8fd0ccbf23f3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a3687ce3-97ad-45ba-9cb6-8fd0ccbf23f3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:15.220111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:15.221393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:15.221393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:15.221393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:15.221393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:15.221393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:15.221393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:15.221393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:15.221393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:15.221393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:15.221393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:15.221393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:15.221393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:15.221393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:15.221393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:15.221393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:15.221393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:15.222801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:15.222801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:15.222801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:15.222801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:15.222801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:15.222801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:15.222801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:15.222801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:15.222801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:15.222801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:15.222801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:15.222801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:15.222801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:10:15.222801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:15.222801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 324/673] 10.222.0.82 () {56 vars in 1129 bytes} [Fri Sep 23 15:10:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:15.223692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3687ce3-97ad-45ba-9cb6-8fd0ccbf23f3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:15.274539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb12f32-cf0a-47a7-b65b-b677253dce86 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:15.312628 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f9278-f779-4f65-ae45-7bcf499c42e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:15.314137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9278-f779-4f65-ae45-7bcf499c42e7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:15.314633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9278-f779-4f65-ae45-7bcf499c42e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:15.315109 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9278-f779-4f65-ae45-7bcf499c42e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:15.316057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f9278-f779-4f65-ae45-7bcf499c42e7 None admin] RBAC: Adding query filter params (role.id=118b4b27bab54b429c3a70924d659c72, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=6dbf682960cc447099c11862afa3206b) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:15.316568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f9278-f779-4f65-ae45-7bcf499c42e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:15.318362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f9278-f779-4f65-ae45-7bcf499c42e7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:15.324983 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 350/674] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:15 2022] GET /identity/v3/role_assignments?user.id=6dbf682960cc447099c11862afa3206b&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=118b4b27bab54b429c3a70924d659c72 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:15.326034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f9278-f779-4f65-ae45-7bcf499c42e7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:15.341838 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3687ce3-97ad-45ba-9cb6-8fd0ccbf23f3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:15.374913 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:15.386742 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ff180-52ca-4a21-b723-57051336c9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:15.387661 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ff180-52ca-4a21-b723-57051336c9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:15.388090 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ff180-52ca-4a21-b723-57051336c9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:15.388512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ff180-52ca-4a21-b723-57051336c9f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:15.396548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ff180-52ca-4a21-b723-57051336c9f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:15.398052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ff180-52ca-4a21-b723-57051336c9f6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:15.412928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e84ff180-52ca-4a21-b723-57051336c9f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:15.412928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:15.412928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:15.412928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:15.412928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:15.412928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:15.412928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:15.412928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:15.412928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:15.412928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:15.412928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:15.412928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:15.412928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:15.412928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:15.412928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:15.414213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:15.415619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:15.415619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:15.415619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:15.415619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:15.415619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:15.415619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:15.415619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:15.415619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:15.415619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 325/675] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:15.415619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ff180-52ca-4a21-b723-57051336c9f6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:15.457250 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:15.465800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f9278-f779-4f65-ae45-7bcf499c42e7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:15.504890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b64b1-264a-4d5a-91a4-856570c2fa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:15.505955 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b64b1-264a-4d5a-91a4-856570c2fa9f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:15.506802 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b64b1-264a-4d5a-91a4-856570c2fa9f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:15.507225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b64b1-264a-4d5a-91a4-856570c2fa9f None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:15.508233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b64b1-264a-4d5a-91a4-856570c2fa9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:15.508894 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b64b1-264a-4d5a-91a4-856570c2fa9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:15.511200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b64b1-264a-4d5a-91a4-856570c2fa9f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:15.530134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 351/676] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:15.531566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b64b1-264a-4d5a-91a4-856570c2fa9f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:15.555237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ff180-52ca-4a21-b723-57051336c9f6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:15.607172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c693b5-172f-4fc6-94e3-a17023646234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:15.608050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c693b5-172f-4fc6-94e3-a17023646234 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:15.608490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c693b5-172f-4fc6-94e3-a17023646234 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:15.608904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c693b5-172f-4fc6-94e3-a17023646234 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:15.609696 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c693b5-172f-4fc6-94e3-a17023646234 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:15.610474 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c693b5-172f-4fc6-94e3-a17023646234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:15.611925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c693b5-172f-4fc6-94e3-a17023646234 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:15.620144 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 326/677] 10.222.0.82 () {56 vars in 1124 bytes} [Fri Sep 23 15:10:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:15.621258 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c693b5-172f-4fc6-94e3-a17023646234 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:15.662025 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b64b1-264a-4d5a-91a4-856570c2fa9f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:15.687102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:15.701234 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb986d6d-4181-4885-9409-f0838e1c8aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:15.702139 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb986d6d-4181-4885-9409-f0838e1c8aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:15.702451 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb986d6d-4181-4885-9409-f0838e1c8aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:15.702745 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb986d6d-4181-4885-9409-f0838e1c8aa5 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:15.703607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb986d6d-4181-4885-9409-f0838e1c8aa5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:15.704777 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb986d6d-4181-4885-9409-f0838e1c8aa5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:15.706275 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb986d6d-4181-4885-9409-f0838e1c8aa5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:15.719886 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 352/678] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:15.720734 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb986d6d-4181-4885-9409-f0838e1c8aa5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:15.740452 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:15.745698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c693b5-172f-4fc6-94e3-a17023646234 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:15.786248 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab83ca1-3a61-4f73-ad41-02753287499c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:15.786851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab83ca1-3a61-4f73-ad41-02753287499c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:15.787123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab83ca1-3a61-4f73-ad41-02753287499c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:15.787392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab83ca1-3a61-4f73-ad41-02753287499c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:15.788192 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab83ca1-3a61-4f73-ad41-02753287499c None admin] RBAC: Adding query filter params (role.id=118b4b27bab54b429c3a70924d659c72, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=defbff3e8f934dab9c800c7207c1d539) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:15.788499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab83ca1-3a61-4f73-ad41-02753287499c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:15.789948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab83ca1-3a61-4f73-ad41-02753287499c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:15.797265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 327/679] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:15 2022] GET /identity/v3/role_assignments?user.id=defbff3e8f934dab9c800c7207c1d539&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=118b4b27bab54b429c3a70924d659c72 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:15.798471 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007185b-f5da-4840-909a-993dd4db5ffc None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:15.798752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007185b-f5da-4840-909a-993dd4db5ffc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:15.799023 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007185b-f5da-4840-909a-993dd4db5ffc None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:15.800478 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 328/680] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:15.805512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007185b-f5da-4840-909a-993dd4db5ffc None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:15.841601 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb986d6d-4181-4885-9409-f0838e1c8aa5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:15.880647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653d891-b3fe-4f5e-a4af-0730d37dd4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:15.881635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653d891-b3fe-4f5e-a4af-0730d37dd4cf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:15.882164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653d891-b3fe-4f5e-a4af-0730d37dd4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:15.882722 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653d891-b3fe-4f5e-a4af-0730d37dd4cf None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:15.883708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653d891-b3fe-4f5e-a4af-0730d37dd4cf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:15.884194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653d891-b3fe-4f5e-a4af-0730d37dd4cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:15.885998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653d891-b3fe-4f5e-a4af-0730d37dd4cf None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:15.898904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 353/681] 10.222.0.82 () {56 vars in 1124 bytes} [Fri Sep 23 15:10:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:15.900710 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e435f-b5b8-4f53-8bff-679438e79827 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:15.901215 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e435f-b5b8-4f53-8bff-679438e79827 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:15.902357 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e435f-b5b8-4f53-8bff-679438e79827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:15.939155 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007185b-f5da-4840-909a-993dd4db5ffc None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:15.945170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-192e435f-b5b8-4f53-8bff-679438e79827 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:15.946742 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-192e435f-b5b8-4f53-8bff-679438e79827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:15.961920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:16.008067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a59f6-b031-4ade-a6ba-e8aeefca44d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:16.008707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a59f6-b031-4ade-a6ba-e8aeefca44d1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:16.008993 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a59f6-b031-4ade-a6ba-e8aeefca44d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:16.010595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a59f6-b031-4ade-a6ba-e8aeefca44d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:16.011926 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a59f6-b031-4ade-a6ba-e8aeefca44d1 None admin] RBAC: Adding query filter params (role.id=118b4b27bab54b429c3a70924d659c72, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=1879a3ad7be74303b9feceff75f62979) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:16.012256 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a59f6-b031-4ade-a6ba-e8aeefca44d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:16.013747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a59f6-b031-4ade-a6ba-e8aeefca44d1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:16.026035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 329/682] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:15 2022] GET /identity/v3/role_assignments?user.id=1879a3ad7be74303b9feceff75f62979&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=118b4b27bab54b429c3a70924d659c72 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:16.076054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 354/683] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:16.364153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a59f6-b031-4ade-a6ba-e8aeefca44d1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:16.477422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a59f6-b031-4ade-a6ba-e8aeefca44d1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:16.522208 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5655b3a-fb6c-428a-b25a-902ce012e949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:16.523235 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655b3a-fb6c-428a-b25a-902ce012e949 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:16.523718 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655b3a-fb6c-428a-b25a-902ce012e949 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:16.524190 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655b3a-fb6c-428a-b25a-902ce012e949 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:16.539569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5655b3a-fb6c-428a-b25a-902ce012e949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:16.546861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-d5655b3a-fb6c-428a-b25a-902ce012e949 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:16.546861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:16.546861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:16.546861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:16.546861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:16.546861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:16.546861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:16.546861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:16.546861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:16.546861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:16.546861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:16.546861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:16.546861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:16.546861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:16.546861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:16.546861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:16.547832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:16.547832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:16.547832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:16.547832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:16.547832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:16.547832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:16.547832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:16.547832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:16.547832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:16.547832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:16.547832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:16.547832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:16.547832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:16.547832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:16.547832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:16.547832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:16.548720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:16.548720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:16.548720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:16.548720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:16.548720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:16.548720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:16.548720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:16.548720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:16.548720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:16.548720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:16.548720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:16.548720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:16.551465 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 330/684] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:10:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:16.556935 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e435f-b5b8-4f53-8bff-679438e79827 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:16.570883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:16.699731 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e435f-b5b8-4f53-8bff-679438e79827 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:16.742011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520a2d9-7126-4be6-a04a-879a03c8b4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:16.742631 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520a2d9-7126-4be6-a04a-879a03c8b4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:16.742925 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520a2d9-7126-4be6-a04a-879a03c8b4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:16.743184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520a2d9-7126-4be6-a04a-879a03c8b4d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:16.743851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520a2d9-7126-4be6-a04a-879a03c8b4d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:16.744155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520a2d9-7126-4be6-a04a-879a03c8b4d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:16.746126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520a2d9-7126-4be6-a04a-879a03c8b4d7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:16.758939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 355/685] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:10:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:16.764964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5655b3a-fb6c-428a-b25a-902ce012e949 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:16.847844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:16.926237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5655b3a-fb6c-428a-b25a-902ce012e949 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:16.969488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b1922-df21-4a01-af85-0b7b2a0788c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:16.970155 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b1922-df21-4a01-af85-0b7b2a0788c4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:16.970433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b1922-df21-4a01-af85-0b7b2a0788c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:16.970703 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b1922-df21-4a01-af85-0b7b2a0788c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:16.983228 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b1922-df21-4a01-af85-0b7b2a0788c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:16.984897 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b1922-df21-4a01-af85-0b7b2a0788c4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:17.001484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-fc8b1922-df21-4a01-af85-0b7b2a0788c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:17.001484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:17.001484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:17.001484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:17.001484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:17.001484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:17.001484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:17.001484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:17.001484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:17.001484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:17.001484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:17.001484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:17.001484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:17.001484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:17.001484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:17.001484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:17.002548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:17.003453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:17.003453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:17.003453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:17.007264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 331/686] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:17.008599 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520a2d9-7126-4be6-a04a-879a03c8b4d7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:17.102819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:17.144180 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520a2d9-7126-4be6-a04a-879a03c8b4d7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:17.178992 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c1c66-830f-466a-9021-09b372c25276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:17.179599 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c1c66-830f-466a-9021-09b372c25276 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:17.179875 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c1c66-830f-466a-9021-09b372c25276 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:17.180145 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c1c66-830f-466a-9021-09b372c25276 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:17.180785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c1c66-830f-466a-9021-09b372c25276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:17.181086 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c1c66-830f-466a-9021-09b372c25276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:17.182554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c1c66-830f-466a-9021-09b372c25276 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:17.195745 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 356/687] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:17.200977 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b1922-df21-4a01-af85-0b7b2a0788c4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:17.317602 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:17.326901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b1922-df21-4a01-af85-0b7b2a0788c4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:17.360999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393fc3a-df04-4f2a-b2f8-fe1a6547ee87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:17.361628 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393fc3a-df04-4f2a-b2f8-fe1a6547ee87 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:17.361931 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393fc3a-df04-4f2a-b2f8-fe1a6547ee87 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:17.362202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393fc3a-df04-4f2a-b2f8-fe1a6547ee87 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:17.369975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393fc3a-df04-4f2a-b2f8-fe1a6547ee87 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:17.371452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393fc3a-df04-4f2a-b2f8-fe1a6547ee87 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:17.383049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-2393fc3a-df04-4f2a-b2f8-fe1a6547ee87 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 15:10:17.383049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:17.383049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:17.383049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:17.383049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:17.383049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:17.383049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:17.383049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:17.383049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:17.383049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:17.383049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:17.383049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:17.383049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:17.383049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:17.383049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:17.383049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:17.383991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:17.384932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:17.384932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:17.384932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:17.384932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:17.384932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:17.384932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:17.384932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:17.384932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:17.384932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 15:10:17.384932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:17.389257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 332/688] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:10:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:17.390638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c1c66-830f-466a-9021-09b372c25276 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:17.518488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c1c66-830f-466a-9021-09b372c25276 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:17.558730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:17.563980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a550517-5b79-4e36-80e6-8ce0134336f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:17.564600 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a550517-5b79-4e36-80e6-8ce0134336f2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:17.564873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a550517-5b79-4e36-80e6-8ce0134336f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:17.565144 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a550517-5b79-4e36-80e6-8ce0134336f2 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:17.565892 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a550517-5b79-4e36-80e6-8ce0134336f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:17.566197 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a550517-5b79-4e36-80e6-8ce0134336f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:17.567781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a550517-5b79-4e36-80e6-8ce0134336f2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:17.595906 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 357/689] 10.222.0.82 () {56 vars in 1135 bytes} [Fri Sep 23 15:10:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:17.601619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393fc3a-df04-4f2a-b2f8-fe1a6547ee87 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:17.707519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393fc3a-df04-4f2a-b2f8-fe1a6547ee87 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:17.743591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06dc26-42e1-4e02-b6b5-d7e0cfa2caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:17.744196 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06dc26-42e1-4e02-b6b5-d7e0cfa2caa7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:17.744472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06dc26-42e1-4e02-b6b5-d7e0cfa2caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:17.744741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06dc26-42e1-4e02-b6b5-d7e0cfa2caa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:17.775753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:17.844922 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06dc26-42e1-4e02-b6b5-d7e0cfa2caa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:17.846273 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06dc26-42e1-4e02-b6b5-d7e0cfa2caa7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:17.912195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2abe5b-abd5-4673-9c4b-d5fcf2fdbe06 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:17.912551 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2abe5b-abd5-4673-9c4b-d5fcf2fdbe06 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:17.912854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2abe5b-abd5-4673-9c4b-d5fcf2fdbe06 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:17.914361 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 358/690] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:17.919994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1bb75-937a-452b-bb22-08fe1a36e0ba None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:17.920655 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1bb75-937a-452b-bb22-08fe1a36e0ba None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:17.921143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1bb75-937a-452b-bb22-08fe1a36e0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:17.954901 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0ac1bb75-937a-452b-bb22-08fe1a36e0ba None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:17.956537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0ac1bb75-937a-452b-bb22-08fe1a36e0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:17.963477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 333/691] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:10:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:10:17.964845 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06dc26-42e1-4e02-b6b5-d7e0cfa2caa7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:18.020542 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:18.067997 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06dc26-42e1-4e02-b6b5-d7e0cfa2caa7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:18.102281 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 359/692] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:18.114353 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbae66-b583-435f-8a0b-81271beb8415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:18.114990 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbae66-b583-435f-8a0b-81271beb8415 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:18.115274 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbae66-b583-435f-8a0b-81271beb8415 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:18.115539 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbae66-b583-435f-8a0b-81271beb8415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:18.127685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbae66-b583-435f-8a0b-81271beb8415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:18.129294 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbae66-b583-435f-8a0b-81271beb8415 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:18.152505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-bdbbae66-b583-435f-8a0b-81271beb8415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:18.152505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:18.152505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:18.152505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:18.152505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:18.152505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:18.152505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:18.152505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:18.152505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:18.152505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:18.152505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:18.152505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:18.152505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:18.152505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:18.152505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:18.152505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:18.153577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:18.154549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:18.154549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:18.154549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:18.158481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 334/693] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:18.164215 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1bb75-937a-452b-bb22-08fe1a36e0ba None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:18.287371 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1bb75-937a-452b-bb22-08fe1a36e0ba None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:18.309252 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:18.326647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad030d-9d68-4f3d-9198-1acad00b39a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:18.327267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad030d-9d68-4f3d-9198-1acad00b39a2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:18.327545 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad030d-9d68-4f3d-9198-1acad00b39a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:18.327827 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad030d-9d68-4f3d-9198-1acad00b39a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:18.328469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad030d-9d68-4f3d-9198-1acad00b39a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:18.328775 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad030d-9d68-4f3d-9198-1acad00b39a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:18.334251 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad030d-9d68-4f3d-9198-1acad00b39a2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:18.346187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 360/694] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:18.351488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbae66-b583-435f-8a0b-81271beb8415 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:18.498217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbae66-b583-435f-8a0b-81271beb8415 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:18.500540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:18.534499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7e276-043a-4e6e-8261-f976c246b27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:18.535516 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7e276-043a-4e6e-8261-f976c246b27a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:18.535804 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7e276-043a-4e6e-8261-f976c246b27a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:18.536078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7e276-043a-4e6e-8261-f976c246b27a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:18.537724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad030d-9d68-4f3d-9198-1acad00b39a2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:18.543740 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7e276-043a-4e6e-8261-f976c246b27a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:18.545176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7e276-043a-4e6e-8261-f976c246b27a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:18.556277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4fe7e276-043a-4e6e-8261-f976c246b27a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:18.556277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:18.556277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:18.556277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:18.556277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:18.556277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:18.556277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:18.556277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:18.556277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:18.556277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:18.556277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:18.556277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:18.556277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:18.556277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:18.556277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:18.557210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:18.558185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:18.558185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:18.558185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:18.558185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:18.558185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:18.558185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:18.558185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:18.558185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:18.561841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 335/695] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:18.563370 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7e276-043a-4e6e-8261-f976c246b27a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:18.742851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7e276-043a-4e6e-8261-f976c246b27a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:18.760475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad030d-9d68-4f3d-9198-1acad00b39a2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:18.785316 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3858057-5fa2-4f79-93bb-4e3b2237d4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:18.785952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3858057-5fa2-4f79-93bb-4e3b2237d4ee None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:18.786236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3858057-5fa2-4f79-93bb-4e3b2237d4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:18.786510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3858057-5fa2-4f79-93bb-4e3b2237d4ee None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:18.787208 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3858057-5fa2-4f79-93bb-4e3b2237d4ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:18.787513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3858057-5fa2-4f79-93bb-4e3b2237d4ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:18.788947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3858057-5fa2-4f79-93bb-4e3b2237d4ee None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:18.797774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce084497-e18f-49ba-b609-5d25b137dbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:18.798401 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce084497-e18f-49ba-b609-5d25b137dbe5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:18.798705 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce084497-e18f-49ba-b609-5d25b137dbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:18.799040 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce084497-e18f-49ba-b609-5d25b137dbe5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:18.802572 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 336/696] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:18.803811 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3061c-9c4c-4c03-97fd-57f246ed469e None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:18.804100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3061c-9c4c-4c03-97fd-57f246ed469e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:18.804380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3061c-9c4c-4c03-97fd-57f246ed469e None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:18.809851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 337/697] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:18.811548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b0a0e-1f29-4640-94b2-9d07ab1f5387 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:18.811900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b0a0e-1f29-4640-94b2-9d07ab1f5387 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:18.812243 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b0a0e-1f29-4640-94b2-9d07ab1f5387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:18.815961 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce084497-e18f-49ba-b609-5d25b137dbe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:18.822404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ce084497-e18f-49ba-b609-5d25b137dbe5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:10:18.822404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:18.822404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:18.822404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:18.822404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:18.822404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:18.822404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:18.822404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:18.822404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:18.822404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:18.822404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:18.822404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:18.822404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:18.822404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:18.822404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:18.822404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:18.824131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:18.824131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:18.824131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:18.824131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:18.824131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:18.824131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:18.824131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:18.824131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:18.824131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:18.824131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:18.824131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:18.824131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:18.824131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:18.824131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:18.824131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:18.824131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:18.825193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:18.825193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:18.825193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:18.825193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:18.825193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:18.825193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:18.825193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:18.825193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:18.825193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:18.825193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:18.825193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:10:18.825193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:18.825193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 361/698] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:10:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:18.825193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce084497-e18f-49ba-b609-5d25b137dbe5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:18.833475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7b3b0a0e-1f29-4640-94b2-9d07ab1f5387 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:18.834951 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7b3b0a0e-1f29-4640-94b2-9d07ab1f5387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:18.853453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:18.868890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:18.906130 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 338/699] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 15:10:18.907324 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b0a0e-1f29-4640-94b2-9d07ab1f5387 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:18.950115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce084497-e18f-49ba-b609-5d25b137dbe5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:18.994197 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406967c5-2e64-4a9e-8fcc-dfbe55dbf865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:18.995316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406967c5-2e64-4a9e-8fcc-dfbe55dbf865 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:18.995937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406967c5-2e64-4a9e-8fcc-dfbe55dbf865 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:18.996745 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406967c5-2e64-4a9e-8fcc-dfbe55dbf865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:18.997964 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406967c5-2e64-4a9e-8fcc-dfbe55dbf865 None admin] RBAC: Adding query filter params (role.id=118b4b27bab54b429c3a70924d659c72, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=b22406c522e149d8bc462ff2feeec44c) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:18.999408 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406967c5-2e64-4a9e-8fcc-dfbe55dbf865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:19.001136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406967c5-2e64-4a9e-8fcc-dfbe55dbf865 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:19.017747 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 362/700] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:18 2022] GET /identity/v3/role_assignments?user.id=b22406c522e149d8bc462ff2feeec44c&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=118b4b27bab54b429c3a70924d659c72 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:19.018626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2240b-e1c7-4ee7-8eab-3bd193900d09 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:19.018911 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2240b-e1c7-4ee7-8eab-3bd193900d09 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:19.019185 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2240b-e1c7-4ee7-8eab-3bd193900d09 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:19.023671 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 363/701] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:19.031411 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5314478-2039-4cca-b888-8c2955b7aebb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:19.031718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5314478-2039-4cca-b888-8c2955b7aebb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:19.034028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5314478-2039-4cca-b888-8c2955b7aebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:19.054613 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a5314478-2039-4cca-b888-8c2955b7aebb None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:19.055994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a5314478-2039-4cca-b888-8c2955b7aebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:19.059594 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b0a0e-1f29-4640-94b2-9d07ab1f5387 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:19.102205 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1223a97-f06f-46e6-a360-23e3b0dc7487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:19.103215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1223a97-f06f-46e6-a360-23e3b0dc7487 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:19.103676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1223a97-f06f-46e6-a360-23e3b0dc7487 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:19.104194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1223a97-f06f-46e6-a360-23e3b0dc7487 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:19.105265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1223a97-f06f-46e6-a360-23e3b0dc7487 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:19.105858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1223a97-f06f-46e6-a360-23e3b0dc7487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:19.107548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1223a97-f06f-46e6-a360-23e3b0dc7487 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:19.117956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 339/702] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:10:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:19.124312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2ce6a-ea35-4b34-8ee1-9a6b2df69670 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:19.125326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2ce6a-ea35-4b34-8ee1-9a6b2df69670 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:19.125934 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2ce6a-ea35-4b34-8ee1-9a6b2df69670 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:19.128055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 340/703] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:19.129363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2ce6a-ea35-4b34-8ee1-9a6b2df69670 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:19.144475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 364/704] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:19.144475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd53f0-5349-4518-a65f-fd5e7f6e758d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:19.144475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd53f0-5349-4518-a65f-fd5e7f6e758d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:19.144475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd53f0-5349-4518-a65f-fd5e7f6e758d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:19.175268 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:19.176806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9edd53f0-5349-4518-a65f-fd5e7f6e758d None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:19.178064 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9edd53f0-5349-4518-a65f-fd5e7f6e758d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:19.222533 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:19.261757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 365/705] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:19.262589 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd53f0-5349-4518-a65f-fd5e7f6e758d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:19.287165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2ce6a-ea35-4b34-8ee1-9a6b2df69670 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:19.331941 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b61b89-4932-4d7d-a7ab-d9a30e7fd20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:19.332571 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b61b89-4932-4d7d-a7ab-d9a30e7fd20b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:19.332846 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b61b89-4932-4d7d-a7ab-d9a30e7fd20b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:19.333113 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b61b89-4932-4d7d-a7ab-d9a30e7fd20b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:19.346698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b61b89-4932-4d7d-a7ab-d9a30e7fd20b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:19.349201 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b61b89-4932-4d7d-a7ab-d9a30e7fd20b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:19.367667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-91b61b89-4932-4d7d-a7ab-d9a30e7fd20b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:19.367667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:19.367667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:19.367667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:19.367667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:19.367667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:19.367667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:19.367667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:19.367667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:19.367667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:19.367667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:19.367667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:19.367667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:19.367667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:19.367667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:19.367667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:19.368693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:19.370000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:19.370000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:19.370000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:19.370000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 341/706] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:19.377860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b61b89-4932-4d7d-a7ab-d9a30e7fd20b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:19.401161 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd53f0-5349-4518-a65f-fd5e7f6e758d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:19.443689 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e715de-0ce7-4d53-b6ab-3d6e20419bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:19.444360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e715de-0ce7-4d53-b6ab-3d6e20419bb8 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:19.444675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e715de-0ce7-4d53-b6ab-3d6e20419bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:19.444956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e715de-0ce7-4d53-b6ab-3d6e20419bb8 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:19.446465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e715de-0ce7-4d53-b6ab-3d6e20419bb8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:19.448652 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e715de-0ce7-4d53-b6ab-3d6e20419bb8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:19.468280 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:19.502704 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b61b89-4932-4d7d-a7ab-d9a30e7fd20b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:19.540986 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193dc9c-e28e-4705-8ae3-8e0863144ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:19.541520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193dc9c-e28e-4705-8ae3-8e0863144ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:19.541892 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193dc9c-e28e-4705-8ae3-8e0863144ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:19.542711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193dc9c-e28e-4705-8ae3-8e0863144ca3 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:19.543353 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193dc9c-e28e-4705-8ae3-8e0863144ca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:19.543719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193dc9c-e28e-4705-8ae3-8e0863144ca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:19.545148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193dc9c-e28e-4705-8ae3-8e0863144ca3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:19.559758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 342/707] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:19.560700 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193dc9c-e28e-4705-8ae3-8e0863144ca3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:19.563864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 366/708] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Sep 23 15:10:19 2022] POST /identity/v3/services => generated 251 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:10:19.566201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e715de-0ce7-4d53-b6ab-3d6e20419bb8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:19.607078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:19.693063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193dc9c-e28e-4705-8ae3-8e0863144ca3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:19.727812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e715de-0ce7-4d53-b6ab-3d6e20419bb8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:19.737063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:19.747309 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e76875-397f-4487-84ea-2e6cc0c95d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:19.748792 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e76875-397f-4487-84ea-2e6cc0c95d91 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:19.749281 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e76875-397f-4487-84ea-2e6cc0c95d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:19.749782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e76875-397f-4487-84ea-2e6cc0c95d91 None admin] PATH_INFO: `/v3/services/network` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:19.750586 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e76875-397f-4487-84ea-2e6cc0c95d91 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:19.752159 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e76875-397f-4487-84ea-2e6cc0c95d91 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-24e76875-397f-4487-84ea-2e6cc0c95d91 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:19.762313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:19.763377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:19.763377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:19.763377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:19.763377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:19.763377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:19.763377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:19.763377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:19.763377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:19.763377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:19.763377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:19.763377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:19.763377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:19.763377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:19.763377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:19.763377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:19.763377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:19.764840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:19.764840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:19.764840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:19.764840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:19.764840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:19.764840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:19.764840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:19.764840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:19.764840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:19.764840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:19.764840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:19.764840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:19.764840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:10:19.764840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:19.764840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 343/709] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:19 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:19.765690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e76875-397f-4487-84ea-2e6cc0c95d91 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:19.775684 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c285d-07a0-4f26-8862-6119f6a1eea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:19.776447 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c285d-07a0-4f26-8862-6119f6a1eea7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:19.777314 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c285d-07a0-4f26-8862-6119f6a1eea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:19.777602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c285d-07a0-4f26-8862-6119f6a1eea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:19.788374 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c285d-07a0-4f26-8862-6119f6a1eea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:19.790599 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c285d-07a0-4f26-8862-6119f6a1eea7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:19.806755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-373c285d-07a0-4f26-8862-6119f6a1eea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:19.806755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:19.806755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:19.806755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:19.806755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:19.806755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:19.806755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:19.806755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:19.806755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:19.806755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:19.806755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:19.806755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:19.806755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:19.806755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:19.806755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:19.806755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:19.807804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:19.809422 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:19.809422 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:19.809422 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:19.809422 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 367/710] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:19.809422 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c285d-07a0-4f26-8862-6119f6a1eea7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:19.900945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e76875-397f-4487-84ea-2e6cc0c95d91 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:19.912028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:19.944402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c285d-07a0-4f26-8862-6119f6a1eea7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:19.951575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747e444-4674-4363-86f3-cfa607b09bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:19.952220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747e444-4674-4363-86f3-cfa607b09bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:19.952502 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747e444-4674-4363-86f3-cfa607b09bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:19.952806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747e444-4674-4363-86f3-cfa607b09bd5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:19.975804 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747e444-4674-4363-86f3-cfa607b09bd5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:19.977624 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747e444-4674-4363-86f3-cfa607b09bd5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:19.990535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f23f3-58db-4447-92cd-3822c4024bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:19.991278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f23f3-58db-4447-92cd-3822c4024bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:19.991654 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f23f3-58db-4447-92cd-3822c4024bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:19.992052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f23f3-58db-4447-92cd-3822c4024bf8 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:19.992823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f23f3-58db-4447-92cd-3822c4024bf8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:19.993251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c747e444-4674-4363-86f3-cfa607b09bd5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:10:19.993251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:19.993251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:19.993251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:19.993251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:19.993251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:19.993251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:19.993251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:19.993251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:19.993251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:19.993251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:19.993251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:19.993251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:19.993251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:19.993251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:19.993251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:19.994820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:19.997333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:19.997333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:19.997333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:19.997333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:19.997333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:19.997333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:19.997333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:19.997333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:19.997333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:10:19.997333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:19.998468 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f23f3-58db-4447-92cd-3822c4024bf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:19.998587 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 344/711] 10.222.0.82 () {56 vars in 1093 bytes} [Fri Sep 23 15:10:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:19.998587 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747e444-4674-4363-86f3-cfa607b09bd5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:19.998820 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f23f3-58db-4447-92cd-3822c4024bf8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:20.004307 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 368/712] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Sep 23 15:10:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:20.008787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f23f3-58db-4447-92cd-3822c4024bf8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:20.061415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:20.114069 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747e444-4674-4363-86f3-cfa607b09bd5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:20.121438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f23f3-58db-4447-92cd-3822c4024bf8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:20.151828 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d3198-810c-47f8-aa2d-b0fba38d4466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:20.152593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d3198-810c-47f8-aa2d-b0fba38d4466 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:20.152969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d3198-810c-47f8-aa2d-b0fba38d4466 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:20.153442 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d3198-810c-47f8-aa2d-b0fba38d4466 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:20.154230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d3198-810c-47f8-aa2d-b0fba38d4466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:20.154634 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d3198-810c-47f8-aa2d-b0fba38d4466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:20.156110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d3198-810c-47f8-aa2d-b0fba38d4466 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:20.158138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09277ede-68f0-4dfe-9066-b6e7e16a811c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:20.158789 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09277ede-68f0-4dfe-9066-b6e7e16a811c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:20.159072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09277ede-68f0-4dfe-9066-b6e7e16a811c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:20.159358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09277ede-68f0-4dfe-9066-b6e7e16a811c None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:20.160084 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09277ede-68f0-4dfe-9066-b6e7e16a811c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:20.160389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09277ede-68f0-4dfe-9066-b6e7e16a811c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:20.161980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09277ede-68f0-4dfe-9066-b6e7e16a811c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:20.164758 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:20.173778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 345/713] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:20.173778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d3198-810c-47f8-aa2d-b0fba38d4466 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:20.190255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 369/714] 10.222.0.82 () {56 vars in 1133 bytes} [Fri Sep 23 15:10:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:20.191956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09277ede-68f0-4dfe-9066-b6e7e16a811c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:20.290448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d3198-810c-47f8-aa2d-b0fba38d4466 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:20.304551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:20.312159 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09277ede-68f0-4dfe-9066-b6e7e16a811c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:20.330850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5a2e2-679a-49e1-8d0d-1fc9d6929396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:20.331222 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5a2e2-679a-49e1-8d0d-1fc9d6929396 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:20.331508 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5a2e2-679a-49e1-8d0d-1fc9d6929396 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:20.331775 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5a2e2-679a-49e1-8d0d-1fc9d6929396 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:20.332423 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5a2e2-679a-49e1-8d0d-1fc9d6929396 None admin] RBAC: Adding query filter params (type=network) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:20.332707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5a2e2-679a-49e1-8d0d-1fc9d6929396 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:20.334071 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5a2e2-679a-49e1-8d0d-1fc9d6929396 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:20.339718 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 346/715] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Sep 23 15:10:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:20.340418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5a2e2-679a-49e1-8d0d-1fc9d6929396 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:20.362560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41758042-3183-439a-86cb-b339eb284b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:20.363774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758042-3183-439a-86cb-b339eb284b54 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:20.364644 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758042-3183-439a-86cb-b339eb284b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:20.365069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758042-3183-439a-86cb-b339eb284b54 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:20.365900 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41758042-3183-439a-86cb-b339eb284b54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:20.368113 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41758042-3183-439a-86cb-b339eb284b54 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:20.462511 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5a2e2-679a-49e1-8d0d-1fc9d6929396 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:20.504282 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 370/716] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:10:20 2022] POST /identity/v3/users => generated 254 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:10:20.504570 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16101d14-ea8c-491e-b3a4-3930ecaf9b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:20.505174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16101d14-ea8c-491e-b3a4-3930ecaf9b2c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:20.505457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16101d14-ea8c-491e-b3a4-3930ecaf9b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:20.505728 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16101d14-ea8c-491e-b3a4-3930ecaf9b2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:20.561356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:20.593907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16101d14-ea8c-491e-b3a4-3930ecaf9b2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:20.595322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16101d14-ea8c-491e-b3a4-3930ecaf9b2c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:20.720112 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 347/717] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:10:20 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:10:20.725537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41758042-3183-439a-86cb-b339eb284b54 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:20.783445 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:20.838109 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41758042-3183-439a-86cb-b339eb284b54 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:20.875561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bfd6f-7fd1-410a-bf4a-a588fcfeae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:20.876551 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bfd6f-7fd1-410a-bf4a-a588fcfeae67 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:20.877053 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bfd6f-7fd1-410a-bf4a-a588fcfeae67 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:20.877546 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bfd6f-7fd1-410a-bf4a-a588fcfeae67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:20.889193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bfd6f-7fd1-410a-bf4a-a588fcfeae67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:20.890999 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bfd6f-7fd1-410a-bf4a-a588fcfeae67 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:20.907324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-702bfd6f-7fd1-410a-bf4a-a588fcfeae67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:20.907324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:20.907324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:20.907324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:20.907324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:20.907324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:20.907324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:20.907324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:20.907324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:20.907324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:20.907324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:20.907324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:20.907324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:20.907324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:20.907324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:20.907324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:20.908377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:20.909276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:20.909276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:20.909276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:20.911405 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 371/718] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:20.916711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16101d14-ea8c-491e-b3a4-3930ecaf9b2c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:21.008488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:21.032719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16101d14-ea8c-491e-b3a4-3930ecaf9b2c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:21.068467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe813a-8653-40e0-8cb5-b60fae5a3ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:21.069132 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe813a-8653-40e0-8cb5-b60fae5a3ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:21.069418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe813a-8653-40e0-8cb5-b60fae5a3ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:21.071176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe813a-8653-40e0-8cb5-b60fae5a3ee5 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:21.071958 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe813a-8653-40e0-8cb5-b60fae5a3ee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:21.072268 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe813a-8653-40e0-8cb5-b60fae5a3ee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:21.074243 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe813a-8653-40e0-8cb5-b60fae5a3ee5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:21.090956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 348/719] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:21.094821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bfd6f-7fd1-410a-bf4a-a588fcfeae67 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:21.249219 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bfd6f-7fd1-410a-bf4a-a588fcfeae67 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:21.250939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:21.301204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a947aac-becb-4d88-a2b3-e8b3e196d072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:21.301906 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a947aac-becb-4d88-a2b3-e8b3e196d072 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:21.302287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a947aac-becb-4d88-a2b3-e8b3e196d072 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:21.302564 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a947aac-becb-4d88-a2b3-e8b3e196d072 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:21.315172 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a947aac-becb-4d88-a2b3-e8b3e196d072 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:21.316641 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a947aac-becb-4d88-a2b3-e8b3e196d072 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:21.332409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-0a947aac-becb-4d88-a2b3-e8b3e196d072 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:21.332409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:21.332409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:21.332409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:21.332409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:21.332409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:21.332409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:21.332409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:21.332409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:21.332409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:21.332409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:21.332409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:21.332409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:21.332409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:21.332409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:21.333362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:21.334334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:21.334334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:21.334334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:21.334334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:21.334334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:21.334334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:21.334334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:21.334334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:21.334334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 372/720] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:21.342827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe813a-8653-40e0-8cb5-b60fae5a3ee5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:21.484210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe813a-8653-40e0-8cb5-b60fae5a3ee5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:21.520005 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7076a-1a7f-48a7-b2ef-1e80ed677e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:21.520534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7076a-1a7f-48a7-b2ef-1e80ed677e4f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:21.520857 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7076a-1a7f-48a7-b2ef-1e80ed677e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:21.521132 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7076a-1a7f-48a7-b2ef-1e80ed677e4f None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:21.521853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7076a-1a7f-48a7-b2ef-1e80ed677e4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:21.522157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7076a-1a7f-48a7-b2ef-1e80ed677e4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:21.523667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7076a-1a7f-48a7-b2ef-1e80ed677e4f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:21.526546 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:21.546492 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 349/721] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:21.552527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a947aac-becb-4d88-a2b3-e8b3e196d072 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:21.713006 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a947aac-becb-4d88-a2b3-e8b3e196d072 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:21.756928 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d517f-021b-4da2-a2c3-f6aadf80e855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:21.757536 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d517f-021b-4da2-a2c3-f6aadf80e855 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:21.757844 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d517f-021b-4da2-a2c3-f6aadf80e855 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:21.758115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d517f-021b-4da2-a2c3-f6aadf80e855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:21.758832 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d517f-021b-4da2-a2c3-f6aadf80e855 None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=6dbf682960cc447099c11862afa3206b) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:21.759128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d517f-021b-4da2-a2c3-f6aadf80e855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:21.760604 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d517f-021b-4da2-a2c3-f6aadf80e855 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:21.769859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 373/722] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:21 2022] GET /identity/v3/role_assignments?user.id=6dbf682960cc447099c11862afa3206b&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:21.791511 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0ea9b-b7de-4820-baf4-1cc5c115d1eb None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:21.792713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0ea9b-b7de-4820-baf4-1cc5c115d1eb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:21.792887 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0ea9b-b7de-4820-baf4-1cc5c115d1eb None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:21.794122 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 350/723] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:21.800253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b8a5a-5624-4980-ac01-df570ace6200 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:21.800890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b8a5a-5624-4980-ac01-df570ace6200 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:21.800890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b8a5a-5624-4980-ac01-df570ace6200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:21.820947 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-504b8a5a-5624-4980-ac01-df570ace6200 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:21.822412 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-504b8a5a-5624-4980-ac01-df570ace6200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:21.855639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:21.916371 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 374/724] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:22.097945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f7a2a-d605-4a8c-897a-dc9a61854f77 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:22.097945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f7a2a-d605-4a8c-897a-dc9a61854f77 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:22.097945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f7a2a-d605-4a8c-897a-dc9a61854f77 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:22.099500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 351/725] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:22.105671 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3ce6b-dec6-4c39-91b8-13b184017de4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:22.105998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3ce6b-dec6-4c39-91b8-13b184017de4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:22.106270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3ce6b-dec6-4c39-91b8-13b184017de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:22.128936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-eba3ce6b-dec6-4c39-91b8-13b184017de4 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:22.130183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-eba3ce6b-dec6-4c39-91b8-13b184017de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:22.215076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 375/726] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:22.336242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f7a2a-d605-4a8c-897a-dc9a61854f77 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:22.445253 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f7a2a-d605-4a8c-897a-dc9a61854f77 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:22.481047 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f091e4-4dfb-4814-9c8b-434dfbd384f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:22.481681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f091e4-4dfb-4814-9c8b-434dfbd384f3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:22.481977 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f091e4-4dfb-4814-9c8b-434dfbd384f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:22.482247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f091e4-4dfb-4814-9c8b-434dfbd384f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:22.492848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f091e4-4dfb-4814-9c8b-434dfbd384f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:22.498226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-b4f091e4-4dfb-4814-9c8b-434dfbd384f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:10:22.498226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:22.498226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:22.498226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:22.498226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:22.498226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:22.498226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:22.498226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:22.498226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:22.498226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:22.498226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:22.498226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:22.498226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:22.498226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:22.498226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:22.498226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:22.500347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:22.500347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:22.500347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:22.500347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:22.500347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:22.500347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:22.500347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:22.500347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:22.500347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:22.500347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:22.500347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:22.500347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:22.500347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:22.500347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:22.500347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:22.500347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:22.502391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:22.502391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:22.502391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:22.502391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:22.502391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:22.502391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:22.502391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:22.502391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:22.502391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:22.502391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:22.502391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:10:22.502391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:22.509759 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 352/727] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:10:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:22.510011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3ce6b-dec6-4c39-91b8-13b184017de4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:22.612495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f091e4-4dfb-4814-9c8b-434dfbd384f3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:22.634281 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:22.660353 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3ce6b-dec6-4c39-91b8-13b184017de4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:22.712171 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:22.735653 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccac26-6503-4271-ab9c-af945c0098ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:22.736267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccac26-6503-4271-ab9c-af945c0098ec None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:22.736539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccac26-6503-4271-ab9c-af945c0098ec None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:22.736802 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccac26-6503-4271-ab9c-af945c0098ec None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:22.737469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccac26-6503-4271-ab9c-af945c0098ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:22.741442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccac26-6503-4271-ab9c-af945c0098ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:22.742905 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccac26-6503-4271-ab9c-af945c0098ec None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:22.754077 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 376/728] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:10:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:22.759236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccac26-6503-4271-ab9c-af945c0098ec None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:22.799465 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f091e4-4dfb-4814-9c8b-434dfbd384f3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:22.853495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd75123-da5a-496e-983e-8ca43922869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:22.854198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd75123-da5a-496e-983e-8ca43922869b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:22.854475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd75123-da5a-496e-983e-8ca43922869b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:22.854739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd75123-da5a-496e-983e-8ca43922869b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:22.855320 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd75123-da5a-496e-983e-8ca43922869b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:22.856687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd75123-da5a-496e-983e-8ca43922869b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-bbd75123-da5a-496e-983e-8ca43922869b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:22.865770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:22.867002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:22.867002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:22.867002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:22.867002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:22.867002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:22.867002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:22.867002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:22.867002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:22.867002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:22.867002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:22.867002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:22.867002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:22.867002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:22.867002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:22.867002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:22.867002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:22.868102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:22.868102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:22.868102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:22.868102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:22.868102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:22.868102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:22.868102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:22.868102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:22.868102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:22.868102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:22.868102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:22.868102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:22.868102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:10:22.868102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:22.869239 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 353/729] 10.222.0.82 () {56 vars in 1129 bytes} [Fri Sep 23 15:10:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:22.875259 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd75123-da5a-496e-983e-8ca43922869b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:22.943072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccac26-6503-4271-ab9c-af945c0098ec None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:22.987934 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd75123-da5a-496e-983e-8ca43922869b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:23.028349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50966f-bf91-41f2-b91b-693e5245d685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:23.028978 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50966f-bf91-41f2-b91b-693e5245d685 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:23.029253 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50966f-bf91-41f2-b91b-693e5245d685 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:23.029565 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50966f-bf91-41f2-b91b-693e5245d685 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:23.030251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50966f-bf91-41f2-b91b-693e5245d685 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:23.030554 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50966f-bf91-41f2-b91b-693e5245d685 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:23.032095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50966f-bf91-41f2-b91b-693e5245d685 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:23.037825 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 354/730] 10.222.0.82 () {56 vars in 1124 bytes} [Fri Sep 23 15:10:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:23.042506 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:23.044923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d9dca-5457-45fb-8da3-051b1b6ae205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:23.045724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d9dca-5457-45fb-8da3-051b1b6ae205 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:23.046164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d9dca-5457-45fb-8da3-051b1b6ae205 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:23.046544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d9dca-5457-45fb-8da3-051b1b6ae205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:23.049709 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50966f-bf91-41f2-b91b-693e5245d685 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:23.071685 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d9dca-5457-45fb-8da3-051b1b6ae205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:23.073796 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d9dca-5457-45fb-8da3-051b1b6ae205 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:23.091461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:23.099070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-9b9d9dca-5457-45fb-8da3-051b1b6ae205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:23.099070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:23.099070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:23.099070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:23.099070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:23.099070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:23.099070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:23.099070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:23.099070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:23.099070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:23.099070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:23.099070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:23.099070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:23.099070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:23.099070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:23.099070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:23.100049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:23.100959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:23.100959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:23.100959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:23.101804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 377/731] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:23.107192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d9dca-5457-45fb-8da3-051b1b6ae205 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:23.200547 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50966f-bf91-41f2-b91b-693e5245d685 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:23.242226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d0679-24d9-41ce-ba76-5628f9128107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:23.242765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0679-24d9-41ce-ba76-5628f9128107 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:23.243048 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0679-24d9-41ce-ba76-5628f9128107 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:23.243325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0679-24d9-41ce-ba76-5628f9128107 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:23.243958 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d0679-24d9-41ce-ba76-5628f9128107 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:23.245338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d0679-24d9-41ce-ba76-5628f9128107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:23.247052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d0679-24d9-41ce-ba76-5628f9128107 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:23.254962 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 355/732] 10.222.0.82 () {56 vars in 1124 bytes} [Fri Sep 23 15:10:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:23.256531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c13e-63fa-475c-bee4-ec9a2296db69 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:23.256844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c13e-63fa-475c-bee4-ec9a2296db69 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:23.257127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c13e-63fa-475c-bee4-ec9a2296db69 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:23.257810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d9dca-5457-45fb-8da3-051b1b6ae205 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:23.258657 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 356/733] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:23.261833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924c13e-63fa-475c-bee4-ec9a2296db69 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:23.304254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b158e70-8e35-4681-ba50-de39287a0e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:23.304873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b158e70-8e35-4681-ba50-de39287a0e24 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:23.305147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b158e70-8e35-4681-ba50-de39287a0e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:23.305417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b158e70-8e35-4681-ba50-de39287a0e24 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:23.306100 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b158e70-8e35-4681-ba50-de39287a0e24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:23.306400 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b158e70-8e35-4681-ba50-de39287a0e24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:23.308348 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b158e70-8e35-4681-ba50-de39287a0e24 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:23.320013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:23.322816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 378/734] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:23.324180 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48523c5a-68dd-46f2-99d9-4aad0af53a97 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:23.324465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48523c5a-68dd-46f2-99d9-4aad0af53a97 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:23.324738 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48523c5a-68dd-46f2-99d9-4aad0af53a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:23.345437 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-48523c5a-68dd-46f2-99d9-4aad0af53a97 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:23.346985 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-48523c5a-68dd-46f2-99d9-4aad0af53a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:23.389662 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924c13e-63fa-475c-bee4-ec9a2296db69 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:23.423672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:23.436092 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 379/735] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:23.437287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48523c5a-68dd-46f2-99d9-4aad0af53a97 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:23.447683 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09acae-64d0-4d36-ae3e-45e0934cc53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:23.450503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09acae-64d0-4d36-ae3e-45e0934cc53b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:23.451012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09acae-64d0-4d36-ae3e-45e0934cc53b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:23.452891 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09acae-64d0-4d36-ae3e-45e0934cc53b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:23.453860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09acae-64d0-4d36-ae3e-45e0934cc53b None admin] RBAC: Adding query filter params (interface=public, service_id=403bb038d3d4460f9df99e26b2aa7140, region_id=RegionOne) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:23.454398 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09acae-64d0-4d36-ae3e-45e0934cc53b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:23.458240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09acae-64d0-4d36-ae3e-45e0934cc53b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:23.483510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 357/736] 10.222.0.82 () {56 vars in 1251 bytes} [Fri Sep 23 15:10:23 2022] GET /identity/v3/endpoints?service_id=403bb038d3d4460f9df99e26b2aa7140&interface=public®ion_id=RegionOne => generated 194 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:23.486253 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09acae-64d0-4d36-ae3e-45e0934cc53b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:23.591353 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48523c5a-68dd-46f2-99d9-4aad0af53a97 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:23.616872 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09acae-64d0-4d36-ae3e-45e0934cc53b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:23.627011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf6d15-7758-4f6b-89d7-4da6ef3cc484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:23.627773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf6d15-7758-4f6b-89d7-4da6ef3cc484 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:23.628363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf6d15-7758-4f6b-89d7-4da6ef3cc484 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:23.628523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf6d15-7758-4f6b-89d7-4da6ef3cc484 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:23.633279 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:23.637704 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf6d15-7758-4f6b-89d7-4da6ef3cc484 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:23.639358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf6d15-7758-4f6b-89d7-4da6ef3cc484 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:23.651918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-fccf6d15-7758-4f6b-89d7-4da6ef3cc484 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 15:10:23.651918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:23.651918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:23.651918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:23.651918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:23.651918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:23.651918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:23.651918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:23.651918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:23.651918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:23.651918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:23.651918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:23.651918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:23.651918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:23.651918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:23.651918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:23.652883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:23.653913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:23.653913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:23.653913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:23.653913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:23.653913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:23.653913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:23.653913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:23.653913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:23.653913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 15:10:23.653913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:23.655567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 380/737] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:10:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:23.656696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f6578-be45-4e75-a6e8-2bf8a96cb9cd None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:23.656978 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f6578-be45-4e75-a6e8-2bf8a96cb9cd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:23.657251 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f6578-be45-4e75-a6e8-2bf8a96cb9cd None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:23.659053 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 381/738] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:23.660796 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda67852-0cd1-4246-9adb-3b5791261de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:23.661529 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda67852-0cd1-4246-9adb-3b5791261de5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:23.665781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda67852-0cd1-4246-9adb-3b5791261de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:23.665781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda67852-0cd1-4246-9adb-3b5791261de5 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:23.665781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda67852-0cd1-4246-9adb-3b5791261de5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:23.665781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda67852-0cd1-4246-9adb-3b5791261de5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:23.668182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52accf73-e275-4e7d-a5fe-fb617fecdc5f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:23.668639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52accf73-e275-4e7d-a5fe-fb617fecdc5f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:23.669048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52accf73-e275-4e7d-a5fe-fb617fecdc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:23.670198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 358/739] 10.222.0.82 () {56 vars in 1087 bytes} [Fri Sep 23 15:10:23 2022] GET /identity/v3/services => generated 544 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:23.682021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda67852-0cd1-4246-9adb-3b5791261de5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:23.715070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-52accf73-e275-4e7d-a5fe-fb617fecdc5f None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:23.716281 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-52accf73-e275-4e7d-a5fe-fb617fecdc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:23.803015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:23.810671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda67852-0cd1-4246-9adb-3b5791261de5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:23.828829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 382/740] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 15:10:23.830024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52accf73-e275-4e7d-a5fe-fb617fecdc5f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:23.871668 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad20c2f-0e27-4010-87c6-97ee0ebdf5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:23.872590 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad20c2f-0e27-4010-87c6-97ee0ebdf5bf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:23.874226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad20c2f-0e27-4010-87c6-97ee0ebdf5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:23.874682 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad20c2f-0e27-4010-87c6-97ee0ebdf5bf None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:23.876582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad20c2f-0e27-4010-87c6-97ee0ebdf5bf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:23.879918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad20c2f-0e27-4010-87c6-97ee0ebdf5bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:23.881812 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad20c2f-0e27-4010-87c6-97ee0ebdf5bf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:23.915499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 359/741] 10.222.0.82 () {56 vars in 1135 bytes} [Fri Sep 23 15:10:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:23.921132 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad20c2f-0e27-4010-87c6-97ee0ebdf5bf None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:23.975821 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:23.989710 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52accf73-e275-4e7d-a5fe-fb617fecdc5f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:24.030332 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8e36e-d00b-4efb-a487-0530ee838814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:24.031373 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8e36e-d00b-4efb-a487-0530ee838814 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:24.031896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8e36e-d00b-4efb-a487-0530ee838814 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:24.032367 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8e36e-d00b-4efb-a487-0530ee838814 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:24.033236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8e36e-d00b-4efb-a487-0530ee838814 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:24.034981 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8e36e-d00b-4efb-a487-0530ee838814 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:24.056195 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad20c2f-0e27-4010-87c6-97ee0ebdf5bf None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:24.093447 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91194157-5cfb-48d5-8231-4ebda6cab7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:24.094081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91194157-5cfb-48d5-8231-4ebda6cab7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:24.094359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91194157-5cfb-48d5-8231-4ebda6cab7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:24.094631 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91194157-5cfb-48d5-8231-4ebda6cab7e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:24.141453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 383/742] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Sep 23 15:10:23 2022] POST /identity/v3/services => generated 240 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:10:24.142234 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8e36e-d00b-4efb-a487-0530ee838814 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:24.171030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91194157-5cfb-48d5-8231-4ebda6cab7e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:24.172843 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91194157-5cfb-48d5-8231-4ebda6cab7e2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:24.210087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:24.216956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:24.293373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 360/743] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:10:23 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 15:10:24.302262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91194157-5cfb-48d5-8231-4ebda6cab7e2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:24.393463 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8e36e-d00b-4efb-a487-0530ee838814 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:24.412682 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91194157-5cfb-48d5-8231-4ebda6cab7e2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:24.437760 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543b15b-a256-45a6-8552-843456e07096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:24.438624 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543b15b-a256-45a6-8552-843456e07096 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:24.439693 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543b15b-a256-45a6-8552-843456e07096 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:24.439693 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543b15b-a256-45a6-8552-843456e07096 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:24.452161 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543b15b-a256-45a6-8552-843456e07096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:24.454541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8573f-a3a9-4f6a-916f-9f4f69447f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:24.454673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8573f-a3a9-4f6a-916f-9f4f69447f6b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:24.454944 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8573f-a3a9-4f6a-916f-9f4f69447f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:24.455220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8573f-a3a9-4f6a-916f-9f4f69447f6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:24.457625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7543b15b-a256-45a6-8552-843456e07096 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:24.457625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:24.457625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:24.457625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:24.457625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:24.457625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:24.457625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:24.457625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:24.457625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:24.457625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:24.457625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:24.457625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:24.457625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:24.457625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:24.457625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:24.457625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:24.458607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:24.458607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:24.458607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:24.458607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:24.458607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:24.458607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:24.458607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:24.458607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:24.458607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:24.458607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:24.458607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:24.458607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:24.458607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:24.458607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:24.458607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:24.458607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:24.459464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:24.459464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:24.459464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:24.459464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:24.459464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:24.459464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:24.459464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:24.459464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:24.459464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:24.459464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:24.459464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:24.459464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:24.459464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 384/744] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:10:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:24.460173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:24.460910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091518bb-8240-4782-92b5-715cbed3a5d6 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:24.460910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091518bb-8240-4782-92b5-715cbed3a5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:24.461071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091518bb-8240-4782-92b5-715cbed3a5d6 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:24.462811 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 385/745] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:24.465500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091518bb-8240-4782-92b5-715cbed3a5d6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:24.473338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8573f-a3a9-4f6a-916f-9f4f69447f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:24.475263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8573f-a3a9-4f6a-916f-9f4f69447f6b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:24.494982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e1c8573f-a3a9-4f6a-916f-9f4f69447f6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:24.494982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:24.494982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:24.494982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:24.494982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:24.494982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:24.494982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:24.494982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:24.494982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:24.494982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:24.494982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:24.494982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:24.494982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:24.494982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:24.494982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:24.494982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:24.496146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:24.497068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:24.497068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:24.497068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:24.497068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 361/746] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:24.497876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1757e4e-007f-44ce-bf5e-e118c12cb421 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:24.497876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1757e4e-007f-44ce-bf5e-e118c12cb421 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:24.500942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1757e4e-007f-44ce-bf5e-e118c12cb421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:24.518114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f1757e4e-007f-44ce-bf5e-e118c12cb421 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:24.519493 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f1757e4e-007f-44ce-bf5e-e118c12cb421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:24.577554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:24.584078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091518bb-8240-4782-92b5-715cbed3a5d6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:24.613821 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 362/747] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:24.615078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1757e4e-007f-44ce-bf5e-e118c12cb421 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:24.637456 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bac1d-c648-4d09-8b4b-7eedaa333ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:24.638414 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bac1d-c648-4d09-8b4b-7eedaa333ece None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:24.638876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bac1d-c648-4d09-8b4b-7eedaa333ece None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:24.639407 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bac1d-c648-4d09-8b4b-7eedaa333ece None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:24.640852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bac1d-c648-4d09-8b4b-7eedaa333ece None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:24.641549 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bac1d-c648-4d09-8b4b-7eedaa333ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:24.645213 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bac1d-c648-4d09-8b4b-7eedaa333ece None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:24.663641 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 386/748] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:10:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:24.668298 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bac1d-c648-4d09-8b4b-7eedaa333ece None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:24.814447 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1757e4e-007f-44ce-bf5e-e118c12cb421 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:24.848012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:24.855510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bac1d-c648-4d09-8b4b-7eedaa333ece None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:24.882533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758d976-c9f9-438e-9392-511f98ea8377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:24.884180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758d976-c9f9-438e-9392-511f98ea8377 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:24.884820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758d976-c9f9-438e-9392-511f98ea8377 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:24.886973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758d976-c9f9-438e-9392-511f98ea8377 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:24.887805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758d976-c9f9-438e-9392-511f98ea8377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:24.888313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758d976-c9f9-438e-9392-511f98ea8377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:24.890809 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758d976-c9f9-438e-9392-511f98ea8377 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:24.911177 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 363/749] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:24.915036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758d976-c9f9-438e-9392-511f98ea8377 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:24.922137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fc24e-be69-4319-b698-c8832f211fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:24.923744 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fc24e-be69-4319-b698-c8832f211fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:24.928776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fc24e-be69-4319-b698-c8832f211fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:24.929317 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fc24e-be69-4319-b698-c8832f211fe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:24.948304 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fc24e-be69-4319-b698-c8832f211fe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:24.953999 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fc24e-be69-4319-b698-c8832f211fe2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:24.978165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-a60fc24e-be69-4319-b698-c8832f211fe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:24.978165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:24.978165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:24.978165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:24.978165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:24.978165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:24.978165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:24.978165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:24.978165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:24.978165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:24.978165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:24.978165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:24.978165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:24.978165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:24.978165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:24.978165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:24.979198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:24.980199 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:24.980199 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:24.980199 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:24.980199 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 387/750] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:24.980427 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fc24e-be69-4319-b698-c8832f211fe2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:25.014136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:25.064305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758d976-c9f9-438e-9392-511f98ea8377 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:25.105062 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fc24e-be69-4319-b698-c8832f211fe2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:25.106974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922795b9-6a0d-4a60-a89b-9f7474c1c44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:25.108055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922795b9-6a0d-4a60-a89b-9f7474c1c44e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:25.109331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922795b9-6a0d-4a60-a89b-9f7474c1c44e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:25.109696 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922795b9-6a0d-4a60-a89b-9f7474c1c44e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:25.118179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922795b9-6a0d-4a60-a89b-9f7474c1c44e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:25.120552 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922795b9-6a0d-4a60-a89b-9f7474c1c44e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:25.134827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-922795b9-6a0d-4a60-a89b-9f7474c1c44e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:25.134827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:25.134827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:25.134827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:25.134827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:25.134827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:25.134827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:25.134827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:25.134827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:25.134827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:25.134827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:25.134827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:25.134827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:25.134827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:25.134827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:25.136426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:25.137318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:25.137318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:25.137318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:25.137318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:25.137318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:25.137318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:25.137318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:25.137318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:25.137318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 364/751] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:25.137851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922795b9-6a0d-4a60-a89b-9f7474c1c44e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:25.151735 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23177b31-2f02-426d-8ba1-66a94b97ba42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:25.152825 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23177b31-2f02-426d-8ba1-66a94b97ba42 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:25.153714 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23177b31-2f02-426d-8ba1-66a94b97ba42 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:25.154191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23177b31-2f02-426d-8ba1-66a94b97ba42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:25.169275 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23177b31-2f02-426d-8ba1-66a94b97ba42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:25.178607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-23177b31-2f02-426d-8ba1-66a94b97ba42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:10:25.178607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:25.178607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:25.178607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:25.178607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:25.178607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:25.178607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:25.178607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:25.178607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:25.178607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:25.178607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:25.178607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:25.178607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:25.178607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:25.178607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:25.178607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:25.179668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:25.179668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:25.179668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:25.179668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:25.179668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:25.179668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:25.179668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:25.179668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:25.179668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:25.179668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:25.179668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:25.179668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:25.179668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:25.179668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:25.179668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:25.179668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:25.180541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:25.180541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:25.180541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:25.180541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:25.180541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:25.180541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:25.180541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:25.180541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:25.180541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:25.180541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:25.180541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:10:25.180541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:25.183813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 388/752] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:10:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:25.184798 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23177b31-2f02-426d-8ba1-66a94b97ba42 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:25.193911 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:25.268968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:25.280123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922795b9-6a0d-4a60-a89b-9f7474c1c44e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:25.303043 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23177b31-2f02-426d-8ba1-66a94b97ba42 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:25.318662 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adaade4-15e7-4a0e-89a4-0bd2070db57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:25.319325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adaade4-15e7-4a0e-89a4-0bd2070db57b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:25.319612 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adaade4-15e7-4a0e-89a4-0bd2070db57b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:25.320042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adaade4-15e7-4a0e-89a4-0bd2070db57b None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:25.320700 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adaade4-15e7-4a0e-89a4-0bd2070db57b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:25.321007 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adaade4-15e7-4a0e-89a4-0bd2070db57b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:25.323638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adaade4-15e7-4a0e-89a4-0bd2070db57b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:25.336246 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 365/753] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:25.337097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adaade4-15e7-4a0e-89a4-0bd2070db57b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:25.344554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914015fe-d184-49a7-8c46-bfa6c0df79b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:25.345468 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914015fe-d184-49a7-8c46-bfa6c0df79b9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:25.346010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914015fe-d184-49a7-8c46-bfa6c0df79b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:25.346596 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914015fe-d184-49a7-8c46-bfa6c0df79b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:25.347532 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914015fe-d184-49a7-8c46-bfa6c0df79b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:25.348042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914015fe-d184-49a7-8c46-bfa6c0df79b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:25.349888 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914015fe-d184-49a7-8c46-bfa6c0df79b9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:25.364640 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 389/754] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:25.366014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914015fe-d184-49a7-8c46-bfa6c0df79b9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:25.449207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:25.455450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adaade4-15e7-4a0e-89a4-0bd2070db57b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:25.478093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914015fe-d184-49a7-8c46-bfa6c0df79b9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:25.492761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4119390-bd1e-45b6-af4a-0232132044f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:25.493544 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4119390-bd1e-45b6-af4a-0232132044f4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:25.493880 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4119390-bd1e-45b6-af4a-0232132044f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:25.494160 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4119390-bd1e-45b6-af4a-0232132044f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:25.495349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4119390-bd1e-45b6-af4a-0232132044f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:25.495737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4119390-bd1e-45b6-af4a-0232132044f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:25.497818 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4119390-bd1e-45b6-af4a-0232132044f4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:25.512394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:25.513617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 366/755] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:10:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:25.515100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4119390-bd1e-45b6-af4a-0232132044f4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:25.520868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab65af6-38a1-4eb3-8a5f-ec0ca2a85c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:25.521797 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab65af6-38a1-4eb3-8a5f-ec0ca2a85c00 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:25.526523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab65af6-38a1-4eb3-8a5f-ec0ca2a85c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:25.526523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab65af6-38a1-4eb3-8a5f-ec0ca2a85c00 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:25.530732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab65af6-38a1-4eb3-8a5f-ec0ca2a85c00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:25.532503 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab65af6-38a1-4eb3-8a5f-ec0ca2a85c00 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:25.546033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7ab65af6-38a1-4eb3-8a5f-ec0ca2a85c00 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 15:10:25.546033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:25.546033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:25.546033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:25.546033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:25.546033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:25.546033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:25.546033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:25.546033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:25.546033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:25.546033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:25.546033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:25.546033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:25.546033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:25.546033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:25.546033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:25.547328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:25.548563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:25.548563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:25.548563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:25.548563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:25.548563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:25.548563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:25.548563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:25.548563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:25.548563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 15:10:25.548563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:25.551075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 390/756] 10.222.0.82 () {56 vars in 1117 bytes} [Fri Sep 23 15:10:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:25.552002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab65af6-38a1-4eb3-8a5f-ec0ca2a85c00 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:25.628299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4119390-bd1e-45b6-af4a-0232132044f4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:25.663275 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab65af6-38a1-4eb3-8a5f-ec0ca2a85c00 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:25.668821 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ee751-1ee4-4f85-b898-7b92f7b8f855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:25.669432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ee751-1ee4-4f85-b898-7b92f7b8f855 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:25.669750 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ee751-1ee4-4f85-b898-7b92f7b8f855 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:25.670033 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ee751-1ee4-4f85-b898-7b92f7b8f855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:25.670761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ee751-1ee4-4f85-b898-7b92f7b8f855 None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=b22406c522e149d8bc462ff2feeec44c) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:25.671072 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ee751-1ee4-4f85-b898-7b92f7b8f855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:25.672940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ee751-1ee4-4f85-b898-7b92f7b8f855 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:25.680009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 367/757] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:25 2022] GET /identity/v3/role_assignments?user.id=b22406c522e149d8bc462ff2feeec44c&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:25.680822 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ee751-1ee4-4f85-b898-7b92f7b8f855 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:25.704202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecaf13-1f3e-4f34-b47d-0356813bee1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:25.705035 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecaf13-1f3e-4f34-b47d-0356813bee1e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:25.705419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecaf13-1f3e-4f34-b47d-0356813bee1e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:25.705811 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecaf13-1f3e-4f34-b47d-0356813bee1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:25.711717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:25.720170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eecaf13-1f3e-4f34-b47d-0356813bee1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:25.722065 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eecaf13-1f3e-4f34-b47d-0356813bee1e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:25.738561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-6eecaf13-1f3e-4f34-b47d-0356813bee1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:25.738561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:25.738561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:25.738561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:25.738561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:25.738561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:25.738561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:25.738561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:25.738561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:25.738561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:25.738561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:25.738561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:25.738561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:25.738561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:25.738561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:25.738561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:25.739773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:25.740789 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:25.740789 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:25.740789 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:25.743120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 391/758] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:25.750998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecaf13-1f3e-4f34-b47d-0356813bee1e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:25.842144 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:25.855946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ee751-1ee4-4f85-b898-7b92f7b8f855 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:25.908724 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7886e3-49b1-4180-b9ec-f4985e22c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:25.909256 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7886e3-49b1-4180-b9ec-f4985e22c4fa None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:25.909527 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7886e3-49b1-4180-b9ec-f4985e22c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:25.909853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7886e3-49b1-4180-b9ec-f4985e22c4fa None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:25.910585 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7886e3-49b1-4180-b9ec-f4985e22c4fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:25.910887 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7886e3-49b1-4180-b9ec-f4985e22c4fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:25.912313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7886e3-49b1-4180-b9ec-f4985e22c4fa None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:25.926672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecaf13-1f3e-4f34-b47d-0356813bee1e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:25.933805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 368/759] 10.222.0.82 () {56 vars in 1149 bytes} [Fri Sep 23 15:10:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:25.939047 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7886e3-49b1-4180-b9ec-f4985e22c4fa None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:25.999855 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0643a5-b8b6-49cc-8d23-f04546b3aa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:26.002517 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0643a5-b8b6-49cc-8d23-f04546b3aa05 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:26.007063 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0643a5-b8b6-49cc-8d23-f04546b3aa05 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:26.007618 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0643a5-b8b6-49cc-8d23-f04546b3aa05 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:26.008518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0643a5-b8b6-49cc-8d23-f04546b3aa05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:26.009044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0643a5-b8b6-49cc-8d23-f04546b3aa05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:26.010741 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0643a5-b8b6-49cc-8d23-f04546b3aa05 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:26.040999 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 392/760] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:26.046922 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0643a5-b8b6-49cc-8d23-f04546b3aa05 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:26.097207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:26.131795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7886e3-49b1-4180-b9ec-f4985e22c4fa None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:26.199458 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8af1e-130f-4b6f-bdd8-badb664901f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:26.200068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8af1e-130f-4b6f-bdd8-badb664901f8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:26.200343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8af1e-130f-4b6f-bdd8-badb664901f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:26.200606 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8af1e-130f-4b6f-bdd8-badb664901f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:26.231222 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0643a5-b8b6-49cc-8d23-f04546b3aa05 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:26.232730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:26.286113 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf583aa-3e95-4c29-8a2b-088d8b0de617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:26.287267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf583aa-3e95-4c29-8a2b-088d8b0de617 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:26.287732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf583aa-3e95-4c29-8a2b-088d8b0de617 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:26.288701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf583aa-3e95-4c29-8a2b-088d8b0de617 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:26.290846 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8af1e-130f-4b6f-bdd8-badb664901f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:26.294082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8af1e-130f-4b6f-bdd8-badb664901f8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:26.299491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf583aa-3e95-4c29-8a2b-088d8b0de617 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:26.301200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf583aa-3e95-4c29-8a2b-088d8b0de617 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:26.317136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-0bf583aa-3e95-4c29-8a2b-088d8b0de617 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:10:26.317136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:26.317136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:26.317136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:26.317136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:26.317136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:26.317136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:26.317136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:26.317136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:26.317136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:26.317136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:26.317136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:26.317136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:26.317136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:26.317136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:26.317136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:26.318187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:26.319128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:26.319128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:26.319128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:26.319128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:26.319128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:26.319128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:26.319128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:26.319128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:26.319128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:10:26.319128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:26.322293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 393/761] 10.222.0.82 () {56 vars in 1093 bytes} [Fri Sep 23 15:10:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:26.324460 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e647c-832f-4770-9bc6-f76e30f369f0 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:26.325145 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e647c-832f-4770-9bc6-f76e30f369f0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:26.325563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e647c-832f-4770-9bc6-f76e30f369f0 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:26.331927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 394/762] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:26.331927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e647c-832f-4770-9bc6-f76e30f369f0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:26.391582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:26.413381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 369/763] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:10:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:10:26.415044 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1a07f-d32a-4a07-a667-df54de720070 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:26.415569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1a07f-d32a-4a07-a667-df54de720070 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:26.417076 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1a07f-d32a-4a07-a667-df54de720070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:26.436999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2fa1a07f-d32a-4a07-a667-df54de720070 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:26.438597 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2fa1a07f-d32a-4a07-a667-df54de720070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:26.447102 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e647c-832f-4770-9bc6-f76e30f369f0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:26.497489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881c410-842a-41e0-a7a1-00ff9c19caf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:26.498197 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881c410-842a-41e0-a7a1-00ff9c19caf3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:26.498477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881c410-842a-41e0-a7a1-00ff9c19caf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:26.498744 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881c410-842a-41e0-a7a1-00ff9c19caf3 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:26.499770 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881c410-842a-41e0-a7a1-00ff9c19caf3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:26.500077 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881c410-842a-41e0-a7a1-00ff9c19caf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:26.501566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881c410-842a-41e0-a7a1-00ff9c19caf3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:26.517912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 370/764] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:26.518867 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1a07f-d32a-4a07-a667-df54de720070 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:26.532059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 395/765] 10.222.0.82 () {56 vars in 1133 bytes} [Fri Sep 23 15:10:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:26.537574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881c410-842a-41e0-a7a1-00ff9c19caf3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:26.578382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:26.638124 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1a07f-d32a-4a07-a667-df54de720070 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:26.649672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:26.675230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee111a76-33bb-48db-ad7e-41909f814a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:26.675864 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee111a76-33bb-48db-ad7e-41909f814a0d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:26.676138 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee111a76-33bb-48db-ad7e-41909f814a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:26.676574 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee111a76-33bb-48db-ad7e-41909f814a0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:26.687490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee111a76-33bb-48db-ad7e-41909f814a0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:26.688938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee111a76-33bb-48db-ad7e-41909f814a0d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:26.705322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ee111a76-33bb-48db-ad7e-41909f814a0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:26.705322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:26.705322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:26.705322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:26.705322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:26.705322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:26.705322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:26.705322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:26.705322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:26.705322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:26.705322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:26.705322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:26.705322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:26.705322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:26.705322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:26.705322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:26.706373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:26.707295 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:26.707295 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:26.707295 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:26.711351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 371/766] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:26.718422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144682ae-979c-4445-945f-d36565469df3 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:26.718754 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144682ae-979c-4445-945f-d36565469df3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:26.718966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144682ae-979c-4445-945f-d36565469df3 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:26.725304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 372/767] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:26.725304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144682ae-979c-4445-945f-d36565469df3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:26.751946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881c410-842a-41e0-a7a1-00ff9c19caf3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:26.787951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d350fb-65b7-408f-917c-47f47716809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:26.789147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d350fb-65b7-408f-917c-47f47716809b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:26.789645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d350fb-65b7-408f-917c-47f47716809b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:26.790248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d350fb-65b7-408f-917c-47f47716809b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:26.802104 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d350fb-65b7-408f-917c-47f47716809b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:26.803793 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d350fb-65b7-408f-917c-47f47716809b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:26.819202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-32d350fb-65b7-408f-917c-47f47716809b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:26.819202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:26.819202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:26.819202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:26.819202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:26.819202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:26.819202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:26.819202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:26.819202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:26.819202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:26.819202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:26.819202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:26.819202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:26.819202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:26.819202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:26.819202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:26.820225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:26.821151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:26.821151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:26.821151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:26.823651 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 396/768] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:26.825137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b72661-7eed-47a5-a203-8de3d8f6233a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:26.825621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b72661-7eed-47a5-a203-8de3d8f6233a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:26.826217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b72661-7eed-47a5-a203-8de3d8f6233a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:26.839035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144682ae-979c-4445-945f-d36565469df3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:26.845976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d7b72661-7eed-47a5-a203-8de3d8f6233a None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:26.847536 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d7b72661-7eed-47a5-a203-8de3d8f6233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:26.875348 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611d9f1-6a19-458c-9042-b09a15155a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:26.875955 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611d9f1-6a19-458c-9042-b09a15155a1a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:26.876237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611d9f1-6a19-458c-9042-b09a15155a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:26.876506 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611d9f1-6a19-458c-9042-b09a15155a1a None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:26.877142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611d9f1-6a19-458c-9042-b09a15155a1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:26.877439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611d9f1-6a19-458c-9042-b09a15155a1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:26.878830 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611d9f1-6a19-458c-9042-b09a15155a1a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:26.893788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 373/769] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:26.893788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611d9f1-6a19-458c-9042-b09a15155a1a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:26.919535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:26.929869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 397/770] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:26.929869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b72661-7eed-47a5-a203-8de3d8f6233a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:26.929869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:27.021750 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611d9f1-6a19-458c-9042-b09a15155a1a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:27.060713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444aa08c-2ea1-4089-8545-c4955d2a5d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:27.061719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444aa08c-2ea1-4089-8545-c4955d2a5d57 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:27.062245 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444aa08c-2ea1-4089-8545-c4955d2a5d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:27.062725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444aa08c-2ea1-4089-8545-c4955d2a5d57 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:27.063736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444aa08c-2ea1-4089-8545-c4955d2a5d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:27.064244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444aa08c-2ea1-4089-8545-c4955d2a5d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:27.065883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444aa08c-2ea1-4089-8545-c4955d2a5d57 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:27.077922 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b72661-7eed-47a5-a203-8de3d8f6233a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:27.083999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 374/771] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:27.085247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444aa08c-2ea1-4089-8545-c4955d2a5d57 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:27.125272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74874c-2494-485d-b2a3-cd7aa04ddd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:27.126207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74874c-2494-485d-b2a3-cd7aa04ddd3b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:27.126499 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74874c-2494-485d-b2a3-cd7aa04ddd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:27.126786 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74874c-2494-485d-b2a3-cd7aa04ddd3b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:27.127384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74874c-2494-485d-b2a3-cd7aa04ddd3b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:27.129787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74874c-2494-485d-b2a3-cd7aa04ddd3b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-df74874c-2494-485d-b2a3-cd7aa04ddd3b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:27.144801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:27.145946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:27.145946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:27.145946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:27.145946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:27.145946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:27.145946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:27.145946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:27.145946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:27.145946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:27.145946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:27.145946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:27.145946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:27.145946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:27.145946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:27.145946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:27.145946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:27.146794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:27.146794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:27.146794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:27.146794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:27.146794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:27.146794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:27.146794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:27.146794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:27.146794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:27.146794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:27.146794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:27.146794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:27.146794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 15:10:27.146794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:27.151986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 398/772] 10.222.0.82 () {56 vars in 1129 bytes} [Fri Sep 23 15:10:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:27.153116 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74874c-2494-485d-b2a3-cd7aa04ddd3b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:27.188023 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:27.209387 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444aa08c-2ea1-4089-8545-c4955d2a5d57 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:27.240972 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:27.248505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb80fe8-6832-4834-9ed5-b40abc0270d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:27.249270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb80fe8-6832-4834-9ed5-b40abc0270d3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:27.249547 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb80fe8-6832-4834-9ed5-b40abc0270d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:27.249854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb80fe8-6832-4834-9ed5-b40abc0270d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:27.256711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb80fe8-6832-4834-9ed5-b40abc0270d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:27.258170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb80fe8-6832-4834-9ed5-b40abc0270d3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:27.270045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3cb80fe8-6832-4834-9ed5-b40abc0270d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:27.270045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:27.270045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:27.270045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:27.270045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:27.270045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:27.270045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:27.270045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:27.270045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:27.270045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:27.270045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:27.270045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:27.270045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:27.270045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:27.270045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:27.271120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:27.272289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:27.272289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:27.272289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:27.272289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:27.272289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:27.272289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:27.272289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:27.272289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:27.278915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 375/773] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:27.278915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb80fe8-6832-4834-9ed5-b40abc0270d3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:27.287912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74874c-2494-485d-b2a3-cd7aa04ddd3b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:27.323345 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac2481-7e95-402e-b758-de1143621c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:27.323973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac2481-7e95-402e-b758-de1143621c0d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:27.324244 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac2481-7e95-402e-b758-de1143621c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:27.324515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac2481-7e95-402e-b758-de1143621c0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:27.331441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac2481-7e95-402e-b758-de1143621c0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:27.333006 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac2481-7e95-402e-b758-de1143621c0d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:27.344740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c0ac2481-7e95-402e-b758-de1143621c0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:27.344740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:27.344740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:27.344740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:27.344740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:27.344740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:27.344740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:27.344740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:27.344740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:27.344740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:27.344740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:27.344740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:27.344740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:27.344740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:27.344740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:27.345876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:27.347054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:27.347054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:27.347054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:27.347054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:27.347054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:27.347054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:27.347054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:27.347054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:27.352467 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 399/774] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:27.352467 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac2481-7e95-402e-b758-de1143621c0d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:27.393316 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb80fe8-6832-4834-9ed5-b40abc0270d3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:27.433074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027c4ff-91b7-4ffa-9aae-4043da9d7870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:27.433683 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027c4ff-91b7-4ffa-9aae-4043da9d7870 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:27.433996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027c4ff-91b7-4ffa-9aae-4043da9d7870 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:27.434263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027c4ff-91b7-4ffa-9aae-4043da9d7870 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:27.434949 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027c4ff-91b7-4ffa-9aae-4043da9d7870 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:27.435272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027c4ff-91b7-4ffa-9aae-4043da9d7870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:27.436627 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027c4ff-91b7-4ffa-9aae-4043da9d7870 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:27.445591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 376/775] 10.222.0.82 () {56 vars in 1124 bytes} [Fri Sep 23 15:10:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:27.445591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027c4ff-91b7-4ffa-9aae-4043da9d7870 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:27.455240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:27.457789 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac2481-7e95-402e-b758-de1143621c0d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:27.483511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:27.492585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6d366-53c7-4b0f-9364-75b9abbad882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:27.493220 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6d366-53c7-4b0f-9364-75b9abbad882 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:27.493499 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6d366-53c7-4b0f-9364-75b9abbad882 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:27.493808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6d366-53c7-4b0f-9364-75b9abbad882 None admin] PATH_INFO: `/v3/services/network` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:27.494914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6d366-53c7-4b0f-9364-75b9abbad882 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:27.496357 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6d366-53c7-4b0f-9364-75b9abbad882 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-89a6d366-53c7-4b0f-9364-75b9abbad882 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:27.505003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:27.506288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:27.506288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:27.506288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:27.506288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:27.506288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:27.506288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:27.506288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:27.506288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:27.506288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:27.506288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:27.506288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:27.506288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:27.506288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:27.506288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:27.506288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:27.506288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:27.507327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:27.507327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:27.507327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:27.507327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:27.507327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:27.507327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:27.507327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:27.507327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:27.507327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:27.507327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:27.507327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:27.507327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:27.507327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:10:27.507327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:27.511763 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 400/776] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:27 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:27.512917 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6d366-53c7-4b0f-9364-75b9abbad882 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:27.555724 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027c4ff-91b7-4ffa-9aae-4043da9d7870 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:27.592121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e37102-2564-4e64-a8ee-19307914850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:27.592758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e37102-2564-4e64-a8ee-19307914850e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:27.593039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e37102-2564-4e64-a8ee-19307914850e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:27.593310 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e37102-2564-4e64-a8ee-19307914850e None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:27.594029 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e37102-2564-4e64-a8ee-19307914850e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:27.594335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e37102-2564-4e64-a8ee-19307914850e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:27.595758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e37102-2564-4e64-a8ee-19307914850e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:27.613061 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 377/777] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:27.613061 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e37102-2564-4e64-a8ee-19307914850e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:27.625484 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6d366-53c7-4b0f-9364-75b9abbad882 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:27.661555 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0cc10-1e3d-49c5-a89f-7c59125ac59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:27.662269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0cc10-1e3d-49c5-a89f-7c59125ac59b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:27.662606 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0cc10-1e3d-49c5-a89f-7c59125ac59b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:27.662941 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0cc10-1e3d-49c5-a89f-7c59125ac59b None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:27.663695 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0cc10-1e3d-49c5-a89f-7c59125ac59b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:27.664062 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0cc10-1e3d-49c5-a89f-7c59125ac59b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:27.665556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0cc10-1e3d-49c5-a89f-7c59125ac59b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:27.678123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 401/778] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:27.679049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0cc10-1e3d-49c5-a89f-7c59125ac59b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:27.687871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:27.724842 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e37102-2564-4e64-a8ee-19307914850e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:27.733005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:27.761856 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f4762-bbe7-4e35-b79e-c7543ef7e5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:27.762463 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f4762-bbe7-4e35-b79e-c7543ef7e5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:27.762739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f4762-bbe7-4e35-b79e-c7543ef7e5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:27.763006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f4762-bbe7-4e35-b79e-c7543ef7e5a0 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:27.763652 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f4762-bbe7-4e35-b79e-c7543ef7e5a0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:27.763949 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f4762-bbe7-4e35-b79e-c7543ef7e5a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:27.765306 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f4762-bbe7-4e35-b79e-c7543ef7e5a0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:27.770419 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 378/779] 10.222.0.82 () {56 vars in 1124 bytes} [Fri Sep 23 15:10:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:27.771198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f4762-bbe7-4e35-b79e-c7543ef7e5a0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:27.788523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0cc10-1e3d-49c5-a89f-7c59125ac59b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:27.825381 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7666013-b28f-42db-823f-9bb1da70e208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:27.825939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7666013-b28f-42db-823f-9bb1da70e208 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:27.826218 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7666013-b28f-42db-823f-9bb1da70e208 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:27.826486 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7666013-b28f-42db-823f-9bb1da70e208 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:27.827104 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7666013-b28f-42db-823f-9bb1da70e208 None admin] RBAC: Adding query filter params (name=network) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:27.827400 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7666013-b28f-42db-823f-9bb1da70e208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:27.828783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7666013-b28f-42db-823f-9bb1da70e208 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:27.833772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 402/780] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Sep 23 15:10:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:27.834471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7666013-b28f-42db-823f-9bb1da70e208 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:27.890128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f4762-bbe7-4e35-b79e-c7543ef7e5a0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:27.927115 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:27.933983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e05f5e-22f0-4455-ba5e-b09cf45f4a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:27.934596 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e05f5e-22f0-4455-ba5e-b09cf45f4a72 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:27.934871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e05f5e-22f0-4455-ba5e-b09cf45f4a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:27.935141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e05f5e-22f0-4455-ba5e-b09cf45f4a72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:27.935874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e05f5e-22f0-4455-ba5e-b09cf45f4a72 None admin] RBAC: Adding query filter params (role.id=118b4b27bab54b429c3a70924d659c72, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=94a8ee59c6b24db9a67eb44a115fae85) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:27.936167 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e05f5e-22f0-4455-ba5e-b09cf45f4a72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:27.937583 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e05f5e-22f0-4455-ba5e-b09cf45f4a72 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:27.941039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7666013-b28f-42db-823f-9bb1da70e208 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:27.942996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 379/781] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:27 2022] GET /identity/v3/role_assignments?user.id=94a8ee59c6b24db9a67eb44a115fae85&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=118b4b27bab54b429c3a70924d659c72 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:27.943747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e05f5e-22f0-4455-ba5e-b09cf45f4a72 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:27.967391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:28.003942 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f034e-bee4-454d-b0a3-d4f708ecdd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:28.005430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f034e-bee4-454d-b0a3-d4f708ecdd28 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:28.006252 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f034e-bee4-454d-b0a3-d4f708ecdd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:28.006694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f034e-bee4-454d-b0a3-d4f708ecdd28 None admin] PATH_INFO: `/v3/projects/718a472b7d564c429849b127a44aaaad/users/6dbf682960cc447099c11862afa3206b/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:28.009656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f034e-bee4-454d-b0a3-d4f708ecdd28 None admin] RBAC: Authorizing `identity:create_grant(project_id=718a472b7d564c429849b127a44aaaad, user_id=6dbf682960cc447099c11862afa3206b, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:28.011465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f034e-bee4-454d-b0a3-d4f708ecdd28 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:28.065276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e05f5e-22f0-4455-ba5e-b09cf45f4a72 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:28.100135 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f1b8d-9dd9-4a7e-a9bb-b2f4497be685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:28.100671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f1b8d-9dd9-4a7e-a9bb-b2f4497be685 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:28.100956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f1b8d-9dd9-4a7e-a9bb-b2f4497be685 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:28.101259 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f1b8d-9dd9-4a7e-a9bb-b2f4497be685 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:28.101945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f1b8d-9dd9-4a7e-a9bb-b2f4497be685 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:28.103340 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f1b8d-9dd9-4a7e-a9bb-b2f4497be685 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:28.142098 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 403/782] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:10:27 2022] PUT /identity/v3/projects/718a472b7d564c429849b127a44aaaad/users/6dbf682960cc447099c11862afa3206b/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:10:28.142996 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f034e-bee4-454d-b0a3-d4f708ecdd28 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:28.238333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 380/783] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:10:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:10:28.240038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e65e8-889a-477c-9692-ecf7f989fad7 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:28.241434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e65e8-889a-477c-9692-ecf7f989fad7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:28.241827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e65e8-889a-477c-9692-ecf7f989fad7 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:28.245727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 381/784] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:28.258264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cfaa1-5fa7-49cc-be77-a9615aff5ed0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:28.258686 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cfaa1-5fa7-49cc-be77-a9615aff5ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:28.259038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cfaa1-5fa7-49cc-be77-a9615aff5ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:28.295223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b97cfaa1-5fa7-49cc-be77-a9615aff5ed0 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:28.298623 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b97cfaa1-5fa7-49cc-be77-a9615aff5ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:28.321108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f034e-bee4-454d-b0a3-d4f708ecdd28 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:28.390118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:28.390322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e75ac-9ca6-45b1-81bf-10ed1b1e10c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:28.390322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e75ac-9ca6-45b1-81bf-10ed1b1e10c1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:28.390322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e75ac-9ca6-45b1-81bf-10ed1b1e10c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:28.390322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e75ac-9ca6-45b1-81bf-10ed1b1e10c1 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:28.391594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e75ac-9ca6-45b1-81bf-10ed1b1e10c1 None admin] RBAC: Adding query filter params (type=network) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:28.391594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e75ac-9ca6-45b1-81bf-10ed1b1e10c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:28.394763 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e75ac-9ca6-45b1-81bf-10ed1b1e10c1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:28.403863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 404/785] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Sep 23 15:10:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:28.410317 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e75ac-9ca6-45b1-81bf-10ed1b1e10c1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:28.418168 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 382/786] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:10:28.560034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:28.643498 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e75ac-9ca6-45b1-81bf-10ed1b1e10c1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:28.691568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee30d4-58a4-485a-8696-b345dd35e250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:28.692428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee30d4-58a4-485a-8696-b345dd35e250 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:28.692872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee30d4-58a4-485a-8696-b345dd35e250 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:28.693285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee30d4-58a4-485a-8696-b345dd35e250 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:28.694169 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee30d4-58a4-485a-8696-b345dd35e250 None admin] RBAC: Adding query filter params (interface=public, service_id=35ca709473444f2eacbf58cb57925ffb, region_id=RegionOne) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:28.694633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee30d4-58a4-485a-8696-b345dd35e250 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:28.696147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee30d4-58a4-485a-8696-b345dd35e250 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:28.708347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 405/787] 10.222.0.82 () {56 vars in 1251 bytes} [Fri Sep 23 15:10:28 2022] GET /identity/v3/endpoints?service_id=35ca709473444f2eacbf58cb57925ffb&interface=public®ion_id=RegionOne => generated 194 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:28.714250 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cfaa1-5fa7-49cc-be77-a9615aff5ed0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:28.745439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee30d4-58a4-485a-8696-b345dd35e250 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:28.887137 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cfaa1-5fa7-49cc-be77-a9615aff5ed0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:28.936774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:28.941577 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee30d4-58a4-485a-8696-b345dd35e250 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:28.969767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c98bc-8802-4263-a64d-b9bd0aca2dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:28.969767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c98bc-8802-4263-a64d-b9bd0aca2dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:28.969767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c98bc-8802-4263-a64d-b9bd0aca2dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:28.969767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c98bc-8802-4263-a64d-b9bd0aca2dd6 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:28.970178 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c98bc-8802-4263-a64d-b9bd0aca2dd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:28.970178 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c98bc-8802-4263-a64d-b9bd0aca2dd6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:28.977770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 383/788] 10.222.0.82 () {56 vars in 1087 bytes} [Fri Sep 23 15:10:28 2022] GET /identity/v3/services => generated 772 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:28.984639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c920a-51db-4a40-833a-55737b3312e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:28.985757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c920a-51db-4a40-833a-55737b3312e7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:28.986221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c920a-51db-4a40-833a-55737b3312e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:28.986841 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c920a-51db-4a40-833a-55737b3312e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:29.000232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c920a-51db-4a40-833a-55737b3312e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:29.006002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7f5c920a-51db-4a40-833a-55737b3312e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:10:29.006002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:29.006002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:29.006002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:29.006002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:29.006002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:29.006002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:29.006002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:29.006002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:29.006002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:29.006002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:29.006002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:29.006002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:29.006002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:29.006002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:29.006002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:29.006931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:29.006931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:29.006931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:29.006931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:29.006931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:29.006931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:29.006931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:29.006931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:29.006931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:29.006931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:29.006931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:29.006931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:29.006931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:29.006931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:29.006931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:29.006931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:29.007790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:29.007790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:29.007790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:29.007790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:29.007790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:29.007790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:29.007790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:29.007790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:29.007790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:29.007790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:29.007790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:10:29.007790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:29.010824 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 406/789] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:10:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:29.019426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c98bc-8802-4263-a64d-b9bd0aca2dd6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:29.085851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:29.163849 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c98bc-8802-4263-a64d-b9bd0aca2dd6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:29.206336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2b271-1938-48af-9e42-9d982ff909ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:29.206870 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2b271-1938-48af-9e42-9d982ff909ab None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:29.207151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2b271-1938-48af-9e42-9d982ff909ab None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:29.207420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2b271-1938-48af-9e42-9d982ff909ab None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:29.208092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2b271-1938-48af-9e42-9d982ff909ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:29.208390 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2b271-1938-48af-9e42-9d982ff909ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:29.209978 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2b271-1938-48af-9e42-9d982ff909ab None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:29.219416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 384/790] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:10:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:29.224932 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c920a-51db-4a40-833a-55737b3312e7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:29.334619 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c920a-51db-4a40-833a-55737b3312e7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:29.373704 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11270dd8-5bcd-4b45-8b4f-d9ecfed215aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:29.374363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11270dd8-5bcd-4b45-8b4f-d9ecfed215aa None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:29.374641 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11270dd8-5bcd-4b45-8b4f-d9ecfed215aa None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:29.374914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11270dd8-5bcd-4b45-8b4f-d9ecfed215aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:29.386821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11270dd8-5bcd-4b45-8b4f-d9ecfed215aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:29.388358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11270dd8-5bcd-4b45-8b4f-d9ecfed215aa None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:29.404552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-11270dd8-5bcd-4b45-8b4f-d9ecfed215aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:29.404552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:29.404552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:29.404552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:29.404552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:29.404552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:29.404552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:29.404552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:29.404552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:29.404552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:29.404552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:29.404552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:29.404552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:29.404552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:29.404552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:29.404552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:29.405566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:29.406591 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:29.406591 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:29.406591 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:29.406591 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 407/791] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:29.413070 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2b271-1938-48af-9e42-9d982ff909ab None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:29.538864 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2b271-1938-48af-9e42-9d982ff909ab None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:29.546846 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:29.573992 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9d7f4-2406-4771-b44b-3edf6d3e2ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:29.574652 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9d7f4-2406-4771-b44b-3edf6d3e2ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:29.574965 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9d7f4-2406-4771-b44b-3edf6d3e2ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:29.575267 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9d7f4-2406-4771-b44b-3edf6d3e2ac9 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:29.575914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9d7f4-2406-4771-b44b-3edf6d3e2ac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:29.576217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9d7f4-2406-4771-b44b-3edf6d3e2ac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:29.577660 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9d7f4-2406-4771-b44b-3edf6d3e2ac9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:29.594999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 385/792] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:29.601526 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11270dd8-5bcd-4b45-8b4f-d9ecfed215aa None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:29.617831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:29.852161 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11270dd8-5bcd-4b45-8b4f-d9ecfed215aa None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:29.894867 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b153ad8-4bd4-4d3f-bec0-ff02a50e793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:29.895562 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b153ad8-4bd4-4d3f-bec0-ff02a50e793d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:29.895841 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b153ad8-4bd4-4d3f-bec0-ff02a50e793d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:29.896111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b153ad8-4bd4-4d3f-bec0-ff02a50e793d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:29.909411 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b153ad8-4bd4-4d3f-bec0-ff02a50e793d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:29.910940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b153ad8-4bd4-4d3f-bec0-ff02a50e793d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:29.926821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-3b153ad8-4bd4-4d3f-bec0-ff02a50e793d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 15:10:29.926821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:29.926821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:29.926821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:29.926821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:29.926821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:29.926821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:29.926821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:29.926821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:29.926821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:29.926821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:29.926821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:29.926821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:29.926821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:29.926821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:29.926821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:29.927809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:29.928766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:29.928766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:29.928766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:29.928766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:29.928766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:29.928766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:29.928766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:29.928766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:29.928766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 15:10:29.928766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:29.931095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 408/793] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:10:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:29.937532 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9d7f4-2406-4771-b44b-3edf6d3e2ac9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:30.187058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9d7f4-2406-4771-b44b-3edf6d3e2ac9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:30.230166 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f0488-c12e-4ad4-8576-01cd82f3c1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:30.230777 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f0488-c12e-4ad4-8576-01cd82f3c1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:30.231057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f0488-c12e-4ad4-8576-01cd82f3c1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:30.231326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f0488-c12e-4ad4-8576-01cd82f3c1e6 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:30.232052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f0488-c12e-4ad4-8576-01cd82f3c1e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:30.232358 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f0488-c12e-4ad4-8576-01cd82f3c1e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:30.233834 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f0488-c12e-4ad4-8576-01cd82f3c1e6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:30.253137 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 386/794] 10.222.0.82 () {56 vars in 1135 bytes} [Fri Sep 23 15:10:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:30.258833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b153ad8-4bd4-4d3f-bec0-ff02a50e793d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:30.353030 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:30.384932 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b153ad8-4bd4-4d3f-bec0-ff02a50e793d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:30.422767 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbf61a-7ae3-4560-95ac-12bc8efdf48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:30.423499 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbf61a-7ae3-4560-95ac-12bc8efdf48a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:30.423782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbf61a-7ae3-4560-95ac-12bc8efdf48a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:30.424051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbf61a-7ae3-4560-95ac-12bc8efdf48a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:30.437842 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbf61a-7ae3-4560-95ac-12bc8efdf48a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:30.439506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbf61a-7ae3-4560-95ac-12bc8efdf48a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:30.457117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-77fbf61a-7ae3-4560-95ac-12bc8efdf48a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:30.457117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:30.457117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:30.457117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:30.457117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:30.457117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:30.457117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:30.457117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:30.457117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:30.457117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:30.457117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:30.457117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:30.457117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:30.457117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:30.457117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:30.457117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:30.458166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:30.459061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:30.459061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:30.459061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:30.459061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 409/795] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:30.468512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f0488-c12e-4ad4-8576-01cd82f3c1e6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:30.502186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:30.556262 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6b87d-caae-4165-b990-afd4ff39144c None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:30.556914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6b87d-caae-4165-b990-afd4ff39144c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:30.557405 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6b87d-caae-4165-b990-afd4ff39144c None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:30.559218 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 410/796] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:10:30.564606 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387f48c-8348-4ef8-b28b-00af17efa86e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:30.565187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387f48c-8348-4ef8-b28b-00af17efa86e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:30.565521 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387f48c-8348-4ef8-b28b-00af17efa86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:30.584597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5387f48c-8348-4ef8-b28b-00af17efa86e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:30.586056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5387f48c-8348-4ef8-b28b-00af17efa86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:30.614118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f0488-c12e-4ad4-8576-01cd82f3c1e6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:30.672417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc509c5-f3bd-4a72-bb71-388e274e4735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:30.673029 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc509c5-f3bd-4a72-bb71-388e274e4735 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:30.673303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc509c5-f3bd-4a72-bb71-388e274e4735 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:30.673587 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc509c5-f3bd-4a72-bb71-388e274e4735 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:30.674223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc509c5-f3bd-4a72-bb71-388e274e4735 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:30.674518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc509c5-f3bd-4a72-bb71-388e274e4735 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:30.677744 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc509c5-f3bd-4a72-bb71-388e274e4735 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:30.701694 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 387/797] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:30.710721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc509c5-f3bd-4a72-bb71-388e274e4735 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:30.717111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 411/798] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:10:30.799682 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:30.816394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc509c5-f3bd-4a72-bb71-388e274e4735 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:30.856327 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96c508-fb6a-4343-8264-5dd9e5618421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:30.856972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96c508-fb6a-4343-8264-5dd9e5618421 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:30.857252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96c508-fb6a-4343-8264-5dd9e5618421 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:30.857523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96c508-fb6a-4343-8264-5dd9e5618421 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:30.864724 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96c508-fb6a-4343-8264-5dd9e5618421 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:30.866193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96c508-fb6a-4343-8264-5dd9e5618421 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:30.882220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3c96c508-fb6a-4343-8264-5dd9e5618421 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:30.882220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:30.882220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:30.882220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:30.882220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:30.882220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:30.882220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:30.882220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:30.882220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:30.882220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:30.882220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:30.882220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:30.882220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:30.882220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:30.882220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:30.883143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:30.884050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:30.884050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:30.884050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:30.884050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:30.884050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:30.884050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:30.884050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:30.884050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:30.888653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 388/799] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:30.889650 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387f48c-8348-4ef8-b28b-00af17efa86e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:30.995310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:31.066291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387f48c-8348-4ef8-b28b-00af17efa86e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:31.091737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5007c-9105-441d-b370-b8824df93d76 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.092386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5007c-9105-441d-b370-b8824df93d76 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.092890 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5007c-9105-441d-b370-b8824df93d76 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.094833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 389/800] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:10:31.100743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e40d4-47b5-4069-970e-91745804730d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.101331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e40d4-47b5-4069-970e-91745804730d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.101868 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e40d4-47b5-4069-970e-91745804730d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.108615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d54cac-f4b3-4f36-a6aa-e1fc2db77be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:31.109256 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d54cac-f4b3-4f36-a6aa-e1fc2db77be0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.109523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d54cac-f4b3-4f36-a6aa-e1fc2db77be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.109836 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d54cac-f4b3-4f36-a6aa-e1fc2db77be0 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.110546 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d54cac-f4b3-4f36-a6aa-e1fc2db77be0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:31.110853 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d54cac-f4b3-4f36-a6aa-e1fc2db77be0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:31.112340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d54cac-f4b3-4f36-a6aa-e1fc2db77be0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:31.124086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f08e40d4-47b5-4069-970e-91745804730d None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:31.125639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f08e40d4-47b5-4069-970e-91745804730d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:31.126061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 412/801] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:31.126919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d54cac-f4b3-4f36-a6aa-e1fc2db77be0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:31.205347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 390/802] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:10:31.206204 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e40d4-47b5-4069-970e-91745804730d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:31.255773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d54cac-f4b3-4f36-a6aa-e1fc2db77be0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:31.273371 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:31.302850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:31.303037 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4f9bd-9d9e-4b25-afe2-1174f869020f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:31.303516 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4f9bd-9d9e-4b25-afe2-1174f869020f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.303790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4f9bd-9d9e-4b25-afe2-1174f869020f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.304304 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4f9bd-9d9e-4b25-afe2-1174f869020f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.319070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4f9bd-9d9e-4b25-afe2-1174f869020f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:31.326071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-00a4f9bd-9d9e-4b25-afe2-1174f869020f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:31.326071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:31.326071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:31.326071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:31.326071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:31.326071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:31.326071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:31.326071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:31.326071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:31.326071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:31.326071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:31.326071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:31.326071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:31.326071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:31.326071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:31.326071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:31.327007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:31.327007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:31.327007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:31.327007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:31.327007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:31.327007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:31.327007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:31.327007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:31.327007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:31.327007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:31.327007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:31.327007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:31.327007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:31.327007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:31.327007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:31.327007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:31.327858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:31.327858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:31.327858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:31.327858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:31.327858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:31.327858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:31.327858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:31.327858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:31.327858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:31.327858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:31.327858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:31.327858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:31.331052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 413/803] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:10:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:31.332408 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ad2c2-1001-43ac-8eb7-68dd51daafc5 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.332814 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ad2c2-1001-43ac-8eb7-68dd51daafc5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.333228 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ad2c2-1001-43ac-8eb7-68dd51daafc5 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.339956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 414/804] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:31.339956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ad2c2-1001-43ac-8eb7-68dd51daafc5 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:31.341835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e40d4-47b5-4069-970e-91745804730d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:31.386531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9e4a6-ffb1-495f-995c-7a7e57ed59f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:31.387250 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9e4a6-ffb1-495f-995c-7a7e57ed59f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.387530 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9e4a6-ffb1-495f-995c-7a7e57ed59f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.387836 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9e4a6-ffb1-495f-995c-7a7e57ed59f1 None admin] PATH_INFO: `/v3/projects/718a472b7d564c429849b127a44aaaad/users/b22406c522e149d8bc462ff2feeec44c/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.389906 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9e4a6-ffb1-495f-995c-7a7e57ed59f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=718a472b7d564c429849b127a44aaaad, user_id=b22406c522e149d8bc462ff2feeec44c, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:31.391445 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9e4a6-ffb1-495f-995c-7a7e57ed59f1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:31.475967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ad2c2-1001-43ac-8eb7-68dd51daafc5 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:31.510051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 391/805] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:10:31 2022] PUT /identity/v3/projects/718a472b7d564c429849b127a44aaaad/users/b22406c522e149d8bc462ff2feeec44c/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:10:31.511589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3efae-17d7-4720-a363-40739339ed41 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.513376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3efae-17d7-4720-a363-40739339ed41 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.513685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3efae-17d7-4720-a363-40739339ed41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.531727 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01ba20-b0dd-4ddc-99a5-0bfa037a566f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:31.532356 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01ba20-b0dd-4ddc-99a5-0bfa037a566f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.532635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01ba20-b0dd-4ddc-99a5-0bfa037a566f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.532905 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01ba20-b0dd-4ddc-99a5-0bfa037a566f None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.533606 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01ba20-b0dd-4ddc-99a5-0bfa037a566f None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:31.533944 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01ba20-b0dd-4ddc-99a5-0bfa037a566f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:31.535534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01ba20-b0dd-4ddc-99a5-0bfa037a566f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:31.538680 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2cc3efae-17d7-4720-a363-40739339ed41 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:31.540317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2cc3efae-17d7-4720-a363-40739339ed41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:31.546594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 415/806] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:10:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:31.547410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01ba20-b0dd-4ddc-99a5-0bfa037a566f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:31.603112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:31.642070 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 392/807] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:31.644291 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3efae-17d7-4720-a363-40739339ed41 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:31.697880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01ba20-b0dd-4ddc-99a5-0bfa037a566f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:31.747892 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:31.756962 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f41c3-5324-4701-8f2e-35d9ae9747e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:31.757592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f41c3-5324-4701-8f2e-35d9ae9747e5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.757907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f41c3-5324-4701-8f2e-35d9ae9747e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.758232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f41c3-5324-4701-8f2e-35d9ae9747e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.770235 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f41c3-5324-4701-8f2e-35d9ae9747e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:31.775884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-779f41c3-5324-4701-8f2e-35d9ae9747e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:10:31.775884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:31.775884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:31.775884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:31.775884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:31.775884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:31.775884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:31.775884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:31.775884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:31.775884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:31.775884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:31.775884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:31.775884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:31.775884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:31.775884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:31.775884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:31.776833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:31.776833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:31.776833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:31.776833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:31.776833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:31.776833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:31.776833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:31.776833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:31.776833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:31.776833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:31.776833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:31.776833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:31.776833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:31.776833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:31.776833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:31.776833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:31.778071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:31.778071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:31.778071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:31.778071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:31.778071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:31.778071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:31.778071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:31.778071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:31.778071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:31.778071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:31.778071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:10:31.778071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:31.778071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 416/808] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:10:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:31.778952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafc06f-8f27-48d5-8066-17799fc239f6 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.778952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafc06f-8f27-48d5-8066-17799fc239f6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.779130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafc06f-8f27-48d5-8066-17799fc239f6 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.780286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 417/809] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:31.785170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafc06f-8f27-48d5-8066-17799fc239f6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:31.791251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3efae-17d7-4720-a363-40739339ed41 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:31.832816 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859861d-04c5-4a40-8c1a-c3944b2635f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:31.835019 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859861d-04c5-4a40-8c1a-c3944b2635f1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.835019 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859861d-04c5-4a40-8c1a-c3944b2635f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.835019 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859861d-04c5-4a40-8c1a-c3944b2635f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.844684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859861d-04c5-4a40-8c1a-c3944b2635f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:31.846145 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859861d-04c5-4a40-8c1a-c3944b2635f1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:31.865757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c859861d-04c5-4a40-8c1a-c3944b2635f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:31.865757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:31.865757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:31.865757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:31.865757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:31.865757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:31.865757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:31.865757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:31.865757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:31.865757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:31.865757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:31.865757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:31.865757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:31.865757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:31.865757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:31.865757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:31.867042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:31.868205 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:31.868205 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:31.868205 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:31.868205 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 393/810] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:31.868625 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b87127-35e6-4e77-8631-d0b53c468883 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.869379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b87127-35e6-4e77-8631-d0b53c468883 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.869668 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b87127-35e6-4e77-8631-d0b53c468883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.894027 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-87b87127-35e6-4e77-8631-d0b53c468883 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:31.895875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-87b87127-35e6-4e77-8631-d0b53c468883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:31.904616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:31.912397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafc06f-8f27-48d5-8066-17799fc239f6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:31.951829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b04ada-980a-4247-867d-3e5949ccf0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:31.952924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b04ada-980a-4247-867d-3e5949ccf0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:31.953207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b04ada-980a-4247-867d-3e5949ccf0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:31.953481 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b04ada-980a-4247-867d-3e5949ccf0b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:31.954501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b04ada-980a-4247-867d-3e5949ccf0b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:31.954974 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b04ada-980a-4247-867d-3e5949ccf0b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:31.956361 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b04ada-980a-4247-867d-3e5949ccf0b5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:31.965580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 418/811] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:10:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:31.966440 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b04ada-980a-4247-867d-3e5949ccf0b5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:31.992123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 394/812] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:31.992123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b87127-35e6-4e77-8631-d0b53c468883 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:32.040027 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:32.077249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b04ada-980a-4247-867d-3e5949ccf0b5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:32.108208 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b87127-35e6-4e77-8631-d0b53c468883 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:32.115073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76b9a2-25ce-486a-a143-6457a8ddbf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:32.115682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76b9a2-25ce-486a-a143-6457a8ddbf4d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:32.115962 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76b9a2-25ce-486a-a143-6457a8ddbf4d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:32.116367 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76b9a2-25ce-486a-a143-6457a8ddbf4d None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:32.117016 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76b9a2-25ce-486a-a143-6457a8ddbf4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:32.117319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76b9a2-25ce-486a-a143-6457a8ddbf4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:32.118978 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76b9a2-25ce-486a-a143-6457a8ddbf4d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:32.132735 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 419/813] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:32.133588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76b9a2-25ce-486a-a143-6457a8ddbf4d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:32.147321 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41796a98-d575-4695-ab12-ab124f63fb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:32.148308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41796a98-d575-4695-ab12-ab124f63fb0d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:32.148789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41796a98-d575-4695-ab12-ab124f63fb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:32.149528 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41796a98-d575-4695-ab12-ab124f63fb0d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:32.150874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41796a98-d575-4695-ab12-ab124f63fb0d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:32.152912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:32.153398 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41796a98-d575-4695-ab12-ab124f63fb0d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-41796a98-d575-4695-ab12-ab124f63fb0d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:32.164518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:32.169715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:32.169715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:32.169715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:32.169715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:32.169715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:32.169715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:32.169715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:32.169715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:32.169715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:32.169715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:32.169715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:32.169715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:32.169715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:32.169715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:32.169715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:32.169715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:32.170932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:32.170932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:32.170932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:32.170932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:32.170932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:32.170932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:32.170932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:32.170932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:32.170932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:32.170932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:32.170932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:32.170932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:32.170932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:10:32.170932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:32.170932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 395/814] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:10:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:32.171765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41796a98-d575-4695-ab12-ab124f63fb0d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:32.268669 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76b9a2-25ce-486a-a143-6457a8ddbf4d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:32.287371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41796a98-d575-4695-ab12-ab124f63fb0d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:32.299738 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:32.312656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48926f0c-5570-4478-9426-ed5c78d2b4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:32.313296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48926f0c-5570-4478-9426-ed5c78d2b4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:32.315645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48926f0c-5570-4478-9426-ed5c78d2b4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:32.315645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48926f0c-5570-4478-9426-ed5c78d2b4c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:32.325195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48926f0c-5570-4478-9426-ed5c78d2b4c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:32.325905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3a93a-dc65-4317-853e-d0838ebb8a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:32.326696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48926f0c-5570-4478-9426-ed5c78d2b4c8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:32.326871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3a93a-dc65-4317-853e-d0838ebb8a6c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:32.327287 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3a93a-dc65-4317-853e-d0838ebb8a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:32.327717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3a93a-dc65-4317-853e-d0838ebb8a6c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:32.336869 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3a93a-dc65-4317-853e-d0838ebb8a6c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:32.338934 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3a93a-dc65-4317-853e-d0838ebb8a6c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:32.342594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-48926f0c-5570-4478-9426-ed5c78d2b4c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:32.342594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:32.342594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:32.342594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:32.342594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:32.342594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:32.342594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:32.342594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:32.342594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:32.342594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:32.342594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:32.342594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:32.342594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:32.342594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:32.342594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:32.342594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:32.343576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:32.344468 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:32.344468 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:32.344468 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:32.348375 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 420/815] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:32.349096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48926f0c-5570-4478-9426-ed5c78d2b4c8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:32.351209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-2ec3a93a-dc65-4317-853e-d0838ebb8a6c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 15:10:32.351209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:32.351209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:32.351209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:32.351209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:32.351209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:32.351209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:32.351209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:32.351209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:32.351209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:32.351209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:32.351209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:32.351209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:32.351209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:32.351209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:32.351209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:32.352111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:32.353049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:32.353049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:32.353049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:32.353049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:32.353049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:32.353049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:32.353049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:32.353049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:32.353049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 15:10:32.353049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:32.353049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 396/816] 10.222.0.82 () {56 vars in 1117 bytes} [Fri Sep 23 15:10:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:32.355166 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3a93a-dc65-4317-853e-d0838ebb8a6c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:32.420970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:32.455541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48926f0c-5570-4478-9426-ed5c78d2b4c8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:32.461487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3a93a-dc65-4317-853e-d0838ebb8a6c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:32.492977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2f726-6e44-48c2-9ee7-b267d8144930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:32.493615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2f726-6e44-48c2-9ee7-b267d8144930 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:32.493984 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2f726-6e44-48c2-9ee7-b267d8144930 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:32.494223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2f726-6e44-48c2-9ee7-b267d8144930 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:32.494873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2f726-6e44-48c2-9ee7-b267d8144930 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:32.495182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2f726-6e44-48c2-9ee7-b267d8144930 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:32.496607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2f726-6e44-48c2-9ee7-b267d8144930 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:32.498126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c12cc-8053-4bd5-82ae-e2d930e2dd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:32.498784 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c12cc-8053-4bd5-82ae-e2d930e2dd8d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:32.499059 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c12cc-8053-4bd5-82ae-e2d930e2dd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:32.499355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c12cc-8053-4bd5-82ae-e2d930e2dd8d None admin] PATH_INFO: `/v3/services/network` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:32.499933 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c12cc-8053-4bd5-82ae-e2d930e2dd8d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:32.501343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c12cc-8053-4bd5-82ae-e2d930e2dd8d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:32.508846 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 421/817] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:10:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:32.508846 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2f726-6e44-48c2-9ee7-b267d8144930 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-b63c12cc-8053-4bd5-82ae-e2d930e2dd8d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:32.516877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:32.518107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:32.518107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:32.518107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:32.518107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:32.518107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:32.518107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:32.518107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:32.518107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:32.518107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:32.518107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:32.518107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:32.518107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:32.518107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:32.518107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:32.518107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:32.518107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:32.520173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:32.520173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:32.520173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:32.520173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:32.520173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:32.520173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:32.520173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:32.520173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:32.520173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:32.520173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:32.520173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:32.520173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:32.520173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 15:10:32.520173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:32.520173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 397/818] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:32 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:32.521032 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c12cc-8053-4bd5-82ae-e2d930e2dd8d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:32.556665 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:32.617912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2f726-6e44-48c2-9ee7-b267d8144930 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:32.624559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c12cc-8053-4bd5-82ae-e2d930e2dd8d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:32.647425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:32.653183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d13fef-3a06-445f-9a75-cc7d424a47c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:32.653701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d13fef-3a06-445f-9a75-cc7d424a47c5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:32.654039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d13fef-3a06-445f-9a75-cc7d424a47c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:32.654367 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d13fef-3a06-445f-9a75-cc7d424a47c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:32.655013 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d13fef-3a06-445f-9a75-cc7d424a47c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:32.655318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d13fef-3a06-445f-9a75-cc7d424a47c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:32.656761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d13fef-3a06-445f-9a75-cc7d424a47c5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:32.663266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecddd6-06bf-4859-9347-cc8cc52fcaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:32.663872 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecddd6-06bf-4859-9347-cc8cc52fcaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:32.664147 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecddd6-06bf-4859-9347-cc8cc52fcaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:32.664421 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecddd6-06bf-4859-9347-cc8cc52fcaf5 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:32.665141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecddd6-06bf-4859-9347-cc8cc52fcaf5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:32.665442 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecddd6-06bf-4859-9347-cc8cc52fcaf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:32.667738 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecddd6-06bf-4859-9347-cc8cc52fcaf5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:32.670000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 422/819] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:32.675072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d13fef-3a06-445f-9a75-cc7d424a47c5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:32.686872 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 398/820] 10.222.0.82 () {56 vars in 1149 bytes} [Fri Sep 23 15:10:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:32.687584 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecddd6-06bf-4859-9347-cc8cc52fcaf5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:32.782725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d13fef-3a06-445f-9a75-cc7d424a47c5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:32.784346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:32.798941 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecddd6-06bf-4859-9347-cc8cc52fcaf5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:32.819011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8937d-42ff-48e2-91f9-f8579c5c714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:32.819961 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8937d-42ff-48e2-91f9-f8579c5c714b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:32.820249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8937d-42ff-48e2-91f9-f8579c5c714b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:32.820524 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8937d-42ff-48e2-91f9-f8579c5c714b None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:32.821160 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8937d-42ff-48e2-91f9-f8579c5c714b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:32.821465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8937d-42ff-48e2-91f9-f8579c5c714b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:32.823452 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8937d-42ff-48e2-91f9-f8579c5c714b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:32.828129 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 423/821] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:10:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:32.828951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8937d-42ff-48e2-91f9-f8579c5c714b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:32.858248 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b8a35-3da6-4627-a575-2abd408cbe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:32.860092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b8a35-3da6-4627-a575-2abd408cbe01 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:32.860626 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b8a35-3da6-4627-a575-2abd408cbe01 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:32.861267 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b8a35-3da6-4627-a575-2abd408cbe01 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:32.862346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b8a35-3da6-4627-a575-2abd408cbe01 None admin] RBAC: Adding query filter params (name=network) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:32.862886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b8a35-3da6-4627-a575-2abd408cbe01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:32.865724 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b8a35-3da6-4627-a575-2abd408cbe01 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:32.878411 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 399/822] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Sep 23 15:10:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:32.880817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b8a35-3da6-4627-a575-2abd408cbe01 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:32.907422 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:32.958098 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8937d-42ff-48e2-91f9-f8579c5c714b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:33.011194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db35485-0426-46b2-826d-63d6d2d2f951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:33.011848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db35485-0426-46b2-826d-63d6d2d2f951 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:33.012112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db35485-0426-46b2-826d-63d6d2d2f951 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:33.012923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db35485-0426-46b2-826d-63d6d2d2f951 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:33.021069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db35485-0426-46b2-826d-63d6d2d2f951 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:33.022670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db35485-0426-46b2-826d-63d6d2d2f951 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:33.029161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b8a35-3da6-4627-a575-2abd408cbe01 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:33.039629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8db35485-0426-46b2-826d-63d6d2d2f951 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:10:33.039629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:33.039629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:33.039629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:33.039629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:33.039629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:33.039629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:33.039629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:33.039629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:33.039629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:33.039629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:33.039629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:33.039629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:33.039629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:33.039629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:33.039629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:33.040587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:33.041893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:33.041893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:33.041893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:33.041893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:33.041893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:33.041893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:33.041893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:33.041893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:33.041893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:10:33.041893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:33.044077 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 424/823] 10.222.0.82 () {56 vars in 1093 bytes} [Fri Sep 23 15:10:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:33.045065 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db35485-0426-46b2-826d-63d6d2d2f951 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:33.075872 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523d65c-aea7-4ca5-bb5e-b0fbc6218a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:33.076433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523d65c-aea7-4ca5-bb5e-b0fbc6218a30 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:33.076713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523d65c-aea7-4ca5-bb5e-b0fbc6218a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:33.076987 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523d65c-aea7-4ca5-bb5e-b0fbc6218a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:33.088620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523d65c-aea7-4ca5-bb5e-b0fbc6218a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:33.090167 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523d65c-aea7-4ca5-bb5e-b0fbc6218a30 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:33.107266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e523d65c-aea7-4ca5-bb5e-b0fbc6218a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:33.107266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:33.107266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:33.107266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:33.107266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:33.107266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:33.107266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:33.107266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:33.107266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:33.107266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:33.107266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:33.107266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:33.107266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:33.107266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:33.107266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:33.107266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:33.108284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:33.109206 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:33.109206 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:33.109206 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:33.112094 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 400/824] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:33.113091 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523d65c-aea7-4ca5-bb5e-b0fbc6218a30 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:33.127223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:33.155957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db35485-0426-46b2-826d-63d6d2d2f951 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:33.174452 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:33.193781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a338b3-b1b2-4348-bd0c-59bee1208a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:33.194739 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a338b3-b1b2-4348-bd0c-59bee1208a50 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:33.195231 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a338b3-b1b2-4348-bd0c-59bee1208a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:33.195701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a338b3-b1b2-4348-bd0c-59bee1208a50 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:33.196478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a338b3-b1b2-4348-bd0c-59bee1208a50 None admin] RBAC: Adding query filter params (type=network) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:33.196871 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a338b3-b1b2-4348-bd0c-59bee1208a50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:33.198936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a338b3-b1b2-4348-bd0c-59bee1208a50 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:33.209003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 425/825] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Sep 23 15:10:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:33.210372 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a338b3-b1b2-4348-bd0c-59bee1208a50 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:33.250154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523d65c-aea7-4ca5-bb5e-b0fbc6218a30 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:33.289048 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6286fcf-b3e1-4b6c-9094-8f74b9d7b257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:33.290228 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6286fcf-b3e1-4b6c-9094-8f74b9d7b257 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:33.290707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6286fcf-b3e1-4b6c-9094-8f74b9d7b257 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:33.291141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6286fcf-b3e1-4b6c-9094-8f74b9d7b257 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:33.292263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6286fcf-b3e1-4b6c-9094-8f74b9d7b257 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:33.292975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6286fcf-b3e1-4b6c-9094-8f74b9d7b257 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:33.295335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6286fcf-b3e1-4b6c-9094-8f74b9d7b257 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:33.322726 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 401/826] 10.222.0.82 () {56 vars in 1133 bytes} [Fri Sep 23 15:10:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:33.326936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6286fcf-b3e1-4b6c-9094-8f74b9d7b257 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:33.337055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a338b3-b1b2-4348-bd0c-59bee1208a50 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:33.373579 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21754165-3628-4af5-9d8c-0d3d92f4f45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:33.374296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21754165-3628-4af5-9d8c-0d3d92f4f45f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:33.374584 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21754165-3628-4af5-9d8c-0d3d92f4f45f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:33.374859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21754165-3628-4af5-9d8c-0d3d92f4f45f None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:33.375510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21754165-3628-4af5-9d8c-0d3d92f4f45f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:33.375814 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21754165-3628-4af5-9d8c-0d3d92f4f45f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:33.377941 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21754165-3628-4af5-9d8c-0d3d92f4f45f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:33.395075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 426/827] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:33.395075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21754165-3628-4af5-9d8c-0d3d92f4f45f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:33.428044 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:33.440349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:33.476587 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6286fcf-b3e1-4b6c-9094-8f74b9d7b257 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:33.502350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21754165-3628-4af5-9d8c-0d3d92f4f45f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:33.528929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a68d99-9cde-4520-90f5-26dc296e54f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:33.530092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a68d99-9cde-4520-90f5-26dc296e54f2 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:33.530515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a68d99-9cde-4520-90f5-26dc296e54f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:33.531174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a68d99-9cde-4520-90f5-26dc296e54f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:33.532423 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a68d99-9cde-4520-90f5-26dc296e54f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:33.534531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a68d99-9cde-4520-90f5-26dc296e54f2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:33.544646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc818ec-9a72-4e7f-961d-157b4040ec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:33.545460 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc818ec-9a72-4e7f-961d-157b4040ec17 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:33.546049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc818ec-9a72-4e7f-961d-157b4040ec17 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:33.546477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc818ec-9a72-4e7f-961d-157b4040ec17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:33.617790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc818ec-9a72-4e7f-961d-157b4040ec17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:33.619725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc818ec-9a72-4e7f-961d-157b4040ec17 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:33.634753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 402/828] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:10:33 2022] POST /identity/v3/endpoints => generated 337 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:10:33.634964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a68d99-9cde-4520-90f5-26dc296e54f2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:33.696789 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:33.803720 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 427/829] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:10:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:10:33.805486 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563ae2c-ea51-4f31-8d53-b367d645d72f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:33.806007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563ae2c-ea51-4f31-8d53-b367d645d72f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:33.807286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563ae2c-ea51-4f31-8d53-b367d645d72f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:33.809211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 428/830] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:33.810495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563ae2c-ea51-4f31-8d53-b367d645d72f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:33.866033 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a68d99-9cde-4520-90f5-26dc296e54f2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:33.890241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:33.911854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef9b63-7b7b-4165-b19b-9cdb11ae62b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:33.912952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef9b63-7b7b-4165-b19b-9cdb11ae62b6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:33.913348 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef9b63-7b7b-4165-b19b-9cdb11ae62b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:33.913690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef9b63-7b7b-4165-b19b-9cdb11ae62b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:33.921709 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef9b63-7b7b-4165-b19b-9cdb11ae62b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:33.923526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef9b63-7b7b-4165-b19b-9cdb11ae62b6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:33.937414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c7ef9b63-7b7b-4165-b19b-9cdb11ae62b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:33.937414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:33.937414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:33.937414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:33.937414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:33.937414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:33.937414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:33.937414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:33.937414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:33.937414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:33.937414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:33.937414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:33.937414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:33.937414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:33.937414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:33.938433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:33.939369 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:33.939369 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:33.939369 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:33.939369 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:33.939369 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:33.939369 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:33.939369 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:33.939369 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:33.939823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 403/831] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:33.940916 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc7a16-fcb6-4eda-859b-5ab88a8dcdb7 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:33.941500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc7a16-fcb6-4eda-859b-5ab88a8dcdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:33.941500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc7a16-fcb6-4eda-859b-5ab88a8dcdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:33.955884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563ae2c-ea51-4f31-8d53-b367d645d72f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:33.968706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d2dc7a16-fcb6-4eda-859b-5ab88a8dcdb7 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:33.968706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d2dc7a16-fcb6-4eda-859b-5ab88a8dcdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:34.007413 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386352d7-b105-438b-b780-4148990a10a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:34.008924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386352d7-b105-438b-b780-4148990a10a9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:34.009255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386352d7-b105-438b-b780-4148990a10a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:34.009505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386352d7-b105-438b-b780-4148990a10a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:34.020057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:34.022283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386352d7-b105-438b-b780-4148990a10a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:34.023778 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386352d7-b105-438b-b780-4148990a10a9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:34.039728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-386352d7-b105-438b-b780-4148990a10a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:34.039728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:34.039728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:34.039728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:34.039728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:34.039728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:34.039728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:34.039728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:34.039728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:34.039728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:34.039728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:34.039728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:34.039728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:34.039728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:34.039728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:34.039728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:34.046730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:34.047703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:34.047703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:34.047703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:34.047703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 429/832] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:34.047703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386352d7-b105-438b-b780-4148990a10a9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:34.048049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 404/833] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:34.049688 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc7a16-fcb6-4eda-859b-5ab88a8dcdb7 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:34.160741 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386352d7-b105-438b-b780-4148990a10a9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:34.190227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc7a16-fcb6-4eda-859b-5ab88a8dcdb7 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:34.201400 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:34.201987 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a99431-3a12-4eaa-a557-8d3fe6b9b72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:34.202691 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a99431-3a12-4eaa-a557-8d3fe6b9b72a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:34.202971 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a99431-3a12-4eaa-a557-8d3fe6b9b72a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:34.203243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a99431-3a12-4eaa-a557-8d3fe6b9b72a None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:34.204310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a99431-3a12-4eaa-a557-8d3fe6b9b72a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:34.204621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a99431-3a12-4eaa-a557-8d3fe6b9b72a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:34.206587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a99431-3a12-4eaa-a557-8d3fe6b9b72a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:34.224225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 430/834] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:34.230633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a99431-3a12-4eaa-a557-8d3fe6b9b72a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:34.236262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd023c-d791-44fe-beb4-52473f8d88d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:34.237142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd023c-d791-44fe-beb4-52473f8d88d8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:34.237707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd023c-d791-44fe-beb4-52473f8d88d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:34.238228 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd023c-d791-44fe-beb4-52473f8d88d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:34.239104 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd023c-d791-44fe-beb4-52473f8d88d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:34.240127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd023c-d791-44fe-beb4-52473f8d88d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:34.242217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd023c-d791-44fe-beb4-52473f8d88d8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:34.259794 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 405/835] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:34.264747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd023c-d791-44fe-beb4-52473f8d88d8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:34.289838 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:34.349854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a99431-3a12-4eaa-a557-8d3fe6b9b72a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:34.376765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd023c-d791-44fe-beb4-52473f8d88d8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:34.384934 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb1309-77f0-48d9-951d-02fb3ea12647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:34.385592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb1309-77f0-48d9-951d-02fb3ea12647 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:34.385904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb1309-77f0-48d9-951d-02fb3ea12647 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:34.386179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb1309-77f0-48d9-951d-02fb3ea12647 None admin] PATH_INFO: `/v3/projects/718a472b7d564c429849b127a44aaaad/users/94a8ee59c6b24db9a67eb44a115fae85/roles/118b4b27bab54b429c3a70924d659c72` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:34.401417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb1309-77f0-48d9-951d-02fb3ea12647 None admin] RBAC: Authorizing `identity:create_grant(project_id=718a472b7d564c429849b127a44aaaad, user_id=94a8ee59c6b24db9a67eb44a115fae85, role_id=118b4b27bab54b429c3a70924d659c72)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:34.402895 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb1309-77f0-48d9-951d-02fb3ea12647 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:34.413467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041ef01-d59b-42c7-8a65-57ee15ebcae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:34.414076 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041ef01-d59b-42c7-8a65-57ee15ebcae1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:34.414357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041ef01-d59b-42c7-8a65-57ee15ebcae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:34.414681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041ef01-d59b-42c7-8a65-57ee15ebcae1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:34.421620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041ef01-d59b-42c7-8a65-57ee15ebcae1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:34.423102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041ef01-d59b-42c7-8a65-57ee15ebcae1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:34.434157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e041ef01-d59b-42c7-8a65-57ee15ebcae1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:34.434157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:34.434157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:34.434157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:34.434157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:34.434157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:34.434157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:34.434157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:34.434157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:34.434157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:34.434157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:34.434157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:34.434157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:34.434157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:34.434157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:34.435092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:34.436424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:34.436424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:34.436424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:34.436424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:34.436424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:34.436424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:34.436424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:34.436424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:34.436424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 406/836] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:34.436424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041ef01-d59b-42c7-8a65-57ee15ebcae1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:34.467568 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:34.497986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 431/837] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:10:34 2022] PUT /identity/v3/projects/718a472b7d564c429849b127a44aaaad/users/94a8ee59c6b24db9a67eb44a115fae85/roles/118b4b27bab54b429c3a70924d659c72 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:10:34.498940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb1309-77f0-48d9-951d-02fb3ea12647 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:34.572798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041ef01-d59b-42c7-8a65-57ee15ebcae1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:34.614963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ae38a-c1d5-46d3-9158-93d0133b765c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:34.615788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ae38a-c1d5-46d3-9158-93d0133b765c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:34.616663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ae38a-c1d5-46d3-9158-93d0133b765c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:34.616663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ae38a-c1d5-46d3-9158-93d0133b765c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:34.628956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ae38a-c1d5-46d3-9158-93d0133b765c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:34.634191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-069ae38a-c1d5-46d3-9158-93d0133b765c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:10:34.634191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:34.634191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:34.634191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:34.634191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:34.634191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:34.634191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:34.634191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:34.634191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:34.634191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:34.634191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:34.634191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:34.634191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:34.634191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:34.634191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:34.634191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:34.635450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:34.635450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:34.635450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:34.635450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:34.635450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:34.635450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:34.635450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:34.635450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:34.635450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:34.635450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:34.635450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:34.635450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:34.635450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:34.635450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:34.635450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:34.635450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:34.636504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:34.636504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:34.636504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:34.636504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:34.636504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:34.636504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:34.636504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:34.636504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:34.636504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:34.636504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:34.636504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:10:34.636504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:34.638421 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 407/838] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:34.643951 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ae38a-c1d5-46d3-9158-93d0133b765c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:34.655074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb1309-77f0-48d9-951d-02fb3ea12647 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:34.657134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:34.704132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb583905-e8c2-40cd-9498-75e65c93083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:34.704787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb583905-e8c2-40cd-9498-75e65c93083f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:34.705107 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb583905-e8c2-40cd-9498-75e65c93083f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:34.705380 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb583905-e8c2-40cd-9498-75e65c93083f None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:34.706128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb583905-e8c2-40cd-9498-75e65c93083f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:34.706443 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb583905-e8c2-40cd-9498-75e65c93083f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:34.707897 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb583905-e8c2-40cd-9498-75e65c93083f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:34.724555 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 432/839] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:34.731555 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb583905-e8c2-40cd-9498-75e65c93083f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:34.764872 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:34.779613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ae38a-c1d5-46d3-9158-93d0133b765c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:34.823660 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c725c-c433-4091-a39f-58edca691ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:34.824817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c725c-c433-4091-a39f-58edca691ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:34.825166 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c725c-c433-4091-a39f-58edca691ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:34.825531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c725c-c433-4091-a39f-58edca691ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:34.826723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c725c-c433-4091-a39f-58edca691ce9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:34.826723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c725c-c433-4091-a39f-58edca691ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:34.828345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c725c-c433-4091-a39f-58edca691ce9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:34.839773 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 408/840] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:10:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:34.842244 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb583905-e8c2-40cd-9498-75e65c93083f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:34.844983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c725c-c433-4091-a39f-58edca691ce9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:34.888993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8530c-02b5-401b-a042-66c996597f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:34.889600 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8530c-02b5-401b-a042-66c996597f2a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:34.889915 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8530c-02b5-401b-a042-66c996597f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:34.890184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8530c-02b5-401b-a042-66c996597f2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:34.890909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8530c-02b5-401b-a042-66c996597f2a None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=6dbf682960cc447099c11862afa3206b) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:34.891216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8530c-02b5-401b-a042-66c996597f2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:34.892648 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8530c-02b5-401b-a042-66c996597f2a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:34.905768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 433/841] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:34 2022] GET /identity/v3/role_assignments?user.id=6dbf682960cc447099c11862afa3206b&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:34.968572 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c725c-c433-4091-a39f-58edca691ce9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:35.007544 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d8d13-5974-4c2e-a4cb-1f39f08387fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:35.008256 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d8d13-5974-4c2e-a4cb-1f39f08387fc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:35.008534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d8d13-5974-4c2e-a4cb-1f39f08387fc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:35.008799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d8d13-5974-4c2e-a4cb-1f39f08387fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:35.021598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d8d13-5974-4c2e-a4cb-1f39f08387fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:35.023074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d8d13-5974-4c2e-a4cb-1f39f08387fc None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:35.039994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c44d8d13-5974-4c2e-a4cb-1f39f08387fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:35.039994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:35.039994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:35.039994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:35.039994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:35.039994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:35.039994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:35.039994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:35.039994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:35.039994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:35.039994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:35.039994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:35.039994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:35.039994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:35.039994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:35.039994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:35.041157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:35.042368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:35.042368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:35.042368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:35.045909 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 409/842] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:35.047822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8530c-02b5-401b-a042-66c996597f2a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:35.081325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:35.159778 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8530c-02b5-401b-a042-66c996597f2a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:35.193096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ed3f2-0dab-44ea-812f-56b01e91e1d2 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:35.193431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ed3f2-0dab-44ea-812f-56b01e91e1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:35.193645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ed3f2-0dab-44ea-812f-56b01e91e1d2 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:35.195487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 410/843] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:10:35.196039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe60927-db2d-4a3d-beb6-0256362d66d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:35.197482 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe60927-db2d-4a3d-beb6-0256362d66d9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:35.197997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe60927-db2d-4a3d-beb6-0256362d66d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:35.198466 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe60927-db2d-4a3d-beb6-0256362d66d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:35.199308 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe60927-db2d-4a3d-beb6-0256362d66d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:35.199846 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe60927-db2d-4a3d-beb6-0256362d66d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:35.201247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500be000-f502-4997-b7ab-0a1fe24eec05 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:35.201531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500be000-f502-4997-b7ab-0a1fe24eec05 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:35.201830 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500be000-f502-4997-b7ab-0a1fe24eec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:35.202122 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe60927-db2d-4a3d-beb6-0256362d66d9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:35.209248 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:35.216660 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 434/844] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:35.224018 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe60927-db2d-4a3d-beb6-0256362d66d9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:35.224172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-500be000-f502-4997-b7ab-0a1fe24eec05 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:35.224942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-500be000-f502-4997-b7ab-0a1fe24eec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:35.301139 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 411/845] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:10:35.318110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:35.333368 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe60927-db2d-4a3d-beb6-0256362d66d9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:35.367575 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ca720-35aa-4289-af7f-8321ae24252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:35.368196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ca720-35aa-4289-af7f-8321ae24252d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:35.368462 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ca720-35aa-4289-af7f-8321ae24252d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:35.369260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ca720-35aa-4289-af7f-8321ae24252d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:35.376582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ca720-35aa-4289-af7f-8321ae24252d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:35.378483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ca720-35aa-4289-af7f-8321ae24252d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:35.391202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-468ca720-35aa-4289-af7f-8321ae24252d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 15:10:35.391202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:35.391202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:35.391202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:35.391202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:35.391202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:35.391202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:35.391202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:35.391202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:35.391202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:35.391202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:35.391202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:35.391202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:35.391202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:35.391202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:35.391202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:35.392223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:35.393182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:35.393182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:35.393182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:35.393182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:35.393182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:35.393182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:35.393182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:35.393182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:35.393182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 15:10:35.393182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:35.393182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 435/846] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:10:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:35.398314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500be000-f502-4997-b7ab-0a1fe24eec05 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:35.507873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500be000-f502-4997-b7ab-0a1fe24eec05 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:35.543947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:35.550549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f64c23-0e65-4daf-9625-3262f7e4f3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:35.551267 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f64c23-0e65-4daf-9625-3262f7e4f3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:35.551655 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f64c23-0e65-4daf-9625-3262f7e4f3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:35.555882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f64c23-0e65-4daf-9625-3262f7e4f3c4 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:35.555882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f64c23-0e65-4daf-9625-3262f7e4f3c4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:35.555882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f64c23-0e65-4daf-9625-3262f7e4f3c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:35.555882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f64c23-0e65-4daf-9625-3262f7e4f3c4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:35.574157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 412/847] 10.222.0.82 () {56 vars in 1135 bytes} [Fri Sep 23 15:10:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:35.579736 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ca720-35aa-4289-af7f-8321ae24252d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:35.580549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f64c23-0e65-4daf-9625-3262f7e4f3c4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:35.691735 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f64c23-0e65-4daf-9625-3262f7e4f3c4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:35.713711 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ca720-35aa-4289-af7f-8321ae24252d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:35.735226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b636eb8-61c1-41b5-a40c-7e7ba642631f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:35.735840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b636eb8-61c1-41b5-a40c-7e7ba642631f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:35.736119 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b636eb8-61c1-41b5-a40c-7e7ba642631f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:35.736390 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b636eb8-61c1-41b5-a40c-7e7ba642631f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:35.762905 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e9b4b-b0e1-4276-bd13-1fe926157570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:35.763864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e9b4b-b0e1-4276-bd13-1fe926157570 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:35.764609 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e9b4b-b0e1-4276-bd13-1fe926157570 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:35.765087 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e9b4b-b0e1-4276-bd13-1fe926157570 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:35.765964 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e9b4b-b0e1-4276-bd13-1fe926157570 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:35.768519 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e9b4b-b0e1-4276-bd13-1fe926157570 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:35.802852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:35.812877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b636eb8-61c1-41b5-a40c-7e7ba642631f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:35.814446 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b636eb8-61c1-41b5-a40c-7e7ba642631f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:35.871450 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 436/848] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Sep 23 15:10:35 2022] POST /identity/v3/services => generated 251 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:10:35.934622 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 413/849] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:10:35 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 23 15:10:35.941035 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e9b4b-b0e1-4276-bd13-1fe926157570 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:35.953686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:36.075598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e9b4b-b0e1-4276-bd13-1fe926157570 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:36.112779 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091750f-5c58-43df-9df4-9d4b0f27764b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:36.113776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091750f-5c58-43df-9df4-9d4b0f27764b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:36.114269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091750f-5c58-43df-9df4-9d4b0f27764b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:36.114756 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091750f-5c58-43df-9df4-9d4b0f27764b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:36.127393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091750f-5c58-43df-9df4-9d4b0f27764b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:36.129141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091750f-5c58-43df-9df4-9d4b0f27764b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:36.144044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-4091750f-5c58-43df-9df4-9d4b0f27764b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:36.144044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:36.144044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:36.144044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:36.144044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:36.144044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:36.144044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:36.144044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:36.144044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:36.144044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:36.144044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:36.144044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:36.144044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:36.144044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:36.144044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:36.144044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:36.145055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:36.146021 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:36.146021 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:36.146021 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:36.148067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 437/850] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:36.154054 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b636eb8-61c1-41b5-a40c-7e7ba642631f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:36.251382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:36.262239 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b636eb8-61c1-41b5-a40c-7e7ba642631f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:36.302128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f48d40-e850-4e93-8b81-0323d5b7205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:36.303088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f48d40-e850-4e93-8b81-0323d5b7205f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:36.303551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f48d40-e850-4e93-8b81-0323d5b7205f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:36.304020 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f48d40-e850-4e93-8b81-0323d5b7205f None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:36.304849 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f48d40-e850-4e93-8b81-0323d5b7205f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:36.305351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f48d40-e850-4e93-8b81-0323d5b7205f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:36.306976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f48d40-e850-4e93-8b81-0323d5b7205f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:36.320131 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 414/851] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:36.325471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091750f-5c58-43df-9df4-9d4b0f27764b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:36.389454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:36.439269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091750f-5c58-43df-9df4-9d4b0f27764b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:36.479596 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b664d-5d0e-4d9f-9e92-fe02aad98c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:36.480229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b664d-5d0e-4d9f-9e92-fe02aad98c3f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:36.480505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b664d-5d0e-4d9f-9e92-fe02aad98c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:36.480779 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b664d-5d0e-4d9f-9e92-fe02aad98c3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:36.488010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b664d-5d0e-4d9f-9e92-fe02aad98c3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:36.489539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b664d-5d0e-4d9f-9e92-fe02aad98c3f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:36.502081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-219b664d-5d0e-4d9f-9e92-fe02aad98c3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:36.502081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:36.502081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:36.502081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:36.502081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:36.502081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:36.502081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:36.502081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:36.502081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:36.502081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:36.502081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:36.502081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:36.502081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:36.502081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:36.502081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:36.503076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:36.504085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:36.504085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:36.504085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:36.504085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:36.504085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:36.504085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:36.504085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:36.504085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:36.504085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 438/852] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:36.511770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f48d40-e850-4e93-8b81-0323d5b7205f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:36.624499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f48d40-e850-4e93-8b81-0323d5b7205f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:36.661781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f1659-6e20-40a2-9f19-287932680a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:36.662315 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f1659-6e20-40a2-9f19-287932680a41 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:36.662603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f1659-6e20-40a2-9f19-287932680a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:36.662875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f1659-6e20-40a2-9f19-287932680a41 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:36.663569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f1659-6e20-40a2-9f19-287932680a41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:36.663875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f1659-6e20-40a2-9f19-287932680a41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:36.665299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f1659-6e20-40a2-9f19-287932680a41 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:36.678838 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 415/853] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:36.684908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b664d-5d0e-4d9f-9e92-fe02aad98c3f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:36.704430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8656a-ab00-4aa9-9ccc-b9eefcdf858d None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:36.704747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8656a-ab00-4aa9-9ccc-b9eefcdf858d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:36.704994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8656a-ab00-4aa9-9ccc-b9eefcdf858d None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:36.706689 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 416/854] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:36.711823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dfd60-8025-4d56-8487-b12494de8745 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:36.712110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dfd60-8025-4d56-8487-b12494de8745 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:36.712944 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dfd60-8025-4d56-8487-b12494de8745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:36.732008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d27dfd60-8025-4d56-8487-b12494de8745 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:36.733758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d27dfd60-8025-4d56-8487-b12494de8745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:36.736870 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:36.809827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 417/855] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:10:36.823586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b664d-5d0e-4d9f-9e92-fe02aad98c3f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:36.838678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:36.861076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11069483-9b69-4351-835d-529e7081d053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:36.862115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11069483-9b69-4351-835d-529e7081d053 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:36.862602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11069483-9b69-4351-835d-529e7081d053 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:36.863112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11069483-9b69-4351-835d-529e7081d053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:36.864125 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11069483-9b69-4351-835d-529e7081d053 None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=b22406c522e149d8bc462ff2feeec44c) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:36.864652 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11069483-9b69-4351-835d-529e7081d053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:36.866363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11069483-9b69-4351-835d-529e7081d053 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:36.873952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 439/856] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:36 2022] GET /identity/v3/role_assignments?user.id=b22406c522e149d8bc462ff2feeec44c&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:37.081886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dfd60-8025-4d56-8487-b12494de8745 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:37.197874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dfd60-8025-4d56-8487-b12494de8745 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:37.236014 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae4314-6bac-4f4c-bec8-f0b7f5f821a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:37.236885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae4314-6bac-4f4c-bec8-f0b7f5f821a1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:37.237381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae4314-6bac-4f4c-bec8-f0b7f5f821a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:37.237830 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae4314-6bac-4f4c-bec8-f0b7f5f821a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:37.247036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:37.250823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae4314-6bac-4f4c-bec8-f0b7f5f821a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:37.256000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-b8ae4314-6bac-4f4c-bec8-f0b7f5f821a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:37.256000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:37.256000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:37.256000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:37.256000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:37.256000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:37.256000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:37.256000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:37.256000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:37.256000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:37.256000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:37.256000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:37.256000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:37.256000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:37.256000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:37.256000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:37.260203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:37.260203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:37.260203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:37.260203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:37.260203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:37.260203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:37.260203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:37.260203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:37.260203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:37.260203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:37.260203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:37.260203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:37.260203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:37.260203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:37.260203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:37.260203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:37.261285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:37.261285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:37.261285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:37.261285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:37.261285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:37.261285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:37.261285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:37.261285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:37.261285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:37.261285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:37.261285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:10:37.261285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:37.261285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 418/857] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:10:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:37.263322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11069483-9b69-4351-835d-529e7081d053 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:37.283516 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b05d87-b85d-41d3-bba5-725d455bf892 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:37.284271 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b05d87-b85d-41d3-bba5-725d455bf892 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:37.284873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b05d87-b85d-41d3-bba5-725d455bf892 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:37.286851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 419/858] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:10:37.292943 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674359f-4831-4897-a2bd-f3965424ea83 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:37.293312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674359f-4831-4897-a2bd-f3965424ea83 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:37.293661 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674359f-4831-4897-a2bd-f3965424ea83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:37.315462 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d674359f-4831-4897-a2bd-f3965424ea83 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:37.316863 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d674359f-4831-4897-a2bd-f3965424ea83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:37.381508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11069483-9b69-4351-835d-529e7081d053 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:37.399029 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 420/859] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:37 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:10:37.424327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da2ccd-11e3-42a1-bbf3-b4925bad0b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:37.424962 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da2ccd-11e3-42a1-bbf3-b4925bad0b92 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:37.425205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da2ccd-11e3-42a1-bbf3-b4925bad0b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:37.425482 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da2ccd-11e3-42a1-bbf3-b4925bad0b92 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:37.426182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da2ccd-11e3-42a1-bbf3-b4925bad0b92 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:37.426489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da2ccd-11e3-42a1-bbf3-b4925bad0b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:37.427879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da2ccd-11e3-42a1-bbf3-b4925bad0b92 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:37.437197 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 440/860] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:10:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:37.442693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674359f-4831-4897-a2bd-f3965424ea83 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:37.552904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674359f-4831-4897-a2bd-f3965424ea83 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:37.582692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:37.589086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0236b-2d96-4aa1-95df-4a2cc0a1b929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:37.589721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0236b-2d96-4aa1-95df-4a2cc0a1b929 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:37.590023 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0236b-2d96-4aa1-95df-4a2cc0a1b929 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:37.590297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0236b-2d96-4aa1-95df-4a2cc0a1b929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:37.600448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0236b-2d96-4aa1-95df-4a2cc0a1b929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:37.601930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0236b-2d96-4aa1-95df-4a2cc0a1b929 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:37.617371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-9de0236b-2d96-4aa1-95df-4a2cc0a1b929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:37.617371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:37.617371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:37.617371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:37.617371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:37.617371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:37.617371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:37.617371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:37.617371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:37.617371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:37.617371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:37.617371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:37.617371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:37.617371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:37.617371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:37.617371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:37.618415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:37.619302 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:37.619302 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:37.619302 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:37.619302 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 421/861] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:37.624670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da2ccd-11e3-42a1-bbf3-b4925bad0b92 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:37.671146 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:37.683852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0236b-2d96-4aa1-95df-4a2cc0a1b929 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:37.732186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da2ccd-11e3-42a1-bbf3-b4925bad0b92 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:37.766695 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035d389-2265-414f-a6c0-80b74b50ba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:37.767638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035d389-2265-414f-a6c0-80b74b50ba16 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:37.768111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035d389-2265-414f-a6c0-80b74b50ba16 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:37.768556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035d389-2265-414f-a6c0-80b74b50ba16 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:37.769383 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035d389-2265-414f-a6c0-80b74b50ba16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:37.769887 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035d389-2265-414f-a6c0-80b74b50ba16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:37.771441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035d389-2265-414f-a6c0-80b74b50ba16 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:37.784881 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 441/862] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:37.791561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035d389-2265-414f-a6c0-80b74b50ba16 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:37.808996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0236b-2d96-4aa1-95df-4a2cc0a1b929 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:37.850022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46fc31-decc-4948-8a21-5323e322dcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:37.850896 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46fc31-decc-4948-8a21-5323e322dcf8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:37.851402 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46fc31-decc-4948-8a21-5323e322dcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:37.851824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46fc31-decc-4948-8a21-5323e322dcf8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:37.852575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46fc31-decc-4948-8a21-5323e322dcf8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:37.854710 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46fc31-decc-4948-8a21-5323e322dcf8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:37.864129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-9d46fc31-decc-4948-8a21-5323e322dcf8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:10:37.864129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:37.864129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:37.864129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:37.864129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:37.864129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:37.864129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:37.864129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:37.864129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:10:37.864129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:37.864129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:37.864129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:37.864129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:37.864129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:37.864129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:37.864129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:37.865100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:37.866036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:37.866036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:37.866036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:37.866036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:37.866036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:37.866036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:37.866036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:37.866036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:37.866036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:37.866036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:37.866036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:37.866036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:37.866036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:10:37.866036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:37.869227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 422/863] 10.222.0.82 () {56 vars in 1132 bytes} [Fri Sep 23 15:10:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:37.874947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46fc31-decc-4948-8a21-5323e322dcf8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:37.936353 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:37.940781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035d389-2265-414f-a6c0-80b74b50ba16 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:37.943468 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:37.994358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfc2e0-ee5a-4d64-b8de-dfbebe08a5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:37.995520 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfc2e0-ee5a-4d64-b8de-dfbebe08a5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:37.995962 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfc2e0-ee5a-4d64-b8de-dfbebe08a5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:37.996519 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfc2e0-ee5a-4d64-b8de-dfbebe08a5f1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:38.005911 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfc2e0-ee5a-4d64-b8de-dfbebe08a5f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:38.008197 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfc2e0-ee5a-4d64-b8de-dfbebe08a5f1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:38.013283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46fc31-decc-4948-8a21-5323e322dcf8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:38.023585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-05cfc2e0-ee5a-4d64-b8de-dfbebe08a5f1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 15:10:38.023585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:38.023585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:38.023585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:38.023585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:38.023585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:38.023585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:38.023585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:38.023585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:38.023585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:38.023585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:38.023585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:38.023585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:38.023585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:38.023585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:38.023585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:38.024574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:38.026558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:38.026558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:38.026558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:38.026558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:38.026558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:38.026558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:38.026558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:38.026558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:38.026558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 15:10:38.026558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:38.029912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 442/864] 10.222.0.82 () {56 vars in 1117 bytes} [Fri Sep 23 15:10:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:38.036041 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfc2e0-ee5a-4d64-b8de-dfbebe08a5f1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:38.065002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082464d-e475-4959-9733-59717717cf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:38.065610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082464d-e475-4959-9733-59717717cf12 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:38.065919 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082464d-e475-4959-9733-59717717cf12 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:38.066251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082464d-e475-4959-9733-59717717cf12 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:38.066895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082464d-e475-4959-9733-59717717cf12 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:38.067277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082464d-e475-4959-9733-59717717cf12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:38.068776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082464d-e475-4959-9733-59717717cf12 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:38.079633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 423/865] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Sep 23 15:10:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:38.081699 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082464d-e475-4959-9733-59717717cf12 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:38.165712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfc2e0-ee5a-4d64-b8de-dfbebe08a5f1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:38.202261 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ea788-116e-4a15-979e-7f74b6495cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:38.202857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ea788-116e-4a15-979e-7f74b6495cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:38.203134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ea788-116e-4a15-979e-7f74b6495cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:38.203516 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ea788-116e-4a15-979e-7f74b6495cc1 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:38.204195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ea788-116e-4a15-979e-7f74b6495cc1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:38.204497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ea788-116e-4a15-979e-7f74b6495cc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:38.205955 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ea788-116e-4a15-979e-7f74b6495cc1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:38.207517 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082464d-e475-4959-9733-59717717cf12 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:38.219824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:38.225693 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 443/866] 10.222.0.82 () {56 vars in 1149 bytes} [Fri Sep 23 15:10:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:38.227108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96224d79-a549-4488-8d67-8a80d9463e51 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:38.227519 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96224d79-a549-4488-8d67-8a80d9463e51 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:38.227948 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96224d79-a549-4488-8d67-8a80d9463e51 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:38.229470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 444/867] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:38.232998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96224d79-a549-4488-8d67-8a80d9463e51 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:38.253808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72e4e1-fc3b-45c5-8c9c-a707d4043d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:38.254024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:38.254864 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72e4e1-fc3b-45c5-8c9c-a707d4043d8a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:38.255152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72e4e1-fc3b-45c5-8c9c-a707d4043d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:38.255430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72e4e1-fc3b-45c5-8c9c-a707d4043d8a None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:38.256146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72e4e1-fc3b-45c5-8c9c-a707d4043d8a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:38.256370 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72e4e1-fc3b-45c5-8c9c-a707d4043d8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:38.257772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72e4e1-fc3b-45c5-8c9c-a707d4043d8a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:38.263523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 424/868] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Sep 23 15:10:38 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:38.264759 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a09b0c-03c0-4ddc-b4b6-5dd61e982da7 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:38.265094 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a09b0c-03c0-4ddc-b4b6-5dd61e982da7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:38.265371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a09b0c-03c0-4ddc-b4b6-5dd61e982da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:38.285658 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-60a09b0c-03c0-4ddc-b4b6-5dd61e982da7 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:38.287003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-60a09b0c-03c0-4ddc-b4b6-5dd61e982da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:38.390063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 425/869] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:38 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:38.390887 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96224d79-a549-4488-8d67-8a80d9463e51 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:38.432529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35635d68-8ff8-4383-a23a-3613db7e2472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:38.433249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635d68-8ff8-4383-a23a-3613db7e2472 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:38.433485 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635d68-8ff8-4383-a23a-3613db7e2472 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:38.433812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635d68-8ff8-4383-a23a-3613db7e2472 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:38.507738 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35635d68-8ff8-4383-a23a-3613db7e2472 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:38.509273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35635d68-8ff8-4383-a23a-3613db7e2472 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:38.528817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:38.614607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 445/870] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:10:38 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:10:38.620076 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a09b0c-03c0-4ddc-b4b6-5dd61e982da7 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:38.687317 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35635d68-8ff8-4383-a23a-3613db7e2472 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:38.727721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a09b0c-03c0-4ddc-b4b6-5dd61e982da7 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:38.746165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:38.768026 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3106f-0f50-48f4-a10d-3055588a9781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:38.769405 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3106f-0f50-48f4-a10d-3055588a9781 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:38.779698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3106f-0f50-48f4-a10d-3055588a9781 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:38.779698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3106f-0f50-48f4-a10d-3055588a9781 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:38.784220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3106f-0f50-48f4-a10d-3055588a9781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:38.785927 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3106f-0f50-48f4-a10d-3055588a9781 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:38.794518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35635d68-8ff8-4383-a23a-3613db7e2472 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:38.805057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-82d3106f-0f50-48f4-a10d-3055588a9781 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:38.805057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:38.805057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:38.805057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:38.805057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:38.805057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:38.805057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:38.805057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:38.805057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:38.805057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:38.805057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:38.805057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:38.805057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:38.805057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:38.805057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:38.805057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:38.806110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:38.807011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:38.807011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:38.807011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:38.809362 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 426/871] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:38.815232 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3106f-0f50-48f4-a10d-3055588a9781 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:38.820916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:38.841152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776742b-e79c-49e9-9724-2c5ce414daab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:38.842212 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776742b-e79c-49e9-9724-2c5ce414daab None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:38.842780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776742b-e79c-49e9-9724-2c5ce414daab None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:38.843243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776742b-e79c-49e9-9724-2c5ce414daab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:38.844015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776742b-e79c-49e9-9724-2c5ce414daab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:38.845707 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776742b-e79c-49e9-9724-2c5ce414daab None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7776742b-e79c-49e9-9724-2c5ce414daab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:38.855410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:38.856419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:38.856419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:38.856419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:38.856419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:38.856419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:38.856419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:38.856419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:38.856419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:38.856419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:38.856419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:38.856419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:38.856419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:38.856419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:38.856419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:38.856419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:38.856419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:38.857271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:38.857271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:38.857271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:38.857271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:38.857271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:38.857271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:38.857271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:38.857271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:38.857271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:38.857271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:38.857271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:38.857271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:38.857271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:10:38.857271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:38.860102 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 446/872] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:10:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:38.866348 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776742b-e79c-49e9-9724-2c5ce414daab None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:38.939238 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3106f-0f50-48f4-a10d-3055588a9781 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:38.989545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca44c7a-b1bd-4fc7-b936-697fdc084ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:38.990196 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca44c7a-b1bd-4fc7-b936-697fdc084ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:38.990476 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca44c7a-b1bd-4fc7-b936-697fdc084ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:38.990750 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca44c7a-b1bd-4fc7-b936-697fdc084ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:38.991401 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca44c7a-b1bd-4fc7-b936-697fdc084ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:38.991703 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca44c7a-b1bd-4fc7-b936-697fdc084ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:38.993242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca44c7a-b1bd-4fc7-b936-697fdc084ff6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:39.009565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776742b-e79c-49e9-9724-2c5ce414daab None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:39.017380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 427/873] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:39.018884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca44c7a-b1bd-4fc7-b936-697fdc084ff6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:39.041345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:39.058047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01986e9-adb4-4a6e-82e3-4f8fa134d031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:39.060418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01986e9-adb4-4a6e-82e3-4f8fa134d031 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:39.060418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01986e9-adb4-4a6e-82e3-4f8fa134d031 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:39.061136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01986e9-adb4-4a6e-82e3-4f8fa134d031 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:39.062014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01986e9-adb4-4a6e-82e3-4f8fa134d031 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:39.062534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01986e9-adb4-4a6e-82e3-4f8fa134d031 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:39.064149 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01986e9-adb4-4a6e-82e3-4f8fa134d031 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:39.071528 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 447/874] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:10:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:39.076997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01986e9-adb4-4a6e-82e3-4f8fa134d031 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:39.141155 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca44c7a-b1bd-4fc7-b936-697fdc084ff6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:39.146679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:39.185203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032af4ae-214d-4248-8374-9d9b1bd5b233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:39.185877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032af4ae-214d-4248-8374-9d9b1bd5b233 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:39.186257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032af4ae-214d-4248-8374-9d9b1bd5b233 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:39.186540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032af4ae-214d-4248-8374-9d9b1bd5b233 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:39.193901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032af4ae-214d-4248-8374-9d9b1bd5b233 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:39.195446 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032af4ae-214d-4248-8374-9d9b1bd5b233 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:39.206963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-032af4ae-214d-4248-8374-9d9b1bd5b233 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:39.206963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:39.206963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:39.206963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:39.206963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:39.206963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:39.206963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:39.206963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:39.206963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:39.206963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:39.206963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:39.206963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:39.206963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:39.206963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:39.206963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:39.208355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:39.209293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:39.209293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:39.209293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:39.209293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:39.209293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:39.209293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:39.209293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:39.209293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:39.213373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 428/875] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:39.214702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbe404-71a2-48f9-ab82-a13c1e669db2 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:39.214993 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbe404-71a2-48f9-ab82-a13c1e669db2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:39.215267 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbe404-71a2-48f9-ab82-a13c1e669db2 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:39.216694 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 429/876] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:39.217228 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbe404-71a2-48f9-ab82-a13c1e669db2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:39.232483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01986e9-adb4-4a6e-82e3-4f8fa134d031 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:39.270161 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44816f19-d83f-4408-8ee6-206856cdcfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:39.270812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44816f19-d83f-4408-8ee6-206856cdcfe3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:39.271086 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44816f19-d83f-4408-8ee6-206856cdcfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:39.271359 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44816f19-d83f-4408-8ee6-206856cdcfe3 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:39.271985 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44816f19-d83f-4408-8ee6-206856cdcfe3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:39.272283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44816f19-d83f-4408-8ee6-206856cdcfe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:39.273653 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44816f19-d83f-4408-8ee6-206856cdcfe3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:39.281784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 448/877] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:10:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:39.281784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21f32d-2ee4-4769-adb2-30ee0f419f15 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:39.281784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21f32d-2ee4-4769-adb2-30ee0f419f15 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:39.281784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21f32d-2ee4-4769-adb2-30ee0f419f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:39.301458 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7a21f32d-2ee4-4769-adb2-30ee0f419f15 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:39.302957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7a21f32d-2ee4-4769-adb2-30ee0f419f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:39.307089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:39.329719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbe404-71a2-48f9-ab82-a13c1e669db2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:39.367480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0a731-9699-47ed-996e-8ece231f1a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:39.368081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a731-9699-47ed-996e-8ece231f1a85 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:39.368388 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a731-9699-47ed-996e-8ece231f1a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:39.368923 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a731-9699-47ed-996e-8ece231f1a85 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:39.369349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0a731-9699-47ed-996e-8ece231f1a85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:39.369659 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0a731-9699-47ed-996e-8ece231f1a85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:39.371332 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0a731-9699-47ed-996e-8ece231f1a85 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:39.373781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 449/878] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:39 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:39.376954 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21f32d-2ee4-4769-adb2-30ee0f419f15 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:39.390116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 430/879] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:39.395854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0a731-9699-47ed-996e-8ece231f1a85 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:39.425225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:39.497800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21f32d-2ee4-4769-adb2-30ee0f419f15 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:39.503489 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0a731-9699-47ed-996e-8ece231f1a85 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:39.542694 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65456811-9b75-4812-a9f1-ebf3da34ae9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:39.543646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b533af-2ecb-4b45-9d7b-aa5f4d6d0650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:39.543848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65456811-9b75-4812-a9f1-ebf3da34ae9f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:39.544276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65456811-9b75-4812-a9f1-ebf3da34ae9f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:39.544558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b533af-2ecb-4b45-9d7b-aa5f4d6d0650 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:39.544863 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65456811-9b75-4812-a9f1-ebf3da34ae9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:39.545044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b533af-2ecb-4b45-9d7b-aa5f4d6d0650 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:39.545428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b533af-2ecb-4b45-9d7b-aa5f4d6d0650 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:39.546081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65456811-9b75-4812-a9f1-ebf3da34ae9f None admin] RBAC: Adding query filter params (role.id=118b4b27bab54b429c3a70924d659c72, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=94a8ee59c6b24db9a67eb44a115fae85) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:39.546356 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b533af-2ecb-4b45-9d7b-aa5f4d6d0650 None admin] RBAC: Adding query filter params (interface=public, service_id=0ab1aa85ddfe4399ab51383c6c70dd53, region_id=RegionOne) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:39.546702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65456811-9b75-4812-a9f1-ebf3da34ae9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:39.546812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b533af-2ecb-4b45-9d7b-aa5f4d6d0650 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:39.548265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b533af-2ecb-4b45-9d7b-aa5f4d6d0650 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:39.548504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65456811-9b75-4812-a9f1-ebf3da34ae9f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:39.552636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:39.555694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 450/880] 10.222.0.82 () {56 vars in 1251 bytes} [Fri Sep 23 15:10:39 2022] GET /identity/v3/endpoints?service_id=0ab1aa85ddfe4399ab51383c6c70dd53&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:39.556997 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 431/881] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:39 2022] GET /identity/v3/role_assignments?user.id=94a8ee59c6b24db9a67eb44a115fae85&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=118b4b27bab54b429c3a70924d659c72 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:39.565788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b533af-2ecb-4b45-9d7b-aa5f4d6d0650 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:39.681040 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65456811-9b75-4812-a9f1-ebf3da34ae9f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:39.692626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b533af-2ecb-4b45-9d7b-aa5f4d6d0650 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:39.697342 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:39.745204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fdb80-3d2e-4693-8275-0f8747ca27ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:39.745537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fdb80-3d2e-4693-8275-0f8747ca27ec None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:39.746436 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fdb80-3d2e-4693-8275-0f8747ca27ec None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:39.746436 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fdb80-3d2e-4693-8275-0f8747ca27ec None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:39.747067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fdb80-3d2e-4693-8275-0f8747ca27ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:39.749096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fdb80-3d2e-4693-8275-0f8747ca27ec None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:39.755664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 451/882] 10.222.0.82 () {56 vars in 1087 bytes} [Fri Sep 23 15:10:39 2022] GET /identity/v3/services => generated 1011 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:10:39.808631 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65456811-9b75-4812-a9f1-ebf3da34ae9f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:39.853888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9ff79-3899-43f0-991f-37e751f7765d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:39.854833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9ff79-3899-43f0-991f-37e751f7765d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:39.855269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9ff79-3899-43f0-991f-37e751f7765d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:39.855693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9ff79-3899-43f0-991f-37e751f7765d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:39.856439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9ff79-3899-43f0-991f-37e751f7765d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:39.858094 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9ff79-3899-43f0-991f-37e751f7765d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-b8a9ff79-3899-43f0-991f-37e751f7765d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:39.868156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:39.870025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:39.870025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:39.870025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:39.870025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:39.870025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:39.870025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:39.870025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:39.870025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:39.870025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:39.870025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:39.870025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:39.870025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:39.870025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:39.870025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:39.870025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:39.870025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:39.871088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:39.871088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:39.871088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:39.871088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:39.871088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:39.871088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:39.871088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:39.871088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:39.871088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:39.871088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:39.871088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:39.871088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:39.871088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 15:10:39.871088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:39.873544 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 432/883] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Sep 23 15:10:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:39.879937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fdb80-3d2e-4693-8275-0f8747ca27ec None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:40.002586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fdb80-3d2e-4693-8275-0f8747ca27ec None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:40.038335 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696a4d1-577f-42a4-a2cc-8e14e102dfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:40.038945 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696a4d1-577f-42a4-a2cc-8e14e102dfc7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:40.039221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696a4d1-577f-42a4-a2cc-8e14e102dfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:40.039487 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696a4d1-577f-42a4-a2cc-8e14e102dfc7 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:40.040148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696a4d1-577f-42a4-a2cc-8e14e102dfc7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:40.040449 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696a4d1-577f-42a4-a2cc-8e14e102dfc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:40.042101 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696a4d1-577f-42a4-a2cc-8e14e102dfc7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:40.047083 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 452/884] 10.222.0.82 () {56 vars in 1122 bytes} [Fri Sep 23 15:10:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:40.052637 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9ff79-3899-43f0-991f-37e751f7765d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:40.129759 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:40.162165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9ff79-3899-43f0-991f-37e751f7765d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:40.199650 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b255db-f727-4aa8-9842-6b553ddd04de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:40.200259 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b255db-f727-4aa8-9842-6b553ddd04de None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:40.200539 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b255db-f727-4aa8-9842-6b553ddd04de None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:40.200812 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b255db-f727-4aa8-9842-6b553ddd04de None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:40.201444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b255db-f727-4aa8-9842-6b553ddd04de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:40.201831 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b255db-f727-4aa8-9842-6b553ddd04de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:40.203200 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b255db-f727-4aa8-9842-6b553ddd04de None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:40.211894 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 433/885] 10.222.0.82 () {56 vars in 1122 bytes} [Fri Sep 23 15:10:40 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:40.549567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598c5c1-3951-4388-8355-68bbcfd5c8c2 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:40.550158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598c5c1-3951-4388-8355-68bbcfd5c8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:40.550158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598c5c1-3951-4388-8355-68bbcfd5c8c2 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:40.551807 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 453/886] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:40.557954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b7dcd-c4b9-4e44-b190-d56676da01cd None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:40.558237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b7dcd-c4b9-4e44-b190-d56676da01cd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:40.558507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b7dcd-c4b9-4e44-b190-d56676da01cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:40.577020 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bb8b7dcd-c4b9-4e44-b190-d56676da01cd None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:40.578278 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bb8b7dcd-c4b9-4e44-b190-d56676da01cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:40.657074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 434/887] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:40 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:10:40.925483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598c5c1-3951-4388-8355-68bbcfd5c8c2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:40.958115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:41.037765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598c5c1-3951-4388-8355-68bbcfd5c8c2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:41.074507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9728adc-50c8-49a1-a3a1-acab41854db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:41.075110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9728adc-50c8-49a1-a3a1-acab41854db6 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:41.075383 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9728adc-50c8-49a1-a3a1-acab41854db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:41.075654 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9728adc-50c8-49a1-a3a1-acab41854db6 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:41.076311 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9728adc-50c8-49a1-a3a1-acab41854db6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:41.077687 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9728adc-50c8-49a1-a3a1-acab41854db6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:41.234833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 454/888] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Sep 23 15:10:40 2022] POST /identity/v3/services => generated 269 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:10:41.959813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f74b5-2255-4d22-bf9e-75207588e544 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:41.960361 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f74b5-2255-4d22-bf9e-75207588e544 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:41.960361 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f74b5-2255-4d22-bf9e-75207588e544 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:41.975104 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 435/889] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:41 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:41.980973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d44526-8020-49fb-a403-352b5cbca1fd None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:41.981928 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d44526-8020-49fb-a403-352b5cbca1fd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:41.982430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d44526-8020-49fb-a403-352b5cbca1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:42.001352 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b0d44526-8020-49fb-a403-352b5cbca1fd None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:42.002913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b0d44526-8020-49fb-a403-352b5cbca1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:42.040269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c719f-97be-4286-b4dd-acc15d773216 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:42.040597 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c719f-97be-4286-b4dd-acc15d773216 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:42.040849 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c719f-97be-4286-b4dd-acc15d773216 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:42.042767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 436/890] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:10:42.047920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a10c4-63c1-480a-b342-ade15c33c658 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:42.048277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a10c4-63c1-480a-b342-ade15c33c658 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:42.048558 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a10c4-63c1-480a-b342-ade15c33c658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:42.068365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-646a10c4-63c1-480a-b342-ade15c33c658 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:42.070194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-646a10c4-63c1-480a-b342-ade15c33c658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:42.085221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 455/891] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:42.131244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:42.147035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 437/892] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:10:42.361530 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d44526-8020-49fb-a403-352b5cbca1fd None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:42.381057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:42.389408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94a078-b03d-4986-841d-7254cc12f5f6 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:42.389696 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94a078-b03d-4986-841d-7254cc12f5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:42.389995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94a078-b03d-4986-841d-7254cc12f5f6 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:42.391630 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 438/893] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:42.396868 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8b5ae-ff2e-4669-a9df-2d831d367629 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:42.397153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8b5ae-ff2e-4669-a9df-2d831d367629 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:42.397430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8b5ae-ff2e-4669-a9df-2d831d367629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:42.419779 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4fc8b5ae-ff2e-4669-a9df-2d831d367629 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:42.421300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4fc8b5ae-ff2e-4669-a9df-2d831d367629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:42.467514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d44526-8020-49fb-a403-352b5cbca1fd None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:42.494874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 439/894] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:42.495725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8b5ae-ff2e-4669-a9df-2d831d367629 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:42.516897 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697d071-439a-44de-b2c3-20df299e3fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:42.518038 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697d071-439a-44de-b2c3-20df299e3fec None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:42.519077 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697d071-439a-44de-b2c3-20df299e3fec None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:42.519550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697d071-439a-44de-b2c3-20df299e3fec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:42.534691 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697d071-439a-44de-b2c3-20df299e3fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:42.542112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d697d071-439a-44de-b2c3-20df299e3fec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 15:10:42.542112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:42.542112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:42.542112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:42.542112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:42.542112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:42.542112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:42.542112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:42.542112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:42.542112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:42.542112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:42.542112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:42.542112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:42.542112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:42.542112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:42.542112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:42.543061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:42.543061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:42.543061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:42.543061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:42.543061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:42.543061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:42.543061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:42.543061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:42.543061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:42.543061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:42.543061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:42.543061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:42.543061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:42.543061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:42.543061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:42.543061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:42.543926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:42.543926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:42.543926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:42.543926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:42.543926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:42.543926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:42.543926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:42.543926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:42.543926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:42.543926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:42.543926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 15:10:42.543926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:42.546865 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 456/895] 10.222.0.82 () {56 vars in 1120 bytes} [Fri Sep 23 15:10:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:42.552965 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697d071-439a-44de-b2c3-20df299e3fec None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:42.613779 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8b5ae-ff2e-4669-a9df-2d831d367629 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:42.635685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:42.653572 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c41284-fee6-44c4-9dec-a617314d5a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:42.654522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c41284-fee6-44c4-9dec-a617314d5a5e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:42.654946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c41284-fee6-44c4-9dec-a617314d5a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:42.655485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c41284-fee6-44c4-9dec-a617314d5a5e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:42.656080 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c41284-fee6-44c4-9dec-a617314d5a5e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:42.657433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c41284-fee6-44c4-9dec-a617314d5a5e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:42.659533 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-44c41284-fee6-44c4-9dec-a617314d5a5e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:42.669409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:42.670497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:42.670497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:42.670497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:42.670497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:42.670497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:42.670497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:42.670497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:42.670497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:42.670497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:42.670497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:42.670497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:42.670497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:42.670497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:42.670497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:42.670497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:42.670497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:42.671380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:42.671380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:42.671380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:42.671380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:42.671380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:42.671380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:42.671380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:42.671380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:42.671380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:42.671380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:42.671380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:42.671380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:42.671380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 15:10:42.671380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:42.671380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 440/896] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:10:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:42.678581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c41284-fee6-44c4-9dec-a617314d5a5e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:42.700217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697d071-439a-44de-b2c3-20df299e3fec None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:42.741249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645daa56-a6bc-4f75-aeb6-55da544c9710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:42.741886 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645daa56-a6bc-4f75-aeb6-55da544c9710 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:42.742166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645daa56-a6bc-4f75-aeb6-55da544c9710 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:42.742435 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645daa56-a6bc-4f75-aeb6-55da544c9710 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:42.743583 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645daa56-a6bc-4f75-aeb6-55da544c9710 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:42.743890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645daa56-a6bc-4f75-aeb6-55da544c9710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:42.745560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645daa56-a6bc-4f75-aeb6-55da544c9710 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:42.756524 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 457/897] 10.222.0.82 () {56 vars in 1115 bytes} [Fri Sep 23 15:10:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:42.762841 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645daa56-a6bc-4f75-aeb6-55da544c9710 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:42.796893 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c41284-fee6-44c4-9dec-a617314d5a5e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:42.832878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6c7fb-29ee-4591-94cd-fffaf64f7859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:42.833484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6c7fb-29ee-4591-94cd-fffaf64f7859 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:42.833788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6c7fb-29ee-4591-94cd-fffaf64f7859 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:42.834064 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6c7fb-29ee-4591-94cd-fffaf64f7859 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:42.834679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6c7fb-29ee-4591-94cd-fffaf64f7859 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:42.834981 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6c7fb-29ee-4591-94cd-fffaf64f7859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:42.836335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6c7fb-29ee-4591-94cd-fffaf64f7859 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:42.845593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 441/898] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:10:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:42.845593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6c7fb-29ee-4591-94cd-fffaf64f7859 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:42.872558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645daa56-a6bc-4f75-aeb6-55da544c9710 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:42.895024 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:42.907469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d693c-9297-4d63-a166-51ed8cb5608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:42.910521 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d693c-9297-4d63-a166-51ed8cb5608c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:42.910521 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d693c-9297-4d63-a166-51ed8cb5608c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:42.910521 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d693c-9297-4d63-a166-51ed8cb5608c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:42.918626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:42.920874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d693c-9297-4d63-a166-51ed8cb5608c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:42.922556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d693c-9297-4d63-a166-51ed8cb5608c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:42.937800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-3c7d693c-9297-4d63-a166-51ed8cb5608c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:42.937800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:42.937800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:42.937800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:42.937800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:42.937800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:42.937800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:42.937800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:42.937800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:42.937800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:42.937800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:42.937800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:42.937800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:42.937800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:42.937800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:42.937800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:42.938966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:42.940104 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:42.940104 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:42.940104 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:42.941686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 458/899] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:42.942758 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d693c-9297-4d63-a166-51ed8cb5608c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:42.957249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6c7fb-29ee-4591-94cd-fffaf64f7859 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:42.998591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50bd25-115a-4801-9594-879617b8c14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:42.999484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50bd25-115a-4801-9594-879617b8c14b None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:42.999773 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50bd25-115a-4801-9594-879617b8c14b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:43.000036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50bd25-115a-4801-9594-879617b8c14b None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:43.000699 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50bd25-115a-4801-9594-879617b8c14b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:43.002178 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50bd25-115a-4801-9594-879617b8c14b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:43.053150 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d693c-9297-4d63-a166-51ed8cb5608c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:43.086203 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1e2ed-580c-43aa-b4dc-9ed3de04cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:43.087365 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1e2ed-580c-43aa-b4dc-9ed3de04cb45 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:43.087640 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1e2ed-580c-43aa-b4dc-9ed3de04cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:43.087906 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1e2ed-580c-43aa-b4dc-9ed3de04cb45 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:43.088670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1e2ed-580c-43aa-b4dc-9ed3de04cb45 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:43.088971 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1e2ed-580c-43aa-b4dc-9ed3de04cb45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:43.090366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1e2ed-580c-43aa-b4dc-9ed3de04cb45 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:43.095192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 459/900] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Sep 23 15:10:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:43.095967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1e2ed-580c-43aa-b4dc-9ed3de04cb45 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:43.108495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 442/901] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Sep 23 15:10:42 2022] POST /identity/v3/services => generated 241 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:10:43.110866 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50bd25-115a-4801-9594-879617b8c14b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:43.166098 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:43.219497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1e2ed-580c-43aa-b4dc-9ed3de04cb45 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:43.264693 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6eb99a-61e0-41db-bcf0-f1108c0d9e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:43.265585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6eb99a-61e0-41db-bcf0-f1108c0d9e72 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:43.266229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6eb99a-61e0-41db-bcf0-f1108c0d9e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:43.266383 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6eb99a-61e0-41db-bcf0-f1108c0d9e72 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:43.267137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6eb99a-61e0-41db-bcf0-f1108c0d9e72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:43.267544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6eb99a-61e0-41db-bcf0-f1108c0d9e72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:43.269056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6eb99a-61e0-41db-bcf0-f1108c0d9e72 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:43.271209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50bd25-115a-4801-9594-879617b8c14b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:43.273812 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:43.288311 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 460/902] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:43.289412 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6eb99a-61e0-41db-bcf0-f1108c0d9e72 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:43.317497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e09dd0-1c8f-42e5-be82-98fb982b9690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:43.318176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09dd0-1c8f-42e5-be82-98fb982b9690 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:43.318451 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09dd0-1c8f-42e5-be82-98fb982b9690 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:43.318716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09dd0-1c8f-42e5-be82-98fb982b9690 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:43.319388 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e09dd0-1c8f-42e5-be82-98fb982b9690 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:43.321014 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e09dd0-1c8f-42e5-be82-98fb982b9690 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:43.410172 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6eb99a-61e0-41db-bcf0-f1108c0d9e72 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:43.425669 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:43.448728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c670a42-cd86-411e-8ec5-9c17004b5a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:43.449358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c670a42-cd86-411e-8ec5-9c17004b5a7e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:43.449640 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c670a42-cd86-411e-8ec5-9c17004b5a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:43.449945 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c670a42-cd86-411e-8ec5-9c17004b5a7e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:43.457029 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c670a42-cd86-411e-8ec5-9c17004b5a7e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:43.458503 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c670a42-cd86-411e-8ec5-9c17004b5a7e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:43.471544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-5c670a42-cd86-411e-8ec5-9c17004b5a7e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 15:10:43.471544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:43.471544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:43.471544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:43.471544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:43.471544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:43.471544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:43.471544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:43.471544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:43.471544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:43.471544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:43.471544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:43.471544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:43.471544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:43.471544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:43.471544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:43.472550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:43.473565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:43.473565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:43.473565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:43.473565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:43.473565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:43.473565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:43.473565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:43.473565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:43.473565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 15:10:43.473565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:43.473565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 461/903] 10.222.0.82 () {56 vars in 1117 bytes} [Fri Sep 23 15:10:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:43.480251 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c670a42-cd86-411e-8ec5-9c17004b5a7e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:43.487217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 443/904] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:10:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:10:43.505200 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1243ddb-c620-42d7-ab02-f5bff8bc35f1 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:43.505576 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1243ddb-c620-42d7-ab02-f5bff8bc35f1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:43.505767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1243ddb-c620-42d7-ab02-f5bff8bc35f1 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:43.507678 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 444/905] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:10:43.514151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ffb4e-cfcb-416c-b9ef-7b4c20d85065 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:43.514350 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ffb4e-cfcb-416c-b9ef-7b4c20d85065 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:43.514610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ffb4e-cfcb-416c-b9ef-7b4c20d85065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:43.538249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5c3ffb4e-cfcb-416c-b9ef-7b4c20d85065 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:43.539458 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5c3ffb4e-cfcb-416c-b9ef-7b4c20d85065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:43.608094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c670a42-cd86-411e-8ec5-9c17004b5a7e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:43.637899 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 445/906] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:10:43.655524 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8411ea2-3685-4aca-995f-1957ef0d8052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:43.656231 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8411ea2-3685-4aca-995f-1957ef0d8052 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:43.656515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8411ea2-3685-4aca-995f-1957ef0d8052 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:43.656789 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8411ea2-3685-4aca-995f-1957ef0d8052 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:43.657548 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8411ea2-3685-4aca-995f-1957ef0d8052 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:43.657892 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8411ea2-3685-4aca-995f-1957ef0d8052 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:43.659429 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8411ea2-3685-4aca-995f-1957ef0d8052 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:43.680042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 462/907] 10.222.0.82 () {56 vars in 1149 bytes} [Fri Sep 23 15:10:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:43.686174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ffb4e-cfcb-416c-b9ef-7b4c20d85065 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:43.786341 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:43.798419 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ffb4e-cfcb-416c-b9ef-7b4c20d85065 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:43.834885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf77777-75da-40a2-a795-cb85f657630a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:43.836001 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf77777-75da-40a2-a795-cb85f657630a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:43.836549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf77777-75da-40a2-a795-cb85f657630a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:43.837421 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf77777-75da-40a2-a795-cb85f657630a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:43.908659 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf77777-75da-40a2-a795-cb85f657630a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:43.910953 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8411ea2-3685-4aca-995f-1957ef0d8052 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:43.912176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf77777-75da-40a2-a795-cb85f657630a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:43.943868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:44.019993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8411ea2-3685-4aca-995f-1957ef0d8052 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:44.033721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:44.056811 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 446/908] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:10:43 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:10:44.063673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf77777-75da-40a2-a795-cb85f657630a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:44.071960 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c7a7e-92b5-4451-80ae-5d5f3e436d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:44.073402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c7a7e-92b5-4451-80ae-5d5f3e436d56 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:44.073679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c7a7e-92b5-4451-80ae-5d5f3e436d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:44.073979 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c7a7e-92b5-4451-80ae-5d5f3e436d56 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:44.074575 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c7a7e-92b5-4451-80ae-5d5f3e436d56 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:44.076260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c7a7e-92b5-4451-80ae-5d5f3e436d56 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:44.090582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-4e2c7a7e-92b5-4451-80ae-5d5f3e436d56 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:10:44.090582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:44.090582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:44.090582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:44.090582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:44.090582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:44.090582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:44.090582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:44.090582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:10:44.090582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:44.090582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:44.090582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:44.090582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:44.090582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:44.090582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:44.090582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:44.091772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:44.092679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:44.092679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:44.092679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:44.092679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:44.092679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:44.092679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:44.092679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:44.092679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:44.092679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:44.092679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:44.092679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:44.092679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:44.092679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:10:44.092679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:44.095460 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 463/909] 10.222.0.82 () {56 vars in 1132 bytes} [Fri Sep 23 15:10:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:44.101464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c7a7e-92b5-4451-80ae-5d5f3e436d56 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:44.185938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf77777-75da-40a2-a795-cb85f657630a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:44.222764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249883a8-69e7-4b84-8c1d-02ce897d6fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:44.223762 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249883a8-69e7-4b84-8c1d-02ce897d6fcc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:44.224246 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249883a8-69e7-4b84-8c1d-02ce897d6fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:44.224731 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249883a8-69e7-4b84-8c1d-02ce897d6fcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:44.234353 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:44.236863 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249883a8-69e7-4b84-8c1d-02ce897d6fcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:44.238572 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249883a8-69e7-4b84-8c1d-02ce897d6fcc None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:44.242418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c7a7e-92b5-4451-80ae-5d5f3e436d56 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:44.254895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-249883a8-69e7-4b84-8c1d-02ce897d6fcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:44.254895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:44.254895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:44.254895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:44.254895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:44.254895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:44.254895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:44.254895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:44.254895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:44.254895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:44.254895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:44.254895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:44.254895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:44.254895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:44.254895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:44.254895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:44.255853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:44.256768 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:44.256768 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:44.256768 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:44.258883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 447/910] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:44.264353 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249883a8-69e7-4b84-8c1d-02ce897d6fcc None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:44.283559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c38e08-407a-4455-b84d-76c85f5ea2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:44.284618 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c38e08-407a-4455-b84d-76c85f5ea2ac None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:44.285105 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c38e08-407a-4455-b84d-76c85f5ea2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:44.285569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c38e08-407a-4455-b84d-76c85f5ea2ac None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:44.286416 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c38e08-407a-4455-b84d-76c85f5ea2ac None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:44.286934 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c38e08-407a-4455-b84d-76c85f5ea2ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:44.288507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c38e08-407a-4455-b84d-76c85f5ea2ac None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:44.298931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 464/911] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Sep 23 15:10:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:44.304155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c38e08-407a-4455-b84d-76c85f5ea2ac None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:44.311780 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:44.384579 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249883a8-69e7-4b84-8c1d-02ce897d6fcc None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:44.423453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af662b-74a2-4ad7-9e52-671d09a30963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:44.424239 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af662b-74a2-4ad7-9e52-671d09a30963 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:44.424524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af662b-74a2-4ad7-9e52-671d09a30963 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:44.424801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af662b-74a2-4ad7-9e52-671d09a30963 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:44.425523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af662b-74a2-4ad7-9e52-671d09a30963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:44.425859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af662b-74a2-4ad7-9e52-671d09a30963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:44.427484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af662b-74a2-4ad7-9e52-671d09a30963 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:44.433212 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c38e08-407a-4455-b84d-76c85f5ea2ac None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:44.440802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 448/912] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:44.447222 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af662b-74a2-4ad7-9e52-671d09a30963 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:44.481212 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c2e9b-e361-4c12-b6bd-b6243b45ba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:44.482095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c2e9b-e361-4c12-b6bd-b6243b45ba2d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:44.482520 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c2e9b-e361-4c12-b6bd-b6243b45ba2d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:44.482923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c2e9b-e361-4c12-b6bd-b6243b45ba2d None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:44.483561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c2e9b-e361-4c12-b6bd-b6243b45ba2d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:44.483865 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c2e9b-e361-4c12-b6bd-b6243b45ba2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:44.485488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c2e9b-e361-4c12-b6bd-b6243b45ba2d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:44.493541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 465/913] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Sep 23 15:10:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:44.501153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c2e9b-e361-4c12-b6bd-b6243b45ba2d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:44.535500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:44.560281 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:44.570098 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af662b-74a2-4ad7-9e52-671d09a30963 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:44.607146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f8cdd-3e6d-41fb-88be-8ca5d7a3a7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:44.608028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f8cdd-3e6d-41fb-88be-8ca5d7a3a7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:44.608553 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f8cdd-3e6d-41fb-88be-8ca5d7a3a7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:44.608958 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f8cdd-3e6d-41fb-88be-8ca5d7a3a7b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:44.617672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f8cdd-3e6d-41fb-88be-8ca5d7a3a7b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:44.619303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f8cdd-3e6d-41fb-88be-8ca5d7a3a7b9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:44.631452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-7d0f8cdd-3e6d-41fb-88be-8ca5d7a3a7b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:44.631452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:44.631452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:44.631452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:44.631452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:44.631452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:44.631452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:44.631452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:44.631452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:44.631452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:44.631452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:44.631452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:44.631452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:44.631452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:44.631452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:44.632510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:44.633503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:44.633503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:44.633503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:44.633503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:44.633503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:44.633503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:44.633503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:44.633503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:44.635200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c2e9b-e361-4c12-b6bd-b6243b45ba2d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:44.635950 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 449/914] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:44.641200 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f8cdd-3e6d-41fb-88be-8ca5d7a3a7b9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:44.677853 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823c69e-dc24-4620-b54c-6c773793caf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:44.678568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823c69e-dc24-4620-b54c-6c773793caf8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:44.678919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823c69e-dc24-4620-b54c-6c773793caf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:44.679260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823c69e-dc24-4620-b54c-6c773793caf8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:44.680186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823c69e-dc24-4620-b54c-6c773793caf8 None admin] RBAC: Adding query filter params (interface=public, service_id=d383b65ffd56486abd9976f5382acd58, region_id=RegionOne) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:44.680593 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823c69e-dc24-4620-b54c-6c773793caf8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:44.682662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823c69e-dc24-4620-b54c-6c773793caf8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:44.690770 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 466/915] 10.222.0.82 () {56 vars in 1251 bytes} [Fri Sep 23 15:10:44 2022] GET /identity/v3/endpoints?service_id=d383b65ffd56486abd9976f5382acd58&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:44.697540 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823c69e-dc24-4620-b54c-6c773793caf8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:44.758222 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f8cdd-3e6d-41fb-88be-8ca5d7a3a7b9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:44.794913 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e35d1a-47eb-444f-ac53-986d72df9b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:44.795516 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35d1a-47eb-444f-ac53-986d72df9b82 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:44.795796 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35d1a-47eb-444f-ac53-986d72df9b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:44.796067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35d1a-47eb-444f-ac53-986d72df9b82 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:44.796755 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35d1a-47eb-444f-ac53-986d72df9b82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:44.797060 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35d1a-47eb-444f-ac53-986d72df9b82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:44.798505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35d1a-47eb-444f-ac53-986d72df9b82 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:44.811629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 450/916] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:44.821804 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e35d1a-47eb-444f-ac53-986d72df9b82 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:44.822965 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:44.838921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823c69e-dc24-4620-b54c-6c773793caf8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:44.846131 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:44.877283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08871fa-f0c1-4ff6-9877-689ed40b8fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:44.878003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08871fa-f0c1-4ff6-9877-689ed40b8fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:44.878292 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08871fa-f0c1-4ff6-9877-689ed40b8fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:44.878569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08871fa-f0c1-4ff6-9877-689ed40b8fb7 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:44.879328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08871fa-f0c1-4ff6-9877-689ed40b8fb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:44.880712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08871fa-f0c1-4ff6-9877-689ed40b8fb7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:44.887705 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 467/917] 10.222.0.82 () {56 vars in 1087 bytes} [Fri Sep 23 15:10:44 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:10:44.951039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e35d1a-47eb-444f-ac53-986d72df9b82 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:45.001542 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6777604-7ee5-41dd-94fb-dfd43e5c1689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:45.002236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6777604-7ee5-41dd-94fb-dfd43e5c1689 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:45.002517 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6777604-7ee5-41dd-94fb-dfd43e5c1689 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:45.002797 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6777604-7ee5-41dd-94fb-dfd43e5c1689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:45.003573 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6777604-7ee5-41dd-94fb-dfd43e5c1689 None admin] RBAC: Adding query filter params (role.id=761366d21b194095aa29578e791fe568, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=94a8ee59c6b24db9a67eb44a115fae85) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:45.003882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6777604-7ee5-41dd-94fb-dfd43e5c1689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:45.005460 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6777604-7ee5-41dd-94fb-dfd43e5c1689 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:45.013196 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 451/918] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:44 2022] GET /identity/v3/role_assignments?user.id=94a8ee59c6b24db9a67eb44a115fae85&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=761366d21b194095aa29578e791fe568 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:45.412986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41a645-279f-4312-a836-0d67538c6d3e None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:45.413491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41a645-279f-4312-a836-0d67538c6d3e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:45.413572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41a645-279f-4312-a836-0d67538c6d3e None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:45.415570 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 468/919] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:45.421376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a02cc-158d-4358-98fd-ac188850f5a5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:45.422434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a02cc-158d-4358-98fd-ac188850f5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:45.422914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a02cc-158d-4358-98fd-ac188850f5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:45.442420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-143a02cc-158d-4358-98fd-ac188850f5a5 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:45.443958 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-143a02cc-158d-4358-98fd-ac188850f5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:45.518447 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 452/920] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:45.791237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41a645-279f-4312-a836-0d67538c6d3e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:45.820796 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f9d28-e1d3-4e87-9b47-478d838ac99e None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:45.821070 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f9d28-e1d3-4e87-9b47-478d838ac99e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:45.821325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f9d28-e1d3-4e87-9b47-478d838ac99e None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:45.823193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 453/921] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:10:45.828890 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecedadb-a804-4ff2-8809-303b935f1c7a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:45.829203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecedadb-a804-4ff2-8809-303b935f1c7a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:45.829435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecedadb-a804-4ff2-8809-303b935f1c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:45.849243 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9ecedadb-a804-4ff2-8809-303b935f1c7a None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:45.850935 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9ecedadb-a804-4ff2-8809-303b935f1c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:45.854893 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:45.905277 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41a645-279f-4312-a836-0d67538c6d3e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:45.937976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 454/922] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:10:45.954084 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346e1cf-55a5-434d-b86c-91fa2cc7f930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:45.954793 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346e1cf-55a5-434d-b86c-91fa2cc7f930 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:45.955069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346e1cf-55a5-434d-b86c-91fa2cc7f930 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:45.955395 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346e1cf-55a5-434d-b86c-91fa2cc7f930 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:45.955991 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346e1cf-55a5-434d-b86c-91fa2cc7f930 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:45.957467 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346e1cf-55a5-434d-b86c-91fa2cc7f930 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-9346e1cf-55a5-434d-b86c-91fa2cc7f930 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:45.981757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:45.982826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:45.982826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:45.982826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:45.982826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:45.982826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:45.982826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:45.982826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:45.982826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:45.982826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:45.982826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:45.982826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:45.982826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:45.982826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:45.982826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:45.982826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:45.982826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:45.983702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:45.983702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:45.983702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:45.983702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:45.983702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:45.983702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:45.983702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:45.983702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:45.983702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:45.983702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:45.983702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:45.983702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:45.983702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 15:10:45.983702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:45.983702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 469/923] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Sep 23 15:10:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:45.984504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecedadb-a804-4ff2-8809-303b935f1c7a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:46.088615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecedadb-a804-4ff2-8809-303b935f1c7a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:46.125079 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d18b1-ca51-4004-af37-6ea2be2dae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:46.126076 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d18b1-ca51-4004-af37-6ea2be2dae80 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:46.126612 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d18b1-ca51-4004-af37-6ea2be2dae80 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:46.127088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d18b1-ca51-4004-af37-6ea2be2dae80 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:46.127912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d18b1-ca51-4004-af37-6ea2be2dae80 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:46.128436 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d18b1-ca51-4004-af37-6ea2be2dae80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:46.130135 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d18b1-ca51-4004-af37-6ea2be2dae80 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:46.136218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 455/924] 10.222.0.82 () {56 vars in 1122 bytes} [Fri Sep 23 15:10:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:46.145863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346e1cf-55a5-434d-b86c-91fa2cc7f930 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:46.158748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:46.229619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d18b1-ca51-4004-af37-6ea2be2dae80 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:46.233722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:46.251588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346e1cf-55a5-434d-b86c-91fa2cc7f930 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:46.295506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388e647-8370-4d61-a8bf-2e3a945790fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:46.296114 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388e647-8370-4d61-a8bf-2e3a945790fa None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:46.296393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388e647-8370-4d61-a8bf-2e3a945790fa None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:46.296665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388e647-8370-4d61-a8bf-2e3a945790fa None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:46.297294 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388e647-8370-4d61-a8bf-2e3a945790fa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:46.297598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388e647-8370-4d61-a8bf-2e3a945790fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:46.299000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388e647-8370-4d61-a8bf-2e3a945790fa None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:46.308089 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 470/925] 10.222.0.82 () {56 vars in 1122 bytes} [Fri Sep 23 15:10:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:46.313563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388e647-8370-4d61-a8bf-2e3a945790fa None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:46.355207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d18b1-ca51-4004-af37-6ea2be2dae80 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:46.401290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a92e0-dd55-4a93-9e02-c0e26e2ec0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:46.402430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a92e0-dd55-4a93-9e02-c0e26e2ec0f4 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:46.403017 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a92e0-dd55-4a93-9e02-c0e26e2ec0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:46.403534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a92e0-dd55-4a93-9e02-c0e26e2ec0f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:46.404364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a92e0-dd55-4a93-9e02-c0e26e2ec0f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:46.406431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a92e0-dd55-4a93-9e02-c0e26e2ec0f4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:46.410144 dv-cinder-855013-3-smb devstack@keystone.service[81643]: WARNING keystone.server.flask.common [None req-4d2a92e0-dd55-4a93-9e02-c0e26e2ec0f4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 23 15:10:46.417470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:46.442200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388e647-8370-4d61-a8bf-2e3a945790fa None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:46.477715 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca104d-6fc5-4a06-8f4f-fd12b16f2555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:46.478344 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca104d-6fc5-4a06-8f4f-fd12b16f2555 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:46.478643 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca104d-6fc5-4a06-8f4f-fd12b16f2555 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:46.478887 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca104d-6fc5-4a06-8f4f-fd12b16f2555 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:46.479574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca104d-6fc5-4a06-8f4f-fd12b16f2555 None admin] RBAC: Adding query filter params (interface=public, service_id=9c974b3de23e4284a909c92bb8367a54, region_id=RegionOne) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:46.479874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca104d-6fc5-4a06-8f4f-fd12b16f2555 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:46.481241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca104d-6fc5-4a06-8f4f-fd12b16f2555 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:46.484476 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.sql.core [None req-4d2a92e0-dd55-4a93-9e02-c0e26e2ec0f4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 23 15:10:46.484476 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 23 15:10:46.484476 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [parameters: {'id': '3139a17697b0490da234a65e88a8e4a2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 23 15:10:46.484476 dv-cinder-855013-3-smb devstack@keystone.service[81643]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81643) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 23 15:10:46.488964 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 471/926] 10.222.0.82 () {56 vars in 1251 bytes} [Fri Sep 23 15:10:46 2022] GET /identity/v3/endpoints?service_id=9c974b3de23e4284a909c92bb8367a54&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:46.497483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca104d-6fc5-4a06-8f4f-fd12b16f2555 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:46.507946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4d2a92e0-dd55-4a93-9e02-c0e26e2ec0f4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3139a17697b0490da234a65e88a8e4a2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3139a17697b0490da234a65e88a8e4a2. Sep 23 15:10:46.507946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:46.507946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 15:10:46.507946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 15:10:46.507946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 15:10:46.507946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 15:10:46.507946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 15:10:46.507946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 15:10:46.507946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 15:10:46.507946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application conn.query(q) Sep 23 15:10:46.507946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 15:10:46.507946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 15:10:46.507946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application result.read() Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 23 15:10:46.508940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application next(self.gen) Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application yield resource Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application next(self.gen) Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.session.rollback() Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.force_reraise() Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise self.value Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application session.commit() Sep 23 15:10:46.510382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._prepare_impl() Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.session.flush() Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._flush(objects) Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application compat.raise_( Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application flush_context.execute() Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 15:10:46.511313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rec.execute(self) Sep 23 15:10:46.512218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 15:10:46.512218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 23 15:10:46.512218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 15:10:46.512218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 23 15:10:46.512218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 23 15:10:46.512218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 23 15:10:46.512218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 15:10:46.512218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 15:10:46.512218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 15:10:46.512218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 23 15:10:46.512218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 15:10:46.512218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 23 15:10:46.512218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 15:10:46.512218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 23 15:10:46.512218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application conn.query(q) Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application result.read() Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 15:10:46.513031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 15:10:46.515917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 15:10:46.515917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 15:10:46.515917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 15:10:46.515917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 15:10:46.515917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 15:10:46.515917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 15:10:46.515917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 23 15:10:46.515917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 23 15:10:46.515917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [parameters: {'id': '3139a17697b0490da234a65e88a8e4a2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 23 15:10:46.515917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 15:10:46.515917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:46.515917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:46.515917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:46.515917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:46.515917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:46.517898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:46.520126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:46.520126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 23 15:10:46.520126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 23 15:10:46.520126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:46.520126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:46.520126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 23 15:10:46.520126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 23 15:10:46.520126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3139a17697b0490da234a65e88a8e4a2. Sep 23 15:10:46.520126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:46.520126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 456/927] 10.222.0.82 () {60 vars in 1140 bytes} [Fri Sep 23 15:10:46 2022] POST /identity/v3/projects => generated 262 bytes in 280 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:46.520126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a92e0-dd55-4a93-9e02-c0e26e2ec0f4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:46.593295 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:46.635430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca104d-6fc5-4a06-8f4f-fd12b16f2555 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:46.647039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a92e0-dd55-4a93-9e02-c0e26e2ec0f4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:46.674257 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a255eee-de64-4884-a4ac-d7f2d2ce90e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:46.675274 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a255eee-de64-4884-a4ac-d7f2d2ce90e7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:46.675790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a255eee-de64-4884-a4ac-d7f2d2ce90e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:46.676261 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a255eee-de64-4884-a4ac-d7f2d2ce90e7 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:46.677064 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a255eee-de64-4884-a4ac-d7f2d2ce90e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:46.678680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a255eee-de64-4884-a4ac-d7f2d2ce90e7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:46.687700 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 472/928] 10.222.0.82 () {56 vars in 1087 bytes} [Fri Sep 23 15:10:46 2022] GET /identity/v3/services => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:10:46.695677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73467e65-ed16-4e9f-a59a-3bf73c6e11c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:46.697323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73467e65-ed16-4e9f-a59a-3bf73c6e11c7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:46.697913 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73467e65-ed16-4e9f-a59a-3bf73c6e11c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:46.698404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73467e65-ed16-4e9f-a59a-3bf73c6e11c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:46.706820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73467e65-ed16-4e9f-a59a-3bf73c6e11c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:46.710006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73467e65-ed16-4e9f-a59a-3bf73c6e11c7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:46.723453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-73467e65-ed16-4e9f-a59a-3bf73c6e11c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:46.723453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:46.723453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:46.723453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:46.723453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:46.723453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:46.723453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:46.723453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:46.723453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:46.723453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:46.723453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:46.723453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:46.723453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:46.723453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:46.723453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:46.724484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:46.725443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:46.725443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:46.725443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:46.725443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:46.725443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:46.725443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:46.725443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:46.725443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:46.728143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 457/929] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:46.733756 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a255eee-de64-4884-a4ac-d7f2d2ce90e7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:46.744571 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:46.847696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a255eee-de64-4884-a4ac-d7f2d2ce90e7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:46.892055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da0175-8a18-4e1d-84e1-12e4f37dfea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:46.892939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0175-8a18-4e1d-84e1-12e4f37dfea0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:46.893394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0175-8a18-4e1d-84e1-12e4f37dfea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:46.893827 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0175-8a18-4e1d-84e1-12e4f37dfea0 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:46.894641 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da0175-8a18-4e1d-84e1-12e4f37dfea0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:46.895090 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da0175-8a18-4e1d-84e1-12e4f37dfea0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:46.896772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da0175-8a18-4e1d-84e1-12e4f37dfea0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:46.916887 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 473/930] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Sep 23 15:10:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:47.146062 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0690572-d104-4fbe-96ac-c54563b79789 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:47.146280 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0690572-d104-4fbe-96ac-c54563b79789 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:47.146560 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0690572-d104-4fbe-96ac-c54563b79789 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:47.151005 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 458/931] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:47.156551 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b56858-e90e-409b-8003-14d7791388ff None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:47.156836 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b56858-e90e-409b-8003-14d7791388ff None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:47.157110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b56858-e90e-409b-8003-14d7791388ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:47.178869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-09b56858-e90e-409b-8003-14d7791388ff None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:47.180131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-09b56858-e90e-409b-8003-14d7791388ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:47.246027 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:47.253994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 474/932] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:47.291168 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d7e24-6e68-49ce-bb19-a2b54dfc59e2 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:47.291449 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d7e24-6e68-49ce-bb19-a2b54dfc59e2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:47.291722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d7e24-6e68-49ce-bb19-a2b54dfc59e2 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:47.293333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 459/933] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:47.299327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e395658-e027-4fc8-920f-0e6318190fd1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:47.299701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e395658-e027-4fc8-920f-0e6318190fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:47.300056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e395658-e027-4fc8-920f-0e6318190fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:47.318719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9e395658-e027-4fc8-920f-0e6318190fd1 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:47.320076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9e395658-e027-4fc8-920f-0e6318190fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:47.393849 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 475/934] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:47.533368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d7e24-6e68-49ce-bb19-a2b54dfc59e2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:47.660549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d7e24-6e68-49ce-bb19-a2b54dfc59e2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:47.681899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e395658-e027-4fc8-920f-0e6318190fd1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:47.698136 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:47.716194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88adfc-5e46-4cc6-bff1-f3ee713feb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:47.716986 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88adfc-5e46-4cc6-bff1-f3ee713feb4b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:47.717270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88adfc-5e46-4cc6-bff1-f3ee713feb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:47.717546 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88adfc-5e46-4cc6-bff1-f3ee713feb4b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:47.718185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88adfc-5e46-4cc6-bff1-f3ee713feb4b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:47.719650 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88adfc-5e46-4cc6-bff1-f3ee713feb4b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:47.730523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-2e88adfc-5e46-4cc6-bff1-f3ee713feb4b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:10:47.730523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:47.730523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:47.730523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:47.730523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:47.730523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:47.730523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:47.730523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:47.730523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:10:47.730523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:47.730523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:47.730523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:47.730523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:47.730523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:47.730523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:47.730523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:47.731509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:47.732459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:47.732459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:47.732459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:47.732459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:47.732459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:47.732459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:47.732459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:47.732459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:47.732459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:47.732459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:47.732459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:47.732459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:47.732459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 15:10:47.732459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:47.732459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 460/935] 10.222.0.82 () {56 vars in 1132 bytes} [Fri Sep 23 15:10:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:47.738759 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88adfc-5e46-4cc6-bff1-f3ee713feb4b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:47.855535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88adfc-5e46-4cc6-bff1-f3ee713feb4b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:47.893575 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e395658-e027-4fc8-920f-0e6318190fd1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:47.908253 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5365c-00fc-4c68-aa98-916b62e5d55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:47.908866 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5365c-00fc-4c68-aa98-916b62e5d55a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:47.909151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5365c-00fc-4c68-aa98-916b62e5d55a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:47.909426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5365c-00fc-4c68-aa98-916b62e5d55a None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:47.910092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5365c-00fc-4c68-aa98-916b62e5d55a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:47.910397 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5365c-00fc-4c68-aa98-916b62e5d55a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:47.911848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5365c-00fc-4c68-aa98-916b62e5d55a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:47.923338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 461/936] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Sep 23 15:10:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:47.929767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5365c-00fc-4c68-aa98-916b62e5d55a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:47.974984 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:47.991084 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e410cf-e836-4788-bcbe-412b5b743a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:47.993699 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e410cf-e836-4788-bcbe-412b5b743a2b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:47.994022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e410cf-e836-4788-bcbe-412b5b743a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:47.994299 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e410cf-e836-4788-bcbe-412b5b743a2b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:48.014321 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e410cf-e836-4788-bcbe-412b5b743a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:48.019340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d8e410cf-e836-4788-bcbe-412b5b743a2b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 15:10:48.019340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:48.019340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:48.019340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:48.019340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:48.019340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:48.019340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:48.019340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:48.019340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:48.019340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:48.019340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:48.019340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:48.019340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:48.019340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:48.019340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:48.019340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:48.020382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:48.020382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:48.020382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:48.020382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:48.020382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:48.020382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:48.020382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:48.020382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:48.020382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:48.020382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:48.020382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:48.020382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:48.020382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:48.020382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:48.020382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:48.020382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:48.021229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:48.021229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:48.021229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:48.021229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:48.021229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:48.021229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:48.021229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:48.021229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:48.021229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:48.021229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:48.021229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 15:10:48.021229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:48.025659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 476/937] 10.222.0.82 () {56 vars in 1120 bytes} [Fri Sep 23 15:10:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:48.027755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e410cf-e836-4788-bcbe-412b5b743a2b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:48.028581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:48.128383 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5365c-00fc-4c68-aa98-916b62e5d55a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:48.184558 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6382ea2-7e57-4db9-81e7-754871fee63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:48.185863 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6382ea2-7e57-4db9-81e7-754871fee63a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:48.186157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6382ea2-7e57-4db9-81e7-754871fee63a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:48.186435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6382ea2-7e57-4db9-81e7-754871fee63a None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:48.187375 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6382ea2-7e57-4db9-81e7-754871fee63a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:48.187684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6382ea2-7e57-4db9-81e7-754871fee63a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:48.189263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6382ea2-7e57-4db9-81e7-754871fee63a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:48.201495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 462/938] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Sep 23 15:10:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:48.202744 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6382ea2-7e57-4db9-81e7-754871fee63a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:48.226024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e410cf-e836-4788-bcbe-412b5b743a2b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:48.272226 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd7e92-1657-4990-abe4-e97a571c5968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:48.272902 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd7e92-1657-4990-abe4-e97a571c5968 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:48.273207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd7e92-1657-4990-abe4-e97a571c5968 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:48.273481 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd7e92-1657-4990-abe4-e97a571c5968 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:48.274305 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd7e92-1657-4990-abe4-e97a571c5968 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:48.274633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd7e92-1657-4990-abe4-e97a571c5968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:48.276175 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd7e92-1657-4990-abe4-e97a571c5968 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:48.290549 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 477/939] 10.222.0.82 () {56 vars in 1115 bytes} [Fri Sep 23 15:10:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:48.292462 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd7e92-1657-4990-abe4-e97a571c5968 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:48.330815 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6382ea2-7e57-4db9-81e7-754871fee63a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:48.346823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:48.349969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:48.382878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a2a0f-9e4c-4e42-b75c-6aa254eb82fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:48.384516 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a2a0f-9e4c-4e42-b75c-6aa254eb82fc None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:48.384991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a2a0f-9e4c-4e42-b75c-6aa254eb82fc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:48.385482 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a2a0f-9e4c-4e42-b75c-6aa254eb82fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:48.387361 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a2a0f-9e4c-4e42-b75c-6aa254eb82fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:48.389825 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a2a0f-9e4c-4e42-b75c-6aa254eb82fc None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:48.404612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd7e92-1657-4990-abe4-e97a571c5968 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:48.442421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183dc31-0990-48d5-bd1b-53083f56f44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:48.443055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183dc31-0990-48d5-bd1b-53083f56f44c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:48.443335 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183dc31-0990-48d5-bd1b-53083f56f44c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:48.443608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183dc31-0990-48d5-bd1b-53083f56f44c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:48.454860 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183dc31-0990-48d5-bd1b-53083f56f44c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:48.456340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183dc31-0990-48d5-bd1b-53083f56f44c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:48.470910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-9183dc31-0990-48d5-bd1b-53083f56f44c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:48.470910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:48.470910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:48.470910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:48.470910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:48.470910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:48.470910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:48.470910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:48.470910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:48.470910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:48.470910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:48.470910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:48.470910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:48.470910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:48.470910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:48.470910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:48.471924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:48.472941 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:48.472941 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:48.472941 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:48.474004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 478/940] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:48.478537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183dc31-0990-48d5-bd1b-53083f56f44c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:48.548960 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 463/941] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:10:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:10:48.600232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:48.605494 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183dc31-0990-48d5-bd1b-53083f56f44c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:48.653586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82fd31-796f-4f1a-9fa1-ff53d35c07f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:48.654600 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82fd31-796f-4f1a-9fa1-ff53d35c07f0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:48.655047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82fd31-796f-4f1a-9fa1-ff53d35c07f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:48.655480 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82fd31-796f-4f1a-9fa1-ff53d35c07f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:48.656358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82fd31-796f-4f1a-9fa1-ff53d35c07f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:48.656814 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82fd31-796f-4f1a-9fa1-ff53d35c07f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:48.658597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82fd31-796f-4f1a-9fa1-ff53d35c07f0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:48.674667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 479/942] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:48.681429 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a2a0f-9e4c-4e42-b75c-6aa254eb82fc None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:48.797767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a2a0f-9e4c-4e42-b75c-6aa254eb82fc None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:48.835471 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b308a-bb4f-4717-bef1-7149103a00e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:48.836110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b308a-bb4f-4717-bef1-7149103a00e9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:48.836939 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b308a-bb4f-4717-bef1-7149103a00e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:48.837218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b308a-bb4f-4717-bef1-7149103a00e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:48.845349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b308a-bb4f-4717-bef1-7149103a00e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:48.846850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b308a-bb4f-4717-bef1-7149103a00e9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:48.859021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ee1b308a-bb4f-4717-bef1-7149103a00e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 15:10:48.859021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:48.859021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:48.859021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:48.859021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:48.859021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:48.859021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:48.859021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:48.859021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:48.859021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:48.859021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:48.859021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:48.859021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:48.859021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:48.859021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:48.859021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:48.860038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:48.861010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:48.861010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:48.861010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:48.861010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:48.861010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:48.861010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:48.861010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:48.861010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:48.861010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 15:10:48.861010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:48.861010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 464/943] 10.222.0.82 () {56 vars in 1117 bytes} [Fri Sep 23 15:10:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:48.867775 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82fd31-796f-4f1a-9fa1-ff53d35c07f0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:48.996636 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82fd31-796f-4f1a-9fa1-ff53d35c07f0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:49.008865 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d201f92-75c7-4f1c-966b-226bd70f035c None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:49.009140 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d201f92-75c7-4f1c-966b-226bd70f035c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:49.009416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d201f92-75c7-4f1c-966b-226bd70f035c None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:49.011035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 465/944] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:10:49.016216 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07678674-49b4-466b-90ab-b261378f06aa None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:49.016480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07678674-49b4-466b-90ab-b261378f06aa None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:49.016747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07678674-49b4-466b-90ab-b261378f06aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:49.036616 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-07678674-49b4-466b-90ab-b261378f06aa None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:49.038244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-07678674-49b4-466b-90ab-b261378f06aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:49.040100 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5bd5f-9af5-4f5c-9903-3a659d84e451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:49.041430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5bd5f-9af5-4f5c-9903-3a659d84e451 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:49.042825 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5bd5f-9af5-4f5c-9903-3a659d84e451 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:49.043283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5bd5f-9af5-4f5c-9903-3a659d84e451 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:49.044167 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5bd5f-9af5-4f5c-9903-3a659d84e451 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:49.044627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5bd5f-9af5-4f5c-9903-3a659d84e451 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:49.046360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5bd5f-9af5-4f5c-9903-3a659d84e451 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:49.064328 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:49.074201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 480/945] 10.222.0.82 () {56 vars in 1149 bytes} [Fri Sep 23 15:10:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:49.080301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5bd5f-9af5-4f5c-9903-3a659d84e451 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:49.101672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:49.118326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 466/946] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:10:49.201867 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5bd5f-9af5-4f5c-9903-3a659d84e451 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:49.239413 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b632c2-7646-4e00-8870-c33c90931718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:49.240298 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b632c2-7646-4e00-8870-c33c90931718 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:49.240728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b632c2-7646-4e00-8870-c33c90931718 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:49.241151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b632c2-7646-4e00-8870-c33c90931718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:49.242939 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898624b0-61da-4b99-9eaa-c6302b0183d9 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:49.243227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898624b0-61da-4b99-9eaa-c6302b0183d9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:49.243501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898624b0-61da-4b99-9eaa-c6302b0183d9 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:49.245099 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 467/947] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:10:49.250047 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877aaf19-887b-4803-8997-a3f1df67adb0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:49.250332 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877aaf19-887b-4803-8997-a3f1df67adb0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:49.250607 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877aaf19-887b-4803-8997-a3f1df67adb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:49.253927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b632c2-7646-4e00-8870-c33c90931718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:49.255573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b632c2-7646-4e00-8870-c33c90931718 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:49.269640 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-877aaf19-887b-4803-8997-a3f1df67adb0 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:49.270869 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-877aaf19-887b-4803-8997-a3f1df67adb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:49.272439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-42b632c2-7646-4e00-8870-c33c90931718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:49.272439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:49.272439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:49.272439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:49.272439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:49.272439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:49.272439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:49.272439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:49.272439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:49.272439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:49.272439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:49.272439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:49.272439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:49.272439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:49.272439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:49.272439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:49.273580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:49.274780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:49.274780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:49.274780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:49.275144 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 481/948] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:49.280687 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b632c2-7646-4e00-8870-c33c90931718 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:49.358693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 468/949] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:10:49.366046 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:49.391859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877aaf19-887b-4803-8997-a3f1df67adb0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:49.404614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b632c2-7646-4e00-8870-c33c90931718 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:49.446492 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf9655-f62b-4fef-89b5-01a5358c91a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:49.447458 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf9655-f62b-4fef-89b5-01a5358c91a6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:49.447874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf9655-f62b-4fef-89b5-01a5358c91a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:49.448408 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf9655-f62b-4fef-89b5-01a5358c91a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:49.449176 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf9655-f62b-4fef-89b5-01a5358c91a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:49.449615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf9655-f62b-4fef-89b5-01a5358c91a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:49.451242 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf9655-f62b-4fef-89b5-01a5358c91a6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:49.465137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 482/950] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:49.470600 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf9655-f62b-4fef-89b5-01a5358c91a6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:49.495687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:49.510426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877aaf19-887b-4803-8997-a3f1df67adb0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:49.549563 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5b75f-8767-4edc-aee7-2f995f3558c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:49.550234 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5b75f-8767-4edc-aee7-2f995f3558c7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:49.550490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5b75f-8767-4edc-aee7-2f995f3558c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:49.551004 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5b75f-8767-4edc-aee7-2f995f3558c7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:49.552067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5b75f-8767-4edc-aee7-2f995f3558c7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:49.554239 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5b75f-8767-4edc-aee7-2f995f3558c7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-69f5b75f-8767-4edc-aee7-2f995f3558c7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:49.566301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:49.567569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:49.567569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:49.567569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:49.567569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:49.567569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:49.567569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:49.567569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:49.567569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:49.567569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:49.567569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:49.567569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:49.567569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:49.567569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:49.567569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:49.567569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:49.567569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:49.568745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:49.568745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:49.568745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:49.568745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:49.568745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:49.568745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:49.568745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:49.568745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:49.568745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:49.568745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:49.568745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:49.568745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:49.568745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 15:10:49.568745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:49.574901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 469/951] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Sep 23 15:10:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:49.577396 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5b75f-8767-4edc-aee7-2f995f3558c7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:49.608637 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf9655-f62b-4fef-89b5-01a5358c91a6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:49.642344 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:49.652524 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784c8f6-3c89-4c19-9cc3-160be4511f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:49.658506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784c8f6-3c89-4c19-9cc3-160be4511f10 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:49.658506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784c8f6-3c89-4c19-9cc3-160be4511f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:49.658506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784c8f6-3c89-4c19-9cc3-160be4511f10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:49.660903 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784c8f6-3c89-4c19-9cc3-160be4511f10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:49.662405 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784c8f6-3c89-4c19-9cc3-160be4511f10 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:49.673907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7784c8f6-3c89-4c19-9cc3-160be4511f10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:49.673907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:49.673907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:49.673907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:49.673907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:49.673907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:49.673907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:49.673907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:49.673907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:49.673907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:49.673907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:49.673907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:49.673907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:49.673907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:49.673907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:49.674898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:49.675851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:49.675851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:49.675851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:49.675851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:49.675851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:49.675851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:49.675851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:49.675851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:49.675851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 483/952] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:49.675851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784c8f6-3c89-4c19-9cc3-160be4511f10 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:49.698021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5b75f-8767-4edc-aee7-2f995f3558c7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:49.734431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095959f9-178d-407d-8d13-3de6e61aba5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:49.735043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095959f9-178d-407d-8d13-3de6e61aba5c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:49.735325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095959f9-178d-407d-8d13-3de6e61aba5c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:49.735595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095959f9-178d-407d-8d13-3de6e61aba5c None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:49.736362 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095959f9-178d-407d-8d13-3de6e61aba5c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:49.736906 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095959f9-178d-407d-8d13-3de6e61aba5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:49.739034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095959f9-178d-407d-8d13-3de6e61aba5c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:49.749567 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 470/953] 10.222.0.82 () {56 vars in 1122 bytes} [Fri Sep 23 15:10:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:49.749567 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095959f9-178d-407d-8d13-3de6e61aba5c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:49.769912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:49.785211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784c8f6-3c89-4c19-9cc3-160be4511f10 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:49.823437 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ed7a9-c81f-40d8-ad65-2450374ef46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:49.824085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ed7a9-c81f-40d8-ad65-2450374ef46f None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:49.824365 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ed7a9-c81f-40d8-ad65-2450374ef46f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:49.824637 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ed7a9-c81f-40d8-ad65-2450374ef46f None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:49.825279 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ed7a9-c81f-40d8-ad65-2450374ef46f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:49.826899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ed7a9-c81f-40d8-ad65-2450374ef46f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:49.829306 dv-cinder-855013-3-smb devstack@keystone.service[81642]: WARNING keystone.server.flask.common [None req-fc8ed7a9-c81f-40d8-ad65-2450374ef46f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 23 15:10:49.856106 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095959f9-178d-407d-8d13-3de6e61aba5c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:49.877534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.sql.core [None req-fc8ed7a9-c81f-40d8-ad65-2450374ef46f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 23 15:10:49.877534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 23 15:10:49.877534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [parameters: {'user_id': '7a2e8be5a4164db794970681e42b4330', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 23 15:10:49.877534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81642) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 23 15:10:49.886479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-fc8ed7a9-c81f-40d8-ad65-2450374ef46f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 23 15:10:49.886479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:49.886479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 15:10:49.886479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 15:10:49.886479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 15:10:49.886479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 15:10:49.886479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 15:10:49.886479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 15:10:49.886479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 15:10:49.886479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application conn.query(q) Sep 23 15:10:49.886479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 15:10:49.886479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 15:10:49.886479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 15:10:49.886479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result.read() Sep 23 15:10:49.886479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 15:10:49.890939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application next(self.gen) Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application yield resource Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application next(self.gen) Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.session.rollback() Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.force_reraise() Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise self.value Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application session.commit() Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 23 15:10:49.891940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._prepare_impl() Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.session.flush() Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._flush(objects) Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application compat.raise_( Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application flush_context.execute() Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rec.execute(self) Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 15:10:49.892937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 23 15:10:49.893877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 15:10:49.893877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 23 15:10:49.893877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 23 15:10:49.893877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 23 15:10:49.893877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 15:10:49.893877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 15:10:49.893877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 15:10:49.893877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 23 15:10:49.893877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 15:10:49.893877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 23 15:10:49.893877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 15:10:49.893877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 23 15:10:49.893877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 15:10:49.893877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 15:10:49.893877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 15:10:49.893877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception Sep 23 15:10:49.894790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 15:10:49.894790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 15:10:49.894790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 15:10:49.894790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 15:10:49.894790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 15:10:49.894790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 15:10:49.894790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 15:10:49.894790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application conn.query(q) Sep 23 15:10:49.894790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 15:10:49.894790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 15:10:49.894790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 15:10:49.894790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result.read() Sep 23 15:10:49.894790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 15:10:49.894790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 15:10:49.894790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 15:10:49.894790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 15:10:49.895638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 15:10:49.895638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 15:10:49.895638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 15:10:49.895638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 15:10:49.895638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 23 15:10:49.895638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 23 15:10:49.895638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [parameters: {'user_id': '7a2e8be5a4164db794970681e42b4330', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 23 15:10:49.895638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 15:10:49.895638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:49.895638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:49.895638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:49.895638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:49.895638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:49.895638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:49.895638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 23 15:10:49.896469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 23 15:10:49.897418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 23 15:10:49.897418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 23 15:10:49.897418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 23 15:10:49.897418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 23 15:10:49.897418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 23 15:10:49.897418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:49.897418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 484/954] 10.222.0.82 () {60 vars in 1131 bytes} [Fri Sep 23 15:10:49 2022] POST /identity/v3/users => generated 160 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:49.897418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ed7a9-c81f-40d8-ad65-2450374ef46f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:49.905907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83647bb9-3158-4923-a34e-03301ce3b475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:49.906080 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83647bb9-3158-4923-a34e-03301ce3b475 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:49.906366 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83647bb9-3158-4923-a34e-03301ce3b475 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:49.906701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83647bb9-3158-4923-a34e-03301ce3b475 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:49.907397 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83647bb9-3158-4923-a34e-03301ce3b475 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:49.907700 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83647bb9-3158-4923-a34e-03301ce3b475 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:49.909152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83647bb9-3158-4923-a34e-03301ce3b475 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:49.925767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 471/955] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:49.931808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83647bb9-3158-4923-a34e-03301ce3b475 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:49.946705 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:50.005822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ed7a9-c81f-40d8-ad65-2450374ef46f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:50.019286 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:50.043443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83647bb9-3158-4923-a34e-03301ce3b475 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:50.043615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55b1d8-ee22-40a4-9984-decbb575eb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:50.044106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55b1d8-ee22-40a4-9984-decbb575eb5a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:50.044390 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55b1d8-ee22-40a4-9984-decbb575eb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:50.044678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55b1d8-ee22-40a4-9984-decbb575eb5a None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:50.045409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55b1d8-ee22-40a4-9984-decbb575eb5a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:50.045716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55b1d8-ee22-40a4-9984-decbb575eb5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:50.047430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55b1d8-ee22-40a4-9984-decbb575eb5a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:50.060877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 485/956] 10.222.0.82 () {56 vars in 1122 bytes} [Fri Sep 23 15:10:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:50.060877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55b1d8-ee22-40a4-9984-decbb575eb5a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:50.084464 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e30229-9ecd-4b00-8340-b81481912a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:50.085159 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e30229-9ecd-4b00-8340-b81481912a10 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:50.085515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e30229-9ecd-4b00-8340-b81481912a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:50.085805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e30229-9ecd-4b00-8340-b81481912a10 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:50.093577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e30229-9ecd-4b00-8340-b81481912a10 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:50.095129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e30229-9ecd-4b00-8340-b81481912a10 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:50.107151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-93e30229-9ecd-4b00-8340-b81481912a10 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 15:10:50.107151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:50.107151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:50.107151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:50.107151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:50.107151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:50.107151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:50.107151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:50.107151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:50.107151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:50.107151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:50.107151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:50.107151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:50.107151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:50.107151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:50.107151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:50.108114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:50.109082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:50.109082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:50.109082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:50.109082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:50.109082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:50.109082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:50.109082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:50.109082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:50.109082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 15:10:50.109082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:50.109082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 472/957] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:10:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:50.109082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e30229-9ecd-4b00-8340-b81481912a10 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:50.172858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55b1d8-ee22-40a4-9984-decbb575eb5a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:50.186868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:50.209451 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704885cd-76e8-45bd-bb9d-e280cf9880a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:50.210138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704885cd-76e8-45bd-bb9d-e280cf9880a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:50.210420 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704885cd-76e8-45bd-bb9d-e280cf9880a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:50.210696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704885cd-76e8-45bd-bb9d-e280cf9880a9 None admin] PATH_INFO: `/v3/projects/718a472b7d564c429849b127a44aaaad/users/94a8ee59c6b24db9a67eb44a115fae85/roles/761366d21b194095aa29578e791fe568` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:50.213029 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704885cd-76e8-45bd-bb9d-e280cf9880a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=718a472b7d564c429849b127a44aaaad, user_id=94a8ee59c6b24db9a67eb44a115fae85, role_id=761366d21b194095aa29578e791fe568)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:50.214568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704885cd-76e8-45bd-bb9d-e280cf9880a9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:50.221650 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e30229-9ecd-4b00-8340-b81481912a10 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:50.256338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99240293-fc22-40fa-a6ef-5a217dfbe991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:50.256864 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99240293-fc22-40fa-a6ef-5a217dfbe991 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:50.257143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99240293-fc22-40fa-a6ef-5a217dfbe991 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:50.257416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99240293-fc22-40fa-a6ef-5a217dfbe991 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:50.258134 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99240293-fc22-40fa-a6ef-5a217dfbe991 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:50.259493 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99240293-fc22-40fa-a6ef-5a217dfbe991 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:50.264875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:50.398575 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 486/958] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:10:50 2022] PUT /identity/v3/projects/718a472b7d564c429849b127a44aaaad/users/94a8ee59c6b24db9a67eb44a115fae85/roles/761366d21b194095aa29578e791fe568 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:10:50.400025 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704885cd-76e8-45bd-bb9d-e280cf9880a9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:50.458578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 473/959] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:10:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:10:50.540884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704885cd-76e8-45bd-bb9d-e280cf9880a9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:50.591067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba7e33-c1ca-4c2f-ab1c-f85044495506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:50.591751 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba7e33-c1ca-4c2f-ab1c-f85044495506 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:50.592043 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba7e33-c1ca-4c2f-ab1c-f85044495506 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:50.592319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba7e33-c1ca-4c2f-ab1c-f85044495506 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:50.593040 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba7e33-c1ca-4c2f-ab1c-f85044495506 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:50.593345 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba7e33-c1ca-4c2f-ab1c-f85044495506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:50.594954 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba7e33-c1ca-4c2f-ab1c-f85044495506 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:50.636586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 487/960] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Sep 23 15:10:50 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:50.895570 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff52f9d-f928-424b-9405-680ae484ed21 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:50.896048 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff52f9d-f928-424b-9405-680ae484ed21 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:50.896048 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff52f9d-f928-424b-9405-680ae484ed21 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:50.897646 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 474/961] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:50.903810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17609fe-7737-43d0-905c-f6a8c85f06ac None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:50.904272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17609fe-7737-43d0-905c-f6a8c85f06ac None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:50.904371 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17609fe-7737-43d0-905c-f6a8c85f06ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:50.923333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b17609fe-7737-43d0-905c-f6a8c85f06ac None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:50.924866 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b17609fe-7737-43d0-905c-f6a8c85f06ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:50.946785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:50.998659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 488/962] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:51.267928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff52f9d-f928-424b-9405-680ae484ed21 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:51.375549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff52f9d-f928-424b-9405-680ae484ed21 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:51.408859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c6081-4725-4d1a-961b-9967cd3788e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:51.409495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c6081-4725-4d1a-961b-9967cd3788e9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:51.409789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c6081-4725-4d1a-961b-9967cd3788e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:51.410062 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c6081-4725-4d1a-961b-9967cd3788e9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:51.410640 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c6081-4725-4d1a-961b-9967cd3788e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:51.411998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c6081-4725-4d1a-961b-9967cd3788e9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-db1c6081-4725-4d1a-961b-9967cd3788e9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:51.422323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:51.423559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:51.423559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:51.423559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:51.423559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:51.423559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:51.423559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:51.423559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:51.423559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:51.423559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:51.423559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:51.423559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:51.423559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:51.423559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:51.423559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:51.423559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:51.423559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:51.424432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:51.424432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:51.424432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:51.424432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:51.424432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:51.424432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:51.424432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:51.424432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:51.424432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:51.424432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:51.424432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:51.424432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:51.424432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:10:51.424432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:51.428547 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 475/963] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:51.430245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17609fe-7737-43d0-905c-f6a8c85f06ac None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:51.538197 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17609fe-7737-43d0-905c-f6a8c85f06ac None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:51.575463 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d45a8-3e2b-4e1c-9a90-f6bab1065974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:51.576073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d45a8-3e2b-4e1c-9a90-f6bab1065974 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:51.576367 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d45a8-3e2b-4e1c-9a90-f6bab1065974 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:51.576641 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d45a8-3e2b-4e1c-9a90-f6bab1065974 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:51.577265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d45a8-3e2b-4e1c-9a90-f6bab1065974 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:51.577566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d45a8-3e2b-4e1c-9a90-f6bab1065974 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:51.578962 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d45a8-3e2b-4e1c-9a90-f6bab1065974 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:51.588403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 489/964] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Sep 23 15:10:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:51.589897 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c6081-4725-4d1a-961b-9967cd3788e9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:51.648039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:51.693300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c6081-4725-4d1a-961b-9967cd3788e9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:51.727490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efd660-aa75-4607-9dd8-bbfec66dfb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:51.728381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efd660-aa75-4607-9dd8-bbfec66dfb07 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:51.728861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efd660-aa75-4607-9dd8-bbfec66dfb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:51.729602 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efd660-aa75-4607-9dd8-bbfec66dfb07 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:51.730263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efd660-aa75-4607-9dd8-bbfec66dfb07 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:51.730565 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efd660-aa75-4607-9dd8-bbfec66dfb07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:51.731982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efd660-aa75-4607-9dd8-bbfec66dfb07 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:51.736623 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 476/965] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Sep 23 15:10:51 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:52.621772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4e7ff-0d63-4c31-8dc8-09f0d496bbb2 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:52.622359 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4e7ff-0d63-4c31-8dc8-09f0d496bbb2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:52.622359 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4e7ff-0d63-4c31-8dc8-09f0d496bbb2 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:52.623979 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 490/966] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:52.630104 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a763fd-fa31-4c01-9626-6cb89c10a0d8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:52.630674 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a763fd-fa31-4c01-9626-6cb89c10a0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:52.630674 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a763fd-fa31-4c01-9626-6cb89c10a0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:52.653500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e2a763fd-fa31-4c01-9626-6cb89c10a0d8 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:52.654715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e2a763fd-fa31-4c01-9626-6cb89c10a0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:52.721917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 477/967] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:52.741529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab0d16-375f-4591-a10a-c98413296260 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:52.741845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab0d16-375f-4591-a10a-c98413296260 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:52.742123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab0d16-375f-4591-a10a-c98413296260 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:52.743540 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 491/968] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:52.748972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af36ece-09fe-4fce-9e2b-38c3ade8349e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:52.749257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af36ece-09fe-4fce-9e2b-38c3ade8349e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:52.749531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af36ece-09fe-4fce-9e2b-38c3ade8349e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:52.767632 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2af36ece-09fe-4fce-9e2b-38c3ade8349e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:52.768815 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2af36ece-09fe-4fce-9e2b-38c3ade8349e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:52.816377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:52.837096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 478/969] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:52.988779 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab0d16-375f-4591-a10a-c98413296260 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:53.011611 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:53.097012 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab0d16-375f-4591-a10a-c98413296260 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:53.106901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af36ece-09fe-4fce-9e2b-38c3ade8349e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:53.138381 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404e660-a9fe-44b2-b505-146bde530766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:53.139488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404e660-a9fe-44b2-b505-146bde530766 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:53.139877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404e660-a9fe-44b2-b505-146bde530766 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:53.140149 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404e660-a9fe-44b2-b505-146bde530766 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:53.153483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404e660-a9fe-44b2-b505-146bde530766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:10:53.159877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c404e660-a9fe-44b2-b505-146bde530766 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 15:10:53.159877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:53.159877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:53.159877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:53.159877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:53.159877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:53.159877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:53.159877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:53.159877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:53.159877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:53.159877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:53.159877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:53.159877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:10:53.159877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:10:53.159877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:10:53.159877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:10:53.160826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:10:53.160826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:10:53.160826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:10:53.160826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:10:53.160826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:53.160826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:53.160826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:53.160826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:53.160826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:53.160826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:53.160826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:53.160826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:53.160826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:53.160826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:53.160826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:53.160826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:53.166578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:53.166578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:53.166578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:53.166578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:53.166578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:10:53.166578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:10:53.166578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:10:53.166578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:10:53.166578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:10:53.166578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:10:53.166578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 15:10:53.166578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:53.166578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 492/970] 10.222.0.82 () {56 vars in 1120 bytes} [Fri Sep 23 15:10:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:53.167736 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404e660-a9fe-44b2-b505-146bde530766 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:53.212890 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af36ece-09fe-4fce-9e2b-38c3ade8349e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:53.248570 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff555bf8-7cbf-41ce-9e26-d6c0e37a7ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:53.249124 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff555bf8-7cbf-41ce-9e26-d6c0e37a7ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:53.249403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff555bf8-7cbf-41ce-9e26-d6c0e37a7ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:53.249672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff555bf8-7cbf-41ce-9e26-d6c0e37a7ce4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:53.250282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff555bf8-7cbf-41ce-9e26-d6c0e37a7ce4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:53.251640 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff555bf8-7cbf-41ce-9e26-d6c0e37a7ce4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:53.255615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ff555bf8-7cbf-41ce-9e26-d6c0e37a7ce4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:53.261035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:53.262128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:53.262128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:53.262128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:53.262128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:53.262128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:53.262128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:53.262128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:53.262128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:53.262128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:53.262128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:53.262128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:53.262128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:53.262128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:53.262128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:53.262128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:53.262128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:53.267382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:53.267382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:53.267382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:53.267382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:53.267382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:53.267382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:53.267382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:53.267382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:53.267382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:53.267382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:53.267382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:53.267382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:53.267382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 15:10:53.267382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:53.267382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 479/971] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Sep 23 15:10:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:53.268403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff555bf8-7cbf-41ce-9e26-d6c0e37a7ce4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:53.279645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404e660-a9fe-44b2-b505-146bde530766 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:53.316297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:53.317279 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce433d-6532-49f0-9793-5cbfc8116f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:53.318099 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce433d-6532-49f0-9793-5cbfc8116f18 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:53.318418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce433d-6532-49f0-9793-5cbfc8116f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:53.318696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce433d-6532-49f0-9793-5cbfc8116f18 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:53.319358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce433d-6532-49f0-9793-5cbfc8116f18 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:53.319660 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce433d-6532-49f0-9793-5cbfc8116f18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:53.321718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce433d-6532-49f0-9793-5cbfc8116f18 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:53.330358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 493/972] 10.222.0.82 () {56 vars in 1115 bytes} [Fri Sep 23 15:10:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:53.336403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce433d-6532-49f0-9793-5cbfc8116f18 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:53.373420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff555bf8-7cbf-41ce-9e26-d6c0e37a7ce4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:53.409843 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860fd21-9bd7-4842-afe6-b2fc66e2b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:53.410692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860fd21-9bd7-4842-afe6-b2fc66e2b0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:53.411117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860fd21-9bd7-4842-afe6-b2fc66e2b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:53.411550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860fd21-9bd7-4842-afe6-b2fc66e2b0e8 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:53.412335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860fd21-9bd7-4842-afe6-b2fc66e2b0e8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:53.412780 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860fd21-9bd7-4842-afe6-b2fc66e2b0e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:53.414872 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860fd21-9bd7-4842-afe6-b2fc66e2b0e8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:53.420256 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 480/973] 10.222.0.82 () {56 vars in 1122 bytes} [Fri Sep 23 15:10:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:53.426033 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860fd21-9bd7-4842-afe6-b2fc66e2b0e8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:53.445073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce433d-6532-49f0-9793-5cbfc8116f18 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:53.480688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2c7e1-eb59-4445-9765-23aa3a65f80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:53.481625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2c7e1-eb59-4445-9765-23aa3a65f80f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:53.482150 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2c7e1-eb59-4445-9765-23aa3a65f80f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:53.482562 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2c7e1-eb59-4445-9765-23aa3a65f80f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:53.495294 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2c7e1-eb59-4445-9765-23aa3a65f80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:53.496755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2c7e1-eb59-4445-9765-23aa3a65f80f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:53.498977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:53.513914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-07f2c7e1-eb59-4445-9765-23aa3a65f80f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:53.513914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:53.513914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:53.513914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:53.513914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:53.513914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:53.513914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:53.513914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:53.513914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:53.513914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:53.513914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:53.513914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:53.513914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:53.513914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:53.513914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:53.513914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:53.520003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:53.520949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:53.520949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:53.520949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:53.520949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 494/974] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:53.520949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2c7e1-eb59-4445-9765-23aa3a65f80f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:53.549671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860fd21-9bd7-4842-afe6-b2fc66e2b0e8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:53.559513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:53.584565 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb50492-bdd7-42f0-93e4-47955d16efd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:53.585217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb50492-bdd7-42f0-93e4-47955d16efd9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:53.585532 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb50492-bdd7-42f0-93e4-47955d16efd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:53.585840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb50492-bdd7-42f0-93e4-47955d16efd9 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:53.586982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb50492-bdd7-42f0-93e4-47955d16efd9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:53.587282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb50492-bdd7-42f0-93e4-47955d16efd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:53.588621 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb50492-bdd7-42f0-93e4-47955d16efd9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:53.593592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 481/975] 10.222.0.82 () {56 vars in 1122 bytes} [Fri Sep 23 15:10:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:53.599433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb50492-bdd7-42f0-93e4-47955d16efd9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:53.632933 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2c7e1-eb59-4445-9765-23aa3a65f80f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:53.670206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246f314-9610-4c26-b287-7f0d6354dd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:53.671220 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246f314-9610-4c26-b287-7f0d6354dd13 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:53.671716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246f314-9610-4c26-b287-7f0d6354dd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:53.672245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246f314-9610-4c26-b287-7f0d6354dd13 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:53.673365 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246f314-9610-4c26-b287-7f0d6354dd13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:53.673956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246f314-9610-4c26-b287-7f0d6354dd13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:53.676356 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246f314-9610-4c26-b287-7f0d6354dd13 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:53.688896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 495/976] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:53.694167 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246f314-9610-4c26-b287-7f0d6354dd13 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:53.715681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb50492-bdd7-42f0-93e4-47955d16efd9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:53.750553 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bee14-d0b0-4c97-841f-8e011c6d1b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:53.751081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bee14-d0b0-4c97-841f-8e011c6d1b6c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:53.751358 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bee14-d0b0-4c97-841f-8e011c6d1b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:53.751992 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bee14-d0b0-4c97-841f-8e011c6d1b6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:53.752335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bee14-d0b0-4c97-841f-8e011c6d1b6c None admin] RBAC: Adding query filter params (interface=admin, service_id=9c974b3de23e4284a909c92bb8367a54, region_id=RegionOne) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:53.752663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bee14-d0b0-4c97-841f-8e011c6d1b6c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:53.754058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bee14-d0b0-4c97-841f-8e011c6d1b6c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:53.754910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:53.764492 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 482/977] 10.222.0.82 () {56 vars in 1249 bytes} [Fri Sep 23 15:10:53 2022] GET /identity/v3/endpoints?service_id=9c974b3de23e4284a909c92bb8367a54&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:53.765914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bee14-d0b0-4c97-841f-8e011c6d1b6c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:53.802970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246f314-9610-4c26-b287-7f0d6354dd13 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:53.803349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:53.843545 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84210d8-596e-482c-bd3a-33d936895d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:53.844440 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84210d8-596e-482c-bd3a-33d936895d63 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:53.844723 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84210d8-596e-482c-bd3a-33d936895d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:53.844989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84210d8-596e-482c-bd3a-33d936895d63 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:53.854539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84210d8-596e-482c-bd3a-33d936895d63 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:53.856714 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84210d8-596e-482c-bd3a-33d936895d63 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:53.870060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-f84210d8-596e-482c-bd3a-33d936895d63 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 15:10:53.870060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:53.870060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:53.870060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:53.870060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:53.870060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:53.870060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:53.870060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:53.870060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:53.870060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:53.870060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:53.870060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:53.870060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:10:53.870060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:10:53.870060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:10:53.870060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:53.871047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:53.871988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:53.871988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:53.871988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:10:53.871988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:10:53.871988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:10:53.871988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:10:53.871988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:10:53.871988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:10:53.871988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 15:10:53.871988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:53.871988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 496/978] 10.222.0.82 () {56 vars in 1117 bytes} [Fri Sep 23 15:10:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:53.877573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84210d8-596e-482c-bd3a-33d936895d63 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:53.882355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bee14-d0b0-4c97-841f-8e011c6d1b6c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:53.922916 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863450c-72f4-4b4c-91e4-815a4076809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:53.923948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863450c-72f4-4b4c-91e4-815a4076809b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:53.924228 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863450c-72f4-4b4c-91e4-815a4076809b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:53.924500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863450c-72f4-4b4c-91e4-815a4076809b None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:53.925442 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863450c-72f4-4b4c-91e4-815a4076809b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:53.927185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863450c-72f4-4b4c-91e4-815a4076809b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:53.933273 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 483/979] 10.222.0.82 () {56 vars in 1087 bytes} [Fri Sep 23 15:10:53 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:10:53.934475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c583d2-7e72-4ee5-9a92-78acf9103c52 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:53.934754 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c583d2-7e72-4ee5-9a92-78acf9103c52 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:53.935019 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c583d2-7e72-4ee5-9a92-78acf9103c52 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:53.936224 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 484/980] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:53.941883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282aeac-efab-4268-820b-64dd02018497 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:53.942176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282aeac-efab-4268-820b-64dd02018497 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:53.942440 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282aeac-efab-4268-820b-64dd02018497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:53.966611 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1282aeac-efab-4268-820b-64dd02018497 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:53.969716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1282aeac-efab-4268-820b-64dd02018497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:54.003406 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84210d8-596e-482c-bd3a-33d936895d63 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:54.017891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:54.039919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df87f5-f95c-484f-95c9-9c52df266f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:54.041105 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df87f5-f95c-484f-95c9-9c52df266f0d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:54.041380 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df87f5-f95c-484f-95c9-9c52df266f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:54.041646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df87f5-f95c-484f-95c9-9c52df266f0d None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:54.042428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df87f5-f95c-484f-95c9-9c52df266f0d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:54.042739 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df87f5-f95c-484f-95c9-9c52df266f0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:54.044215 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df87f5-f95c-484f-95c9-9c52df266f0d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:54.050557 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 485/981] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:10:54.064956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 497/982] 10.222.0.82 () {56 vars in 1149 bytes} [Fri Sep 23 15:10:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:54.070673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282aeac-efab-4268-820b-64dd02018497 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:54.104235 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:54.177823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282aeac-efab-4268-820b-64dd02018497 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:54.212824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb60be-5431-420b-bf84-f9889ed0ea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:54.213478 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb60be-5431-420b-bf84-f9889ed0ea33 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:54.213713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb60be-5431-420b-bf84-f9889ed0ea33 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:54.214009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb60be-5431-420b-bf84-f9889ed0ea33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:54.284218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb60be-5431-420b-bf84-f9889ed0ea33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:54.285581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb60be-5431-420b-bf84-f9889ed0ea33 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:54.316375 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:54.321959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df87f5-f95c-484f-95c9-9c52df266f0d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:54.397666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 486/983] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:10:54 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:10:54.399406 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb60be-5431-420b-bf84-f9889ed0ea33 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:54.425455 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df87f5-f95c-484f-95c9-9c52df266f0d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:54.461013 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e20574-df06-4007-8ddf-23021acd20f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:54.462227 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e20574-df06-4007-8ddf-23021acd20f0 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:54.462509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e20574-df06-4007-8ddf-23021acd20f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:54.462787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e20574-df06-4007-8ddf-23021acd20f0 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:54.463438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e20574-df06-4007-8ddf-23021acd20f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:54.464872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e20574-df06-4007-8ddf-23021acd20f0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:54.504968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb60be-5431-420b-bf84-f9889ed0ea33 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:54.535176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:54.541218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106ce13-5d6f-408f-9310-1f0896704408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:54.541881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106ce13-5d6f-408f-9310-1f0896704408 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:54.542165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106ce13-5d6f-408f-9310-1f0896704408 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:54.542437 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106ce13-5d6f-408f-9310-1f0896704408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:54.552460 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106ce13-5d6f-408f-9310-1f0896704408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:54.553939 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106ce13-5d6f-408f-9310-1f0896704408 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:54.568317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-d106ce13-5d6f-408f-9310-1f0896704408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:54.568317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:54.568317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:54.568317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:54.568317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:54.568317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:54.568317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:54.568317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:54.568317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:54.568317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:54.568317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:54.568317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:54.568317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:10:54.568317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:10:54.568317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:10:54.568317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:54.569264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:10:54.570241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:10:54.570241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:10:54.570241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:54.570241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 487/984] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:54.575551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106ce13-5d6f-408f-9310-1f0896704408 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:54.593480 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 498/985] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Sep 23 15:10:54 2022] POST /identity/v3/services => generated 242 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:10:54.687991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106ce13-5d6f-408f-9310-1f0896704408 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:54.733221 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3438747-e4bf-4b30-961e-0ae880faed49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:54.733920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3438747-e4bf-4b30-961e-0ae880faed49 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:54.734152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3438747-e4bf-4b30-961e-0ae880faed49 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:54.734417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3438747-e4bf-4b30-961e-0ae880faed49 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:54.735074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3438747-e4bf-4b30-961e-0ae880faed49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:54.735375 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3438747-e4bf-4b30-961e-0ae880faed49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:54.736769 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3438747-e4bf-4b30-961e-0ae880faed49 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:54.754846 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 488/986] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:54.756569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e20574-df06-4007-8ddf-23021acd20f0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:54.792037 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:54.866006 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e20574-df06-4007-8ddf-23021acd20f0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:54.900925 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f518b-5e02-45ee-ba60-eabc5989d52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:54.901556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f518b-5e02-45ee-ba60-eabc5989d52a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:54.901859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f518b-5e02-45ee-ba60-eabc5989d52a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:54.902132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f518b-5e02-45ee-ba60-eabc5989d52a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:54.908732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f518b-5e02-45ee-ba60-eabc5989d52a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:54.910215 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f518b-5e02-45ee-ba60-eabc5989d52a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:54.923121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-848f518b-5e02-45ee-ba60-eabc5989d52a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:54.923121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:54.923121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:54.923121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:54.923121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:54.923121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:54.923121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:54.923121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:54.923121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:54.923121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:54.923121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:54.923121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:54.923121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:10:54.923121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:10:54.923121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:54.924164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:54.925117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:10:54.925117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:10:54.925117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:10:54.925117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:10:54.925117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:10:54.925117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:10:54.925117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:10:54.925117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:54.926148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 499/987] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:10:54.930491 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3438747-e4bf-4b30-961e-0ae880faed49 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:54.973062 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:55.033904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3438747-e4bf-4b30-961e-0ae880faed49 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:55.069919 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020fdc5-70c8-427f-8350-8c5830159450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:55.070482 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020fdc5-70c8-427f-8350-8c5830159450 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:55.070764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020fdc5-70c8-427f-8350-8c5830159450 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:55.071036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020fdc5-70c8-427f-8350-8c5830159450 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:55.071721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020fdc5-70c8-427f-8350-8c5830159450 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:55.072027 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020fdc5-70c8-427f-8350-8c5830159450 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:55.073452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020fdc5-70c8-427f-8350-8c5830159450 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:55.090594 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 489/988] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:10:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:55.092194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f518b-5e02-45ee-ba60-eabc5989d52a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:55.187645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:55.197328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f518b-5e02-45ee-ba60-eabc5989d52a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:55.230675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ccd76-845b-4db2-8ce9-14778ee5e0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:55.231283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ccd76-845b-4db2-8ce9-14778ee5e0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:55.231554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ccd76-845b-4db2-8ce9-14778ee5e0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:55.231821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ccd76-845b-4db2-8ce9-14778ee5e0d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:55.232535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ccd76-845b-4db2-8ce9-14778ee5e0d1 None admin] RBAC: Adding query filter params (role.id=761366d21b194095aa29578e791fe568, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=94a8ee59c6b24db9a67eb44a115fae85) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:55.232840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ccd76-845b-4db2-8ce9-14778ee5e0d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:55.234299 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ccd76-845b-4db2-8ce9-14778ee5e0d1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:55.246375 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 500/989] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:10:55 2022] GET /identity/v3/role_assignments?user.id=94a8ee59c6b24db9a67eb44a115fae85&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=761366d21b194095aa29578e791fe568 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:56.140555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f7477-d478-4f8f-bbf4-4e5ded83e5f5 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:56.141139 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f7477-d478-4f8f-bbf4-4e5ded83e5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:56.141139 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f7477-d478-4f8f-bbf4-4e5ded83e5f5 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:56.142726 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 490/990] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:56.149122 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a10e5d-11ab-499a-9446-1dc81a4d91d8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:56.149682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a10e5d-11ab-499a-9446-1dc81a4d91d8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:56.149682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a10e5d-11ab-499a-9446-1dc81a4d91d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:56.168259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-91a10e5d-11ab-499a-9446-1dc81a4d91d8 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:56.169452 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-91a10e5d-11ab-499a-9446-1dc81a4d91d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:56.237194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 501/991] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:56.502982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f7477-d478-4f8f-bbf4-4e5ded83e5f5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:56.604005 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:56.609368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f7477-d478-4f8f-bbf4-4e5ded83e5f5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:56.642887 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a4e0e-4d70-486e-9d61-6e9939faf951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:56.643514 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a4e0e-4d70-486e-9d61-6e9939faf951 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:56.643792 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a4e0e-4d70-486e-9d61-6e9939faf951 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:56.644061 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a4e0e-4d70-486e-9d61-6e9939faf951 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:56.644637 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a4e0e-4d70-486e-9d61-6e9939faf951 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:56.646028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a4e0e-4d70-486e-9d61-6e9939faf951 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e19a4e0e-4d70-486e-9d61-6e9939faf951 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:56.656003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:56.657105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:56.657105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:56.657105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:56.657105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:56.657105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:56.657105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:56.657105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:56.657105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:56.657105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:56.657105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:56.657105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:56.657105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:56.657105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:56.657105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:56.657105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:56.657105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:56.658236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:56.658236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:56.658236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:56.658236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:56.658236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:56.658236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:56.658236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:56.658236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:56.658236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:56.658236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:56.658236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:56.658236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:56.658236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 15:10:56.658236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:56.658236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 491/992] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Sep 23 15:10:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:56.666358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a10e5d-11ab-499a-9446-1dc81a4d91d8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:56.755738 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:56.771277 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a10e5d-11ab-499a-9446-1dc81a4d91d8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:56.804738 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc088e1-8fa3-4f9b-ade0-ed4af9e37ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:56.805349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc088e1-8fa3-4f9b-ade0-ed4af9e37ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:56.805628 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc088e1-8fa3-4f9b-ade0-ed4af9e37ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:56.805930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc088e1-8fa3-4f9b-ade0-ed4af9e37ff0 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:56.806559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc088e1-8fa3-4f9b-ade0-ed4af9e37ff0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:56.806863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc088e1-8fa3-4f9b-ade0-ed4af9e37ff0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:56.808574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc088e1-8fa3-4f9b-ade0-ed4af9e37ff0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:56.813111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd33641-b54d-421d-bab8-fa4265bb98da None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:56.813394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd33641-b54d-421d-bab8-fa4265bb98da None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:56.813662 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd33641-b54d-421d-bab8-fa4265bb98da None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:56.815225 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 492/993] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:10:56.818501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 502/994] 10.222.0.82 () {56 vars in 1122 bytes} [Fri Sep 23 15:10:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:56.819918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd33641-b54d-421d-bab8-fa4265bb98da None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:56.821076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07c6b3-7439-44f2-9303-779d8681bf47 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:56.821364 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07c6b3-7439-44f2-9303-779d8681bf47 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:56.821640 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07c6b3-7439-44f2-9303-779d8681bf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:56.839626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9a07c6b3-7439-44f2-9303-779d8681bf47 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:56.840810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9a07c6b3-7439-44f2-9303-779d8681bf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:56.918451 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 503/995] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:10:56.935235 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd33641-b54d-421d-bab8-fa4265bb98da None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:56.979496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f86ea2-9a3d-4973-9030-78e00ad144bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:56.980142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f86ea2-9a3d-4973-9030-78e00ad144bf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:56.980426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f86ea2-9a3d-4973-9030-78e00ad144bf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:56.980701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f86ea2-9a3d-4973-9030-78e00ad144bf None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:56.981336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f86ea2-9a3d-4973-9030-78e00ad144bf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:56.981639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f86ea2-9a3d-4973-9030-78e00ad144bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:56.983045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f86ea2-9a3d-4973-9030-78e00ad144bf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:56.988450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 493/996] 10.222.0.82 () {56 vars in 1122 bytes} [Fri Sep 23 15:10:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:56.993977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07c6b3-7439-44f2-9303-779d8681bf47 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:57.080930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:57.100014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07c6b3-7439-44f2-9303-779d8681bf47 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:57.135442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239613af-b6c7-4756-bf75-24b8a2274097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:57.136052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239613af-b6c7-4756-bf75-24b8a2274097 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:57.136331 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239613af-b6c7-4756-bf75-24b8a2274097 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:57.136602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239613af-b6c7-4756-bf75-24b8a2274097 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:57.137274 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239613af-b6c7-4756-bf75-24b8a2274097 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:57.138672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239613af-b6c7-4756-bf75-24b8a2274097 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:57.186791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f86ea2-9a3d-4973-9030-78e00ad144bf None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:57.215476 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:57.241762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 504/997] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:10:56 2022] POST /identity/v3/endpoints => generated 325 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:10:57.301588 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f86ea2-9a3d-4973-9030-78e00ad144bf None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:57.350798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cb149-512e-44fb-8a3c-209770512568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:57.351281 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cb149-512e-44fb-8a3c-209770512568 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:57.351668 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cb149-512e-44fb-8a3c-209770512568 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:57.351947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cb149-512e-44fb-8a3c-209770512568 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:57.352552 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cb149-512e-44fb-8a3c-209770512568 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:57.354080 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cb149-512e-44fb-8a3c-209770512568 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4c0cb149-512e-44fb-8a3c-209770512568 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:57.364290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:57.365373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:57.365373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:57.365373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:57.365373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:57.365373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:57.365373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:57.365373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:57.365373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:57.365373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:57.365373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:57.365373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:57.365373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:57.365373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:57.365373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:57.365373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:57.365373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:57.370970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:57.370970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:57.370970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:57.370970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:57.370970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:57.370970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:57.370970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:57.370970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:57.370970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:57.370970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:57.370970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:57.370970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:57.370970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:10:57.370970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:10:57.370970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 494/998] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:10:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:57.372271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239613af-b6c7-4756-bf75-24b8a2274097 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:57.447890 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31692376-6aaa-49d6-a7f1-b1f383ed439b None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:57.448174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31692376-6aaa-49d6-a7f1-b1f383ed439b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:57.448450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31692376-6aaa-49d6-a7f1-b1f383ed439b None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:57.449976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 495/999] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:10:57.454951 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b75b8-20c2-44ee-8ee7-067bd876a4be None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:57.455226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b75b8-20c2-44ee-8ee7-067bd876a4be None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:57.455497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b75b8-20c2-44ee-8ee7-067bd876a4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:57.476187 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f99b75b8-20c2-44ee-8ee7-067bd876a4be None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:57.477940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f99b75b8-20c2-44ee-8ee7-067bd876a4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:57.487861 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239613af-b6c7-4756-bf75-24b8a2274097 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:57.528416 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031053a-4add-48d4-a2f2-088059c59151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:57.529039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031053a-4add-48d4-a2f2-088059c59151 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:57.529325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031053a-4add-48d4-a2f2-088059c59151 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:57.529602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031053a-4add-48d4-a2f2-088059c59151 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:57.530340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031053a-4add-48d4-a2f2-088059c59151 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:57.530649 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031053a-4add-48d4-a2f2-088059c59151 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:57.532048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031053a-4add-48d4-a2f2-088059c59151 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:57.537771 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 505/1000] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Sep 23 15:10:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:57.543716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031053a-4add-48d4-a2f2-088059c59151 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:57.547726 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:57.559496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 496/1001] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:57 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:10:57.643483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031053a-4add-48d4-a2f2-088059c59151 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:57.677976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f93cf-b4e3-440b-b0da-c531b9dafd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:57.678578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f93cf-b4e3-440b-b0da-c531b9dafd5b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:57.678851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f93cf-b4e3-440b-b0da-c531b9dafd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:57.679114 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f93cf-b4e3-440b-b0da-c531b9dafd5b None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:57.680316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f93cf-b4e3-440b-b0da-c531b9dafd5b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:57.680618 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f93cf-b4e3-440b-b0da-c531b9dafd5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:57.681983 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f93cf-b4e3-440b-b0da-c531b9dafd5b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:57.687330 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 506/1002] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Sep 23 15:10:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:57.693552 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b75b8-20c2-44ee-8ee7-067bd876a4be None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:57.711655 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:57.798583 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b75b8-20c2-44ee-8ee7-067bd876a4be None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:57.831668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f93cf-b4e3-440b-b0da-c531b9dafd5b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:57.836943 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84748d4-186c-4b1a-affd-8daec1d44d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:57.837820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84748d4-186c-4b1a-affd-8daec1d44d36 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:57.838275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84748d4-186c-4b1a-affd-8daec1d44d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:57.838734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84748d4-186c-4b1a-affd-8daec1d44d36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:57.839603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84748d4-186c-4b1a-affd-8daec1d44d36 None admin] RBAC: Adding query filter params (interface=public, service_id=2e7f00061b4147b19549aac1a22cf787, region_id=RegionOne) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:57.840101 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84748d4-186c-4b1a-affd-8daec1d44d36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:57.841794 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84748d4-186c-4b1a-affd-8daec1d44d36 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:57.847826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 497/1003] 10.222.0.82 () {56 vars in 1251 bytes} [Fri Sep 23 15:10:57 2022] GET /identity/v3/endpoints?service_id=2e7f00061b4147b19549aac1a22cf787&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:57.853477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84748d4-186c-4b1a-affd-8daec1d44d36 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:57.907568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:57.936790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:57.952004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f93cf-b4e3-440b-b0da-c531b9dafd5b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:57.956370 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84748d4-186c-4b1a-affd-8daec1d44d36 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:57.991606 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aabdd0-4165-4042-948f-5dc3c507282a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:57.992812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aabdd0-4165-4042-948f-5dc3c507282a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:57.993066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aabdd0-4165-4042-948f-5dc3c507282a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:57.993340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aabdd0-4165-4042-948f-5dc3c507282a None admin] PATH_INFO: `/v3/services/image` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:57.993956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aabdd0-4165-4042-948f-5dc3c507282a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:57.995365 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aabdd0-4165-4042-948f-5dc3c507282a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:57.997353 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de101f76-8bc1-4d64-9b2a-0eca6f45b108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:57.998179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de101f76-8bc1-4d64-9b2a-0eca6f45b108 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:57.998633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de101f76-8bc1-4d64-9b2a-0eca6f45b108 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:57.999138 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de101f76-8bc1-4d64-9b2a-0eca6f45b108 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:57.999900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de101f76-8bc1-4d64-9b2a-0eca6f45b108 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:58.001406 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de101f76-8bc1-4d64-9b2a-0eca6f45b108 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e2aabdd0-4165-4042-948f-5dc3c507282a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:10:58.004578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:10:58.011217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:10:58.011217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:10:58.011217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:10:58.011217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:10:58.011217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:10:58.011217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:10:58.011217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:10:58.011217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:10:58.011217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:10:58.011217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:10:58.011217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:10:58.011217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:10:58.011217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:10:58.011217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:10:58.011217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:10:58.011217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:10:58.012143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:10:58.012143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:10:58.012143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:10:58.012143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:10:58.012143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:10:58.012143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:10:58.012143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:10:58.012143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:10:58.012143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:10:58.012143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:10:58.012143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:10:58.012143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:10:58.012143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:10:58.012143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:10:58.012143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 507/1004] 10.222.0.82 () {56 vars in 1105 bytes} [Fri Sep 23 15:10:57 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:10:58.012955 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aabdd0-4165-4042-948f-5dc3c507282a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:58.013869 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 498/1005] 10.222.0.82 () {56 vars in 1087 bytes} [Fri Sep 23 15:10:57 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:10:58.127764 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aabdd0-4165-4042-948f-5dc3c507282a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:58.162884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:58.169342 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d932057-a826-426f-b5a6-0af3495df9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:58.170429 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d932057-a826-426f-b5a6-0af3495df9aa None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:58.182346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d932057-a826-426f-b5a6-0af3495df9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:58.182346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d932057-a826-426f-b5a6-0af3495df9aa None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:58.182346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d932057-a826-426f-b5a6-0af3495df9aa None admin] RBAC: Adding query filter params (name=image) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:58.182346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d932057-a826-426f-b5a6-0af3495df9aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:58.182346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d932057-a826-426f-b5a6-0af3495df9aa None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:58.182346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 508/1006] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:58.185695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de101f76-8bc1-4d64-9b2a-0eca6f45b108 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:58.290956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de101f76-8bc1-4d64-9b2a-0eca6f45b108 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:58.327497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3e746-9bc7-42a5-84f2-f522c617aeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:58.328416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3e746-9bc7-42a5-84f2-f522c617aeb8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:58.328977 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3e746-9bc7-42a5-84f2-f522c617aeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:58.329444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3e746-9bc7-42a5-84f2-f522c617aeb8 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:58.330283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3e746-9bc7-42a5-84f2-f522c617aeb8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:10:58.330787 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3e746-9bc7-42a5-84f2-f522c617aeb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:58.332337 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3e746-9bc7-42a5-84f2-f522c617aeb8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:58.337677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 499/1007] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:58 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:10:59.450589 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17b3cf-b122-49db-9b96-8a426fa4cb3c None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:59.451082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17b3cf-b122-49db-9b96-8a426fa4cb3c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:59.451082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17b3cf-b122-49db-9b96-8a426fa4cb3c None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:59.452529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 509/1008] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:10:59.457673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeef327-05c3-4c9f-bb3d-e07b2bec5a2f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:59.458141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeef327-05c3-4c9f-bb3d-e07b2bec5a2f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:59.458228 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeef327-05c3-4c9f-bb3d-e07b2bec5a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:59.477154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9eeef327-05c3-4c9f-bb3d-e07b2bec5a2f None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:10:59.478496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9eeef327-05c3-4c9f-bb3d-e07b2bec5a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:10:59.480467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:10:59.556217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 500/1009] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:10:59 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:10:59.823447 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17b3cf-b122-49db-9b96-8a426fa4cb3c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:10:59.931598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17b3cf-b122-49db-9b96-8a426fa4cb3c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:10:59.968890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326743fd-9e75-4108-8444-df17590ff07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:10:59.968890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326743fd-9e75-4108-8444-df17590ff07d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:10:59.968890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326743fd-9e75-4108-8444-df17590ff07d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:10:59.968890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326743fd-9e75-4108-8444-df17590ff07d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:10:59.969352 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326743fd-9e75-4108-8444-df17590ff07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:10:59.970806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326743fd-9e75-4108-8444-df17590ff07d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:10:59.972570 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 510/1010] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:10:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:10:59.978085 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeef327-05c3-4c9f-bb3d-e07b2bec5a2f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:00.078626 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeef327-05c3-4c9f-bb3d-e07b2bec5a2f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:00.112405 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241004b-a30a-4597-b548-6faffe202838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:00.113087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241004b-a30a-4597-b548-6faffe202838 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:00.113288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241004b-a30a-4597-b548-6faffe202838 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:00.113548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241004b-a30a-4597-b548-6faffe202838 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:00.114235 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241004b-a30a-4597-b548-6faffe202838 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:00.115656 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241004b-a30a-4597-b548-6faffe202838 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:00.126607 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:00.245491 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 501/1011] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Sep 23 15:10:59 2022] POST /identity/v3/projects => generated 311 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:11:00.249586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc57d72-e927-4ab2-a2a1-e02b41d973ee None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:00.249904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc57d72-e927-4ab2-a2a1-e02b41d973ee None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:00.250208 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc57d72-e927-4ab2-a2a1-e02b41d973ee None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:00.252003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 511/1012] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:00.258435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e3c00-7c4e-47aa-9fe7-c128bc4fe979 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:00.258914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e3c00-7c4e-47aa-9fe7-c128bc4fe979 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:00.259286 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e3c00-7c4e-47aa-9fe7-c128bc4fe979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:00.281550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-680e3c00-7c4e-47aa-9fe7-c128bc4fe979 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:00.282990 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-680e3c00-7c4e-47aa-9fe7-c128bc4fe979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:00.360985 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 502/1013] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:00 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:11:00.498177 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925d54-6b4d-4341-8075-b1593c5b0d94 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:00.498695 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925d54-6b4d-4341-8075-b1593c5b0d94 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:00.498695 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925d54-6b4d-4341-8075-b1593c5b0d94 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:00.500131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 512/1014] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:00.505603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc7084-5285-4612-b6f2-594c2564ebec None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:00.506354 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc7084-5285-4612-b6f2-594c2564ebec None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:00.506354 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc7084-5285-4612-b6f2-594c2564ebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:00.525422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-01cc7084-5285-4612-b6f2-594c2564ebec None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:00.526613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-01cc7084-5285-4612-b6f2-594c2564ebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:00.594646 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 503/1015] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:00 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:00.638985 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79925d54-6b4d-4341-8075-b1593c5b0d94 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:00.706120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:00.746528 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79925d54-6b4d-4341-8075-b1593c5b0d94 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:00.783127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33614ded-6858-4840-adca-aa1ec8000f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:00.783771 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33614ded-6858-4840-adca-aa1ec8000f4e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:00.784096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33614ded-6858-4840-adca-aa1ec8000f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:00.784567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33614ded-6858-4840-adca-aa1ec8000f4e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:00.785146 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33614ded-6858-4840-adca-aa1ec8000f4e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:00.786602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33614ded-6858-4840-adca-aa1ec8000f4e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-33614ded-6858-4840-adca-aa1ec8000f4e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:00.797126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:00.798569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:00.798569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:00.798569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:00.798569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:00.798569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:00.798569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:00.798569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:11:00.798569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:11:00.798569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:11:00.798569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:11:00.798569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:00.798569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:00.798569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:00.798569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:00.798569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:00.798569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:00.799774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:00.799774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:00.799774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:00.799774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:00.799774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:00.799774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:00.799774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:00.799774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:00.799774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:00.799774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:00.799774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:11:00.799774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:11:00.799774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 15:11:00.799774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:11:00.802089 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 513/1016] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:11:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:11:00.805001 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc7084-5285-4612-b6f2-594c2564ebec None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:00.856696 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:00.861857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33614ded-6858-4840-adca-aa1ec8000f4e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:00.908662 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc7084-5285-4612-b6f2-594c2564ebec None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:00.951821 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514e1f4-b2eb-4433-a919-a118f18bc1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:00.952561 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514e1f4-b2eb-4433-a919-a118f18bc1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:00.952856 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514e1f4-b2eb-4433-a919-a118f18bc1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:00.953176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514e1f4-b2eb-4433-a919-a118f18bc1a4 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:00.953844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514e1f4-b2eb-4433-a919-a118f18bc1a4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:00.954177 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514e1f4-b2eb-4433-a919-a118f18bc1a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:00.955543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514e1f4-b2eb-4433-a919-a118f18bc1a4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:00.960407 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 504/1017] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Sep 23 15:11:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:00.970597 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514e1f4-b2eb-4433-a919-a118f18bc1a4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:00.977671 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33614ded-6858-4840-adca-aa1ec8000f4e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:01.005799 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:01.014137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314da19e-6ba1-42e6-8963-f334ec0a1743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:01.014718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314da19e-6ba1-42e6-8963-f334ec0a1743 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:01.014998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314da19e-6ba1-42e6-8963-f334ec0a1743 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:01.015543 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314da19e-6ba1-42e6-8963-f334ec0a1743 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:01.015909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314da19e-6ba1-42e6-8963-f334ec0a1743 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:01.017282 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314da19e-6ba1-42e6-8963-f334ec0a1743 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:01.073007 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514e1f4-b2eb-4433-a919-a118f18bc1a4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:01.086907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:01.109389 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7d73e-3727-44b3-9ec7-63ad64bf1aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:01.110036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7d73e-3727-44b3-9ec7-63ad64bf1aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:01.110301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7d73e-3727-44b3-9ec7-63ad64bf1aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:01.110575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7d73e-3727-44b3-9ec7-63ad64bf1aa2 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:01.111196 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7d73e-3727-44b3-9ec7-63ad64bf1aa2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:01.111496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7d73e-3727-44b3-9ec7-63ad64bf1aa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:01.112835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7d73e-3727-44b3-9ec7-63ad64bf1aa2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:01.118122 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 505/1018] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Sep 23 15:11:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:01.123740 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7d73e-3727-44b3-9ec7-63ad64bf1aa2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:01.146245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 514/1019] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Sep 23 15:11:00 2022] POST /identity/v3/services => generated 242 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:11:01.238130 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7d73e-3727-44b3-9ec7-63ad64bf1aa2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:01.282444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33b2f7-9eb4-452a-b395-16c496b9266e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:01.283060 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33b2f7-9eb4-452a-b395-16c496b9266e None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:01.283332 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33b2f7-9eb4-452a-b395-16c496b9266e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:01.283595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33b2f7-9eb4-452a-b395-16c496b9266e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:01.284263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33b2f7-9eb4-452a-b395-16c496b9266e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:01.285623 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33b2f7-9eb4-452a-b395-16c496b9266e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:01.376177 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 506/1020] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:11:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:11:02.495037 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121ea3d-5697-4220-947a-0ddf17799866 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:02.495566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121ea3d-5697-4220-947a-0ddf17799866 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:02.495566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121ea3d-5697-4220-947a-0ddf17799866 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:02.498463 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 515/1021] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:11:02.503690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2589367-ea15-4c0f-ae48-e9561c85321e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:02.504165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2589367-ea15-4c0f-ae48-e9561c85321e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:02.504248 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2589367-ea15-4c0f-ae48-e9561c85321e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:02.522482 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b2589367-ea15-4c0f-ae48-e9561c85321e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:02.523692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b2589367-ea15-4c0f-ae48-e9561c85321e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:02.548114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:02.596578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 507/1022] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:02.866500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121ea3d-5697-4220-947a-0ddf17799866 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:02.975228 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121ea3d-5697-4220-947a-0ddf17799866 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:03.013125 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4e696-3402-4d16-a32b-ca6f4e498991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:03.013779 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4e696-3402-4d16-a32b-ca6f4e498991 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:03.014063 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4e696-3402-4d16-a32b-ca6f4e498991 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:03.014336 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4e696-3402-4d16-a32b-ca6f4e498991 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:03.015473 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4e696-3402-4d16-a32b-ca6f4e498991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:03.016916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4e696-3402-4d16-a32b-ca6f4e498991 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:03.021769 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 516/1023] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:11:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:03.025083 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2589367-ea15-4c0f-ae48-e9561c85321e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:03.130844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2589367-ea15-4c0f-ae48-e9561c85321e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:03.167558 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d965bf-0439-4ebd-9fbf-47a6c06796b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:03.168184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d965bf-0439-4ebd-9fbf-47a6c06796b4 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:03.168466 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d965bf-0439-4ebd-9fbf-47a6c06796b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:03.168741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d965bf-0439-4ebd-9fbf-47a6c06796b4 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:03.169428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d965bf-0439-4ebd-9fbf-47a6c06796b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:03.170965 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d965bf-0439-4ebd-9fbf-47a6c06796b4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:03.323501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293e690-6bf6-489f-af01-1b0163252819 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:03.323782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293e690-6bf6-489f-af01-1b0163252819 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:03.324054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293e690-6bf6-489f-af01-1b0163252819 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:03.325573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 517/1024] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:11:03.330255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e713a35-8749-4597-894a-d2b699946fb1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:03.330539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e713a35-8749-4597-894a-d2b699946fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:03.330812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e713a35-8749-4597-894a-d2b699946fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:03.349437 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4e713a35-8749-4597-894a-d2b699946fb1 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:03.350712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4e713a35-8749-4597-894a-d2b699946fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:03.401856 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 508/1025] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:11:03 2022] POST /identity/v3/users => generated 285 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:11:03.402564 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:03.421274 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 518/1026] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:11:03.634403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068ca31-a1f3-4f0e-b6fb-a0d6f4a17bf3 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:03.634938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068ca31-a1f3-4f0e-b6fb-a0d6f4a17bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:03.634938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068ca31-a1f3-4f0e-b6fb-a0d6f4a17bf3 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:03.636473 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 509/1027] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:03.641563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16439-bc62-4c64-9b74-dd93cd781958 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:03.642083 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16439-bc62-4c64-9b74-dd93cd781958 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:03.642186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16439-bc62-4c64-9b74-dd93cd781958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:03.661183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-03c16439-bc62-4c64-9b74-dd93cd781958 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:03.662335 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-03c16439-bc62-4c64-9b74-dd93cd781958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:03.685509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068ca31-a1f3-4f0e-b6fb-a0d6f4a17bf3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:03.705816 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:03.731577 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 519/1028] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:03.793885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068ca31-a1f3-4f0e-b6fb-a0d6f4a17bf3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:03.830182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec40a1f-259e-422c-bcf1-3ed8237c00be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:03.830816 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec40a1f-259e-422c-bcf1-3ed8237c00be None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:03.831089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec40a1f-259e-422c-bcf1-3ed8237c00be None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:03.831473 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec40a1f-259e-422c-bcf1-3ed8237c00be None admin] PATH_INFO: `/v3/services/image` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:03.832056 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec40a1f-259e-422c-bcf1-3ed8237c00be None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:03.833497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec40a1f-259e-422c-bcf1-3ed8237c00be None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-9ec40a1f-259e-422c-bcf1-3ed8237c00be None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:03.842725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:03.843756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:03.843756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:03.843756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:03.843756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:03.843756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:03.843756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:03.843756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:11:03.843756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:11:03.843756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:11:03.843756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:11:03.843756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:03.843756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:03.843756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:03.843756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:03.843756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:03.843756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:03.844999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:03.844999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:03.844999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:03.844999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:03.844999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:03.844999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:03.844999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:03.844999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:03.844999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:03.844999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:03.844999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:11:03.844999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:11:03.844999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:11:03.844999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:03.844999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 510/1029] 10.222.0.82 () {56 vars in 1105 bytes} [Fri Sep 23 15:11:03 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:11:03.849616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c16439-bc62-4c64-9b74-dd93cd781958 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:03.951488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c16439-bc62-4c64-9b74-dd93cd781958 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:03.973450 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:03.991674 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412e37a-bfb4-427a-9e62-c05ab3eef657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:03.992886 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412e37a-bfb4-427a-9e62-c05ab3eef657 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:03.993209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412e37a-bfb4-427a-9e62-c05ab3eef657 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:03.993436 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412e37a-bfb4-427a-9e62-c05ab3eef657 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:03.994091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412e37a-bfb4-427a-9e62-c05ab3eef657 None admin] RBAC: Adding query filter params (name=image) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:03.994391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412e37a-bfb4-427a-9e62-c05ab3eef657 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:03.995770 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412e37a-bfb4-427a-9e62-c05ab3eef657 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:04.000221 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec40a1f-259e-422c-bcf1-3ed8237c00be None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:04.007920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 520/1030] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:11:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:04.009216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412e37a-bfb4-427a-9e62-c05ab3eef657 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:04.086390 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:04.112300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec40a1f-259e-422c-bcf1-3ed8237c00be None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:04.117720 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412e37a-bfb4-427a-9e62-c05ab3eef657 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:04.151730 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3839e-329d-4d33-a726-e0465db27bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:04.152429 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3839e-329d-4d33-a726-e0465db27bfd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:04.152711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3839e-329d-4d33-a726-e0465db27bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:04.152980 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3839e-329d-4d33-a726-e0465db27bfd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:04.155454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fd4ab-27c5-473a-a255-bafa6d8083c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:04.156650 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fd4ab-27c5-473a-a255-bafa6d8083c6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:04.156937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fd4ab-27c5-473a-a255-bafa6d8083c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:04.157216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fd4ab-27c5-473a-a255-bafa6d8083c6 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:04.158153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fd4ab-27c5-473a-a255-bafa6d8083c6 None admin] RBAC: Adding query filter params (type=image) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:04.158469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fd4ab-27c5-473a-a255-bafa6d8083c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:04.160221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fd4ab-27c5-473a-a255-bafa6d8083c6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:04.164505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3839e-329d-4d33-a726-e0465db27bfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:11:04.168695 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 521/1031] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:11:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:04.171226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-1de3839e-329d-4d33-a726-e0465db27bfd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 15:11:04.171226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:04.171226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:04.171226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:04.171226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:04.171226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:04.171226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:04.171226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:04.171226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:04.171226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:04.171226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:04.171226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:04.171226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:11:04.171226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:11:04.171226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:11:04.171226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:11:04.172283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:11:04.172283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:11:04.172283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:11:04.172283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:11:04.172283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:04.172283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:04.172283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:04.172283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:04.172283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:04.172283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:04.172283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:04.172283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:04.172283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:04.172283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:04.172283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:04.172283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:04.173806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:04.173806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:04.173806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:04.173806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:04.173806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:11:04.173806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:11:04.173806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:11:04.173806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:11:04.173806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:11:04.173806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:11:04.173806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 15:11:04.173806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:04.174707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 511/1032] 10.222.0.82 () {56 vars in 1120 bytes} [Fri Sep 23 15:11:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:11:04.175979 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fd4ab-27c5-473a-a255-bafa6d8083c6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:04.178078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3839e-329d-4d33-a726-e0465db27bfd None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:04.226790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:04.284921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fd4ab-27c5-473a-a255-bafa6d8083c6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:04.293244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3839e-329d-4d33-a726-e0465db27bfd None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:04.322111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec3956-f804-4c54-9412-c01b51ec57c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:04.322713 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec3956-f804-4c54-9412-c01b51ec57c7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:04.322988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec3956-f804-4c54-9412-c01b51ec57c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:04.323258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec3956-f804-4c54-9412-c01b51ec57c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:04.323945 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec3956-f804-4c54-9412-c01b51ec57c7 None admin] RBAC: Adding query filter params (interface=public, service_id=42c9aa6e9db14b2386a0282dd51f7bd4, region_id=RegionOne) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:04.324252 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec3956-f804-4c54-9412-c01b51ec57c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:04.325622 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec3956-f804-4c54-9412-c01b51ec57c7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:04.335641 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 522/1033] 10.222.0.82 () {56 vars in 1251 bytes} [Fri Sep 23 15:11:04 2022] GET /identity/v3/endpoints?service_id=42c9aa6e9db14b2386a0282dd51f7bd4&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:04.335829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89689cc-f587-4820-9e6a-0976c92a4697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:04.335829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89689cc-f587-4820-9e6a-0976c92a4697 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:04.335829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89689cc-f587-4820-9e6a-0976c92a4697 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:04.335829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89689cc-f587-4820-9e6a-0976c92a4697 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:04.336174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89689cc-f587-4820-9e6a-0976c92a4697 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:04.336174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89689cc-f587-4820-9e6a-0976c92a4697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:04.336174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89689cc-f587-4820-9e6a-0976c92a4697 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:04.337837 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:04.338380 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec3956-f804-4c54-9412-c01b51ec57c7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:04.346606 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 512/1034] 10.222.0.82 () {56 vars in 1115 bytes} [Fri Sep 23 15:11:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:04.352980 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89689cc-f587-4820-9e6a-0976c92a4697 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:04.449475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec3956-f804-4c54-9412-c01b51ec57c7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:04.458303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:04.479304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89689cc-f587-4820-9e6a-0976c92a4697 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:04.482677 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa9a27-ccfe-4412-9745-c2eb0c8e626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:04.483279 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa9a27-ccfe-4412-9745-c2eb0c8e626e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:04.483561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa9a27-ccfe-4412-9745-c2eb0c8e626e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:04.483833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa9a27-ccfe-4412-9745-c2eb0c8e626e None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:04.484432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa9a27-ccfe-4412-9745-c2eb0c8e626e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:04.485869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa9a27-ccfe-4412-9745-c2eb0c8e626e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:04.493632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 523/1035] 10.222.0.82 () {56 vars in 1087 bytes} [Fri Sep 23 15:11:04 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:11:04.520418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94804b79-afff-48c1-98af-646839205c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:04.521124 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94804b79-afff-48c1-98af-646839205c30 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:04.521402 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94804b79-afff-48c1-98af-646839205c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:04.521717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94804b79-afff-48c1-98af-646839205c30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:04.533941 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94804b79-afff-48c1-98af-646839205c30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:04.535481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94804b79-afff-48c1-98af-646839205c30 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:04.551763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-94804b79-afff-48c1-98af-646839205c30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:11:04.551763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:04.551763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:04.551763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:04.551763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:04.551763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:04.551763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:04.551763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:04.551763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:04.551763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:04.551763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:04.551763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:04.551763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:11:04.551763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:11:04.551763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:11:04.551763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:04.552853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:11:04.553838 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:11:04.553838 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:11:04.553838 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:04.558264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 513/1036] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:11:04.559483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa9a27-ccfe-4412-9745-c2eb0c8e626e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:04.677950 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa9a27-ccfe-4412-9745-c2eb0c8e626e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:04.713608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26044e-a292-4c3f-9701-cc903830e99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:04.714257 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26044e-a292-4c3f-9701-cc903830e99f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:04.714539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26044e-a292-4c3f-9701-cc903830e99f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:04.714809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26044e-a292-4c3f-9701-cc903830e99f None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:04.715449 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26044e-a292-4c3f-9701-cc903830e99f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:04.715750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26044e-a292-4c3f-9701-cc903830e99f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:04.717121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26044e-a292-4c3f-9701-cc903830e99f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:04.729922 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 524/1037] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:04.735706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94804b79-afff-48c1-98af-646839205c30 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:04.787191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:04.839063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94804b79-afff-48c1-98af-646839205c30 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:04.873507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4120b9-947f-4b28-8a64-193ef003f99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:04.874170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4120b9-947f-4b28-8a64-193ef003f99d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:04.874450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4120b9-947f-4b28-8a64-193ef003f99d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:04.874720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4120b9-947f-4b28-8a64-193ef003f99d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:04.882412 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4120b9-947f-4b28-8a64-193ef003f99d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:04.883838 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4120b9-947f-4b28-8a64-193ef003f99d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:04.894971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ae4120b9-947f-4b28-8a64-193ef003f99d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:11:04.894971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:04.894971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:04.894971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:04.894971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:04.894971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:04.894971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:04.894971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:04.894971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:04.894971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:04.894971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:04.894971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:04.894971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:11:04.894971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:11:04.894971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:11:04.894971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:04.895942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:04.897589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:04.897589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:04.897589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:11:04.897589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:11:04.897589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:11:04.897589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:11:04.897589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:11:04.897589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:11:04.897589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:11:04.897589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:04.897589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 514/1038] 10.222.0.82 () {56 vars in 1093 bytes} [Fri Sep 23 15:11:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:11:04.901866 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26044e-a292-4c3f-9701-cc903830e99f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:04.933960 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:05.016194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26044e-a292-4c3f-9701-cc903830e99f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:05.053722 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f1eef-dbf7-437e-af74-be35e38c279b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:05.054388 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f1eef-dbf7-437e-af74-be35e38c279b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:05.054669 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f1eef-dbf7-437e-af74-be35e38c279b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:05.054945 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f1eef-dbf7-437e-af74-be35e38c279b None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:05.055674 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f1eef-dbf7-437e-af74-be35e38c279b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:05.055982 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f1eef-dbf7-437e-af74-be35e38c279b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:05.057434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f1eef-dbf7-437e-af74-be35e38c279b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:05.080367 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 525/1039] 10.222.0.82 () {56 vars in 1133 bytes} [Fri Sep 23 15:11:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:05.082040 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4120b9-947f-4b28-8a64-193ef003f99d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:05.188346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4120b9-947f-4b28-8a64-193ef003f99d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:05.198947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:05.223152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2724a-afb0-4c29-b2e2-5c8eba249c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:05.223770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2724a-afb0-4c29-b2e2-5c8eba249c15 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:05.224048 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2724a-afb0-4c29-b2e2-5c8eba249c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:05.224317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2724a-afb0-4c29-b2e2-5c8eba249c15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:05.295143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2724a-afb0-4c29-b2e2-5c8eba249c15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:05.296500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2724a-afb0-4c29-b2e2-5c8eba249c15 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:05.398858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 515/1040] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:11:05 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:05.404782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f1eef-dbf7-437e-af74-be35e38c279b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:05.500902 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:05.544295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f1eef-dbf7-437e-af74-be35e38c279b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:05.556649 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560d2f5-e421-424f-b597-5243be245cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:05.557202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560d2f5-e421-424f-b597-5243be245cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:05.557475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560d2f5-e421-424f-b597-5243be245cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:05.557762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560d2f5-e421-424f-b597-5243be245cb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:05.577532 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560d2f5-e421-424f-b597-5243be245cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:05.579094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560d2f5-e421-424f-b597-5243be245cb1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:05.597518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d560d2f5-e421-424f-b597-5243be245cb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:11:05.597518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:05.597518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:05.597518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:05.597518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:05.597518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:05.597518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:05.597518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:05.597518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:05.597518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:05.597518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:05.597518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:05.597518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:11:05.597518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:11:05.597518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:11:05.597518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:05.598556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:11:05.599454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:11:05.599454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:11:05.599454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:11:05.599454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 526/1041] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:11:05.604588 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2724a-afb0-4c29-b2e2-5c8eba249c15 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:05.616413 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:05.660498 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a1499-02b6-4b05-a0ca-798348276374 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:05.660826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a1499-02b6-4b05-a0ca-798348276374 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:05.661046 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a1499-02b6-4b05-a0ca-798348276374 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:05.662415 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 527/1042] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:11:05.669140 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d0e76-f78b-4136-93d4-469f5c8710a1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:05.669578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d0e76-f78b-4136-93d4-469f5c8710a1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:05.669887 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d0e76-f78b-4136-93d4-469f5c8710a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:05.689724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8a2d0e76-f78b-4136-93d4-469f5c8710a1 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:05.690938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8a2d0e76-f78b-4136-93d4-469f5c8710a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:05.711458 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2724a-afb0-4c29-b2e2-5c8eba249c15 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:05.754954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4231df-f897-4024-9183-6938e800738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:05.755743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4231df-f897-4024-9183-6938e800738b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:05.756019 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4231df-f897-4024-9183-6938e800738b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:05.756282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4231df-f897-4024-9183-6938e800738b None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:05.756918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4231df-f897-4024-9183-6938e800738b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:05.757267 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4231df-f897-4024-9183-6938e800738b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:05.759846 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4231df-f897-4024-9183-6938e800738b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:05.764213 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 528/1043] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:11:05.779477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 516/1044] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:05.781086 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d0e76-f78b-4136-93d4-469f5c8710a1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:05.854814 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:05.883682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d0e76-f78b-4136-93d4-469f5c8710a1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:05.917420 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87755abc-0016-44fe-8b62-73ac9f8d9fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:05.918078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87755abc-0016-44fe-8b62-73ac9f8d9fce None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:05.918354 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87755abc-0016-44fe-8b62-73ac9f8d9fce None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:05.918625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87755abc-0016-44fe-8b62-73ac9f8d9fce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:05.925174 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87755abc-0016-44fe-8b62-73ac9f8d9fce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:05.926635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87755abc-0016-44fe-8b62-73ac9f8d9fce None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:05.938152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-87755abc-0016-44fe-8b62-73ac9f8d9fce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:11:05.938152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:05.938152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:05.938152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:05.938152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:05.938152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:05.938152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:05.938152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:05.938152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:05.938152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:05.938152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:05.938152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:05.938152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:11:05.938152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:11:05.938152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:05.939074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:05.940091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:11:05.940091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:11:05.940091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:11:05.940091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:11:05.940091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:11:05.940091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:11:05.940091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:11:05.940091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:11:05.942040 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 529/1045] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:11:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:11:05.945781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4231df-f897-4024-9183-6938e800738b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:06.023682 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:06.035010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87755abc-0016-44fe-8b62-73ac9f8d9fce None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:06.060871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4231df-f897-4024-9183-6938e800738b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:06.105128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8c304-2ef2-4097-8369-c9d57eeab841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:06.106355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8c304-2ef2-4097-8369-c9d57eeab841 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:06.106836 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8c304-2ef2-4097-8369-c9d57eeab841 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:06.107462 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8c304-2ef2-4097-8369-c9d57eeab841 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:06.109242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8c304-2ef2-4097-8369-c9d57eeab841 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:06.109777 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8c304-2ef2-4097-8369-c9d57eeab841 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:06.111404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8c304-2ef2-4097-8369-c9d57eeab841 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:06.128278 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 517/1046] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:11:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:06.134339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8c304-2ef2-4097-8369-c9d57eeab841 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:06.143908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87755abc-0016-44fe-8b62-73ac9f8d9fce None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:06.177117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:06.183586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675c4c6-ee72-45d1-9320-afa2fec90393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:06.184272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675c4c6-ee72-45d1-9320-afa2fec90393 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:06.184550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675c4c6-ee72-45d1-9320-afa2fec90393 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:06.184828 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675c4c6-ee72-45d1-9320-afa2fec90393 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:06.196724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675c4c6-ee72-45d1-9320-afa2fec90393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:11:06.208154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e675c4c6-ee72-45d1-9320-afa2fec90393 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:11:06.208154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:06.208154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:06.208154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:06.208154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:06.208154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:06.208154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:06.208154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:06.208154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:06.208154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:06.208154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:06.208154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:06.208154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:11:06.208154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:11:06.208154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:11:06.208154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:11:06.209133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:11:06.209133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:11:06.209133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:11:06.209133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:11:06.209133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:06.209133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:06.209133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:06.209133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:06.209133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:06.209133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:06.209133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:06.209133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:06.209133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:06.209133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:06.209133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:06.209133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:06.210010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:06.210010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:06.210010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:06.210010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:06.210010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:11:06.210010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:11:06.210010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:11:06.210010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:11:06.210010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:11:06.210010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:11:06.210010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:11:06.210010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:11:06.210010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 530/1047] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:11:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:11:06.212421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675c4c6-ee72-45d1-9320-afa2fec90393 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:06.236735 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8c304-2ef2-4097-8369-c9d57eeab841 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:06.271227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:06.276891 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41aa057-cb5f-4a71-8a91-4d88de714906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:06.277696 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41aa057-cb5f-4a71-8a91-4d88de714906 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:06.277916 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41aa057-cb5f-4a71-8a91-4d88de714906 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:06.278176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41aa057-cb5f-4a71-8a91-4d88de714906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:06.279033 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41aa057-cb5f-4a71-8a91-4d88de714906 None admin] RBAC: Adding query filter params (role.id=761366d21b194095aa29578e791fe568, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=6dbf682960cc447099c11862afa3206b) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:06.279310 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41aa057-cb5f-4a71-8a91-4d88de714906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:06.280921 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41aa057-cb5f-4a71-8a91-4d88de714906 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:06.286844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 518/1048] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:11:06 2022] GET /identity/v3/role_assignments?user.id=6dbf682960cc447099c11862afa3206b&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=761366d21b194095aa29578e791fe568 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:06.322247 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675c4c6-ee72-45d1-9320-afa2fec90393 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:06.364406 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6d5ee-0a41-45e0-8884-83220de9e6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:06.364962 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6d5ee-0a41-45e0-8884-83220de9e6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:06.365242 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6d5ee-0a41-45e0-8884-83220de9e6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:06.365515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6d5ee-0a41-45e0-8884-83220de9e6b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:06.366226 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6d5ee-0a41-45e0-8884-83220de9e6b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:06.366562 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6d5ee-0a41-45e0-8884-83220de9e6b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:06.370171 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6d5ee-0a41-45e0-8884-83220de9e6b8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:06.379981 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 531/1049] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:11:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:06.385897 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41aa057-cb5f-4a71-8a91-4d88de714906 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:06.499457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41aa057-cb5f-4a71-8a91-4d88de714906 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:06.535690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b95a5c-1466-4608-b034-41c3df6441ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:06.536319 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b95a5c-1466-4608-b034-41c3df6441ff None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:06.536598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b95a5c-1466-4608-b034-41c3df6441ff None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:06.536958 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b95a5c-1466-4608-b034-41c3df6441ff None admin] PATH_INFO: `/v3/users/bbd4ed19de834d0db8898321fec4d029` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:06.551556 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b95a5c-1466-4608-b034-41c3df6441ff None admin] RBAC: Authorizing `identity:get_user(user_id=bbd4ed19de834d0db8898321fec4d029)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:06.553004 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b95a5c-1466-4608-b034-41c3df6441ff None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:06.559932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 519/1050] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:11:06 2022] GET /identity/v3/users/bbd4ed19de834d0db8898321fec4d029 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:06.561507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6d5ee-0a41-45e0-8884-83220de9e6b8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:06.623562 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:06.668773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6d5ee-0a41-45e0-8884-83220de9e6b8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:06.697563 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0902ce4-615c-41bb-a02c-4fbe90638ea4 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:06.697872 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0902ce4-615c-41bb-a02c-4fbe90638ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:06.698151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0902ce4-615c-41bb-a02c-4fbe90638ea4 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:06.699685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 520/1051] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:11:06.704487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293a19e-4304-4bdb-b763-cf642c01bea4 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:06.704765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293a19e-4304-4bdb-b763-cf642c01bea4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:06.704982 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f51ab-b4eb-4584-a247-9d8495d6b042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:06.705442 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293a19e-4304-4bdb-b763-cf642c01bea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:06.705608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f51ab-b4eb-4584-a247-9d8495d6b042 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:06.705897 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f51ab-b4eb-4584-a247-9d8495d6b042 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:06.706169 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f51ab-b4eb-4584-a247-9d8495d6b042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:06.723515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3293a19e-4304-4bdb-b763-cf642c01bea4 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:06.724714 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3293a19e-4304-4bdb-b763-cf642c01bea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:06.781392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:06.782460 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f51ab-b4eb-4584-a247-9d8495d6b042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:06.783923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f51ab-b4eb-4584-a247-9d8495d6b042 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:06.803761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 521/1052] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:11:06.843305 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:06.888662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 532/1053] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:11:06 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 23 15:11:06.894010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293a19e-4304-4bdb-b763-cf642c01bea4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:07.002746 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293a19e-4304-4bdb-b763-cf642c01bea4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:07.038962 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97b308-86f4-4c5a-9ac7-93e2905e4762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:07.039589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97b308-86f4-4c5a-9ac7-93e2905e4762 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:07.039870 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97b308-86f4-4c5a-9ac7-93e2905e4762 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:07.040143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97b308-86f4-4c5a-9ac7-93e2905e4762 None admin] PATH_INFO: `/v3/projects/7a7f82b1b0ec4272bd372eb5c78f16e1` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:07.041509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97b308-86f4-4c5a-9ac7-93e2905e4762 None admin] RBAC: Authorizing `identity:get_project(project_id=7a7f82b1b0ec4272bd372eb5c78f16e1)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:07.043051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97b308-86f4-4c5a-9ac7-93e2905e4762 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:07.044951 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 522/1054] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:11:06 2022] GET /identity/v3/projects/7a7f82b1b0ec4272bd372eb5c78f16e1 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:07.051065 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f51ab-b4eb-4584-a247-9d8495d6b042 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:07.071765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97b308-86f4-4c5a-9ac7-93e2905e4762 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:07.126348 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:07.160057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f51ab-b4eb-4584-a247-9d8495d6b042 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:07.185388 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97b308-86f4-4c5a-9ac7-93e2905e4762 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:07.196698 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf1b00-3b47-45fd-be20-4447a930efe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:07.197302 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf1b00-3b47-45fd-be20-4447a930efe0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:07.197580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf1b00-3b47-45fd-be20-4447a930efe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:07.197883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf1b00-3b47-45fd-be20-4447a930efe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:07.198604 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf1b00-3b47-45fd-be20-4447a930efe0 None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=7a7f82b1b0ec4272bd372eb5c78f16e1, user.id=bbd4ed19de834d0db8898321fec4d029) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:07.198916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf1b00-3b47-45fd-be20-4447a930efe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:07.200359 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf1b00-3b47-45fd-be20-4447a930efe0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:07.205717 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 533/1055] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:11:07 2022] GET /identity/v3/role_assignments?user.id=bbd4ed19de834d0db8898321fec4d029&scope.project.id=7a7f82b1b0ec4272bd372eb5c78f16e1&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:07.233267 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e92ab-39c9-4d0e-befb-543ca91df403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:07.233963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e92ab-39c9-4d0e-befb-543ca91df403 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:07.234448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e92ab-39c9-4d0e-befb-543ca91df403 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:07.234720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e92ab-39c9-4d0e-befb-543ca91df403 None admin] PATH_INFO: `/v3/services/image` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:07.235323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e92ab-39c9-4d0e-befb-543ca91df403 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:07.236729 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e92ab-39c9-4d0e-befb-543ca91df403 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0a9e92ab-39c9-4d0e-befb-543ca91df403 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:07.246854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:07.247957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:07.247957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:07.247957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:07.247957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:07.247957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:07.247957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:07.247957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:11:07.247957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:11:07.247957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:11:07.247957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:11:07.247957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:07.247957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:07.247957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:07.247957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:07.247957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:07.247957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:07.248813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:07.248813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:07.248813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:07.248813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:07.248813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:07.248813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:07.248813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:07.248813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:07.248813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:07.248813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:07.248813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:11:07.248813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:11:07.248813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 15:11:07.248813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:07.253514 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 523/1056] 10.222.0.82 () {56 vars in 1105 bytes} [Fri Sep 23 15:11:07 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:11:07.254770 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf1b00-3b47-45fd-be20-4447a930efe0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:07.276864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:07.364602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf1b00-3b47-45fd-be20-4447a930efe0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:07.401900 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d93b4f-4176-4bc2-aa7f-2acbc32f53c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:07.402521 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93b4f-4176-4bc2-aa7f-2acbc32f53c7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:07.402800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93b4f-4176-4bc2-aa7f-2acbc32f53c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:07.403075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d93b4f-4176-4bc2-aa7f-2acbc32f53c7 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:07.403708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d93b4f-4176-4bc2-aa7f-2acbc32f53c7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:07.419418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d93b4f-4176-4bc2-aa7f-2acbc32f53c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:07.419418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d93b4f-4176-4bc2-aa7f-2acbc32f53c7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:07.419418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 534/1057] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:11:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:07.419714 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e92ab-39c9-4d0e-befb-543ca91df403 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:07.520047 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e92ab-39c9-4d0e-befb-543ca91df403 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:07.534581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:07.556474 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa250f-44b5-4087-b1d5-f78d5a7cb400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:07.557080 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa250f-44b5-4087-b1d5-f78d5a7cb400 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:07.557356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa250f-44b5-4087-b1d5-f78d5a7cb400 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:07.557627 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa250f-44b5-4087-b1d5-f78d5a7cb400 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:07.558315 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa250f-44b5-4087-b1d5-f78d5a7cb400 None admin] RBAC: Adding query filter params (type=image) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:07.558602 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa250f-44b5-4087-b1d5-f78d5a7cb400 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:07.559962 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa250f-44b5-4087-b1d5-f78d5a7cb400 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:07.569398 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 524/1058] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:11:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:07.570952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d93b4f-4176-4bc2-aa7f-2acbc32f53c7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:07.655781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:07.674522 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d93b4f-4176-4bc2-aa7f-2acbc32f53c7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:07.709147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122ddac-98b7-4391-b946-8c08f2409d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:07.709930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122ddac-98b7-4391-b946-8c08f2409d08 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:07.710044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122ddac-98b7-4391-b946-8c08f2409d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:07.710902 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122ddac-98b7-4391-b946-8c08f2409d08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:07.711809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122ddac-98b7-4391-b946-8c08f2409d08 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:07.713839 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122ddac-98b7-4391-b946-8c08f2409d08 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:07.885763 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 535/1059] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:11:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:11:08.465883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca4038-bdb2-4d02-8904-dd3bf52d9ca5 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:08.466411 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca4038-bdb2-4d02-8904-dd3bf52d9ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:08.466411 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca4038-bdb2-4d02-8904-dd3bf52d9ca5 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:08.467759 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 525/1060] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:08.473152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cd6bb-b69e-46a2-8345-3b80dd5df671 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:08.473444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cd6bb-b69e-46a2-8345-3b80dd5df671 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:08.473717 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cd6bb-b69e-46a2-8345-3b80dd5df671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:08.492776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-508cd6bb-b69e-46a2-8345-3b80dd5df671 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:08.493990 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-508cd6bb-b69e-46a2-8345-3b80dd5df671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:08.568605 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 536/1061] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:08.832992 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca4038-bdb2-4d02-8904-dd3bf52d9ca5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:08.935473 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca4038-bdb2-4d02-8904-dd3bf52d9ca5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:08.978875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78417a-7408-4cee-8b41-118cfe21e5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:08.979509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78417a-7408-4cee-8b41-118cfe21e5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:08.979782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78417a-7408-4cee-8b41-118cfe21e5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:08.980046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78417a-7408-4cee-8b41-118cfe21e5d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:08.990918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78417a-7408-4cee-8b41-118cfe21e5d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:11:08.995743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3a78417a-7408-4cee-8b41-118cfe21e5d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 15:11:08.995743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:08.995743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:08.995743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:08.995743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:08.995743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:08.995743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:08.995743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:08.995743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:08.995743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:08.995743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:08.995743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:08.995743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:11:08.995743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:11:08.995743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:11:08.995743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:11:08.996722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:11:08.996722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:11:08.996722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:11:08.996722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:11:08.996722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:08.996722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:08.996722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:08.996722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:08.996722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:08.996722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:08.996722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:08.996722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:08.996722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:08.996722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:08.996722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:08.996722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:08.997713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:08.997713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:08.997713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:08.997713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:08.997713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:11:08.997713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:11:08.997713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:11:08.997713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:11:08.997713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:11:08.997713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:11:08.997713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 15:11:08.997713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:09.004884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 526/1062] 10.222.0.82 () {56 vars in 1120 bytes} [Fri Sep 23 15:11:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:11:09.005061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cd6bb-b69e-46a2-8345-3b80dd5df671 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:09.067601 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:09.106628 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cd6bb-b69e-46a2-8345-3b80dd5df671 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:09.141155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79972384-6b70-48c2-9e79-36e32d045867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:09.141798 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79972384-6b70-48c2-9e79-36e32d045867 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:09.142076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79972384-6b70-48c2-9e79-36e32d045867 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:09.142343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79972384-6b70-48c2-9e79-36e32d045867 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:09.142999 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79972384-6b70-48c2-9e79-36e32d045867 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:09.143301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79972384-6b70-48c2-9e79-36e32d045867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:09.144661 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79972384-6b70-48c2-9e79-36e32d045867 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:09.153359 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 537/1063] 10.222.0.82 () {56 vars in 1115 bytes} [Fri Sep 23 15:11:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:09.158992 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78417a-7408-4cee-8b41-118cfe21e5d4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:09.200092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:09.263707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78417a-7408-4cee-8b41-118cfe21e5d4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:09.305745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4b64c-50db-4014-b93d-bcae5612fed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:09.306543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b64c-50db-4014-b93d-bcae5612fed0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:09.306917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b64c-50db-4014-b93d-bcae5612fed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:09.307281 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b64c-50db-4014-b93d-bcae5612fed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:09.318076 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4b64c-50db-4014-b93d-bcae5612fed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:09.320162 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4b64c-50db-4014-b93d-bcae5612fed0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:09.334636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-acd4b64c-50db-4014-b93d-bcae5612fed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:11:09.334636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:09.334636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:09.334636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:09.334636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:09.334636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:09.334636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:09.334636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:09.334636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:09.334636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:09.334636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:09.334636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:09.334636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:11:09.334636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:11:09.334636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:11:09.334636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:09.336410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:11:09.337607 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:11:09.337607 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:11:09.337607 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:09.338782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 527/1064] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:11:09.344256 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79972384-6b70-48c2-9e79-36e32d045867 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:09.383992 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9506e6d-dad7-4734-aabd-a9d4b4e773c0 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:09.384338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9506e6d-dad7-4734-aabd-a9d4b4e773c0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:09.384753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9506e6d-dad7-4734-aabd-a9d4b4e773c0 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:09.386247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 528/1065] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:09.391540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d5317-1708-4d13-bfc9-d2175a3b57be None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:09.391824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d5317-1708-4d13-bfc9-d2175a3b57be None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:09.392100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d5317-1708-4d13-bfc9-d2175a3b57be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:09.411787 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-297d5317-1708-4d13-bfc9-d2175a3b57be None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:09.413002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-297d5317-1708-4d13-bfc9-d2175a3b57be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:09.454156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79972384-6b70-48c2-9e79-36e32d045867 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:09.488863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:09.492217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 529/1066] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:09.498870 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988a206-43ec-4b1c-82a2-870c3a20fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:09.499483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988a206-43ec-4b1c-82a2-870c3a20fca0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:09.499759 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988a206-43ec-4b1c-82a2-870c3a20fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:09.500029 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988a206-43ec-4b1c-82a2-870c3a20fca0 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:09.500703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988a206-43ec-4b1c-82a2-870c3a20fca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:09.501953 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988a206-43ec-4b1c-82a2-870c3a20fca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:09.502383 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988a206-43ec-4b1c-82a2-870c3a20fca0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:09.515049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 538/1067] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:09.521055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d5317-1708-4d13-bfc9-d2175a3b57be None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:09.543256 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:09.620038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d5317-1708-4d13-bfc9-d2175a3b57be None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:09.655121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cad6dd-37d3-49a1-8b11-0e554e2c3ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:09.655664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cad6dd-37d3-49a1-8b11-0e554e2c3ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:09.655944 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cad6dd-37d3-49a1-8b11-0e554e2c3ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:09.656215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cad6dd-37d3-49a1-8b11-0e554e2c3ea1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:09.663374 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cad6dd-37d3-49a1-8b11-0e554e2c3ea1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:09.664945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cad6dd-37d3-49a1-8b11-0e554e2c3ea1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:09.676617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c7cad6dd-37d3-49a1-8b11-0e554e2c3ea1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:11:09.676617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:09.676617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:09.676617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:09.676617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:09.676617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:09.676617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:09.676617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:09.676617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:09.676617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:09.676617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:09.676617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:09.676617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:11:09.676617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:11:09.676617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:11:09.676617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:09.677580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:09.684151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:09.684151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:09.684151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:11:09.684151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:11:09.684151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:11:09.684151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:11:09.684151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:11:09.684151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:11:09.684151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:11:09.684151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:09.684151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 530/1068] 10.222.0.82 () {56 vars in 1093 bytes} [Fri Sep 23 15:11:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:11:09.686374 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988a206-43ec-4b1c-82a2-870c3a20fca0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:09.773424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cad6dd-37d3-49a1-8b11-0e554e2c3ea1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:09.790824 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988a206-43ec-4b1c-82a2-870c3a20fca0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:09.826891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d27057-04d5-42f9-9773-6cade88c7a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:09.827499 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d27057-04d5-42f9-9773-6cade88c7a37 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:09.827782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d27057-04d5-42f9-9773-6cade88c7a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:09.828052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d27057-04d5-42f9-9773-6cade88c7a37 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:09.828780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d27057-04d5-42f9-9773-6cade88c7a37 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:09.829082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d27057-04d5-42f9-9773-6cade88c7a37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:09.830558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d27057-04d5-42f9-9773-6cade88c7a37 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:09.847425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 539/1069] 10.222.0.82 () {56 vars in 1133 bytes} [Fri Sep 23 15:11:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:09.853570 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d27057-04d5-42f9-9773-6cade88c7a37 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:09.869328 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:09.889368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cad6dd-37d3-49a1-8b11-0e554e2c3ea1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:09.902209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:09.926860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e666703-f948-4c28-be57-0801be9e20e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:09.928282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e666703-f948-4c28-be57-0801be9e20e7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:09.928566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e666703-f948-4c28-be57-0801be9e20e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:09.928865 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e666703-f948-4c28-be57-0801be9e20e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:09.941361 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e666703-f948-4c28-be57-0801be9e20e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:11:09.946727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4e666703-f948-4c28-be57-0801be9e20e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:11:09.946727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:09.946727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:09.946727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:09.946727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:09.946727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:09.946727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:09.946727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:09.946727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:09.946727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:09.946727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:09.946727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:09.946727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:11:09.946727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:11:09.946727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:11:09.946727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:11:09.947756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:11:09.947756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:11:09.947756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:11:09.947756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:11:09.947756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:09.947756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:09.947756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:09.947756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:09.947756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:09.947756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:09.947756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:09.947756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:09.947756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:09.947756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:09.947756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:09.947756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:09.948603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:09.948603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:09.948603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:09.948603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:09.948603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:11:09.948603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:11:09.948603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:11:09.948603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:11:09.948603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:11:09.948603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:11:09.948603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:11:09.948603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:09.948603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 531/1070] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:11:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:11:09.954626 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e666703-f948-4c28-be57-0801be9e20e7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:09.969667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d27057-04d5-42f9-9773-6cade88c7a37 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:10.017566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf25029-3185-403f-923d-c8771195ec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:10.018689 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf25029-3185-403f-923d-c8771195ec8e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:10.018975 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf25029-3185-403f-923d-c8771195ec8e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:10.019519 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf25029-3185-403f-923d-c8771195ec8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:10.030702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf25029-3185-403f-923d-c8771195ec8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:10.032160 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf25029-3185-403f-923d-c8771195ec8e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:10.049940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ccf25029-3185-403f-923d-c8771195ec8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:11:10.049940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:10.049940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:10.049940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:10.049940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:10.049940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:10.049940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:10.049940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:10.049940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:10.049940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:10.049940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:10.049940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:10.049940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:11:10.049940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:11:10.049940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:11:10.049940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:10.050959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:11:10.052229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:11:10.052229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:11:10.052229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:11:10.052229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 540/1071] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:11:10.060490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf25029-3185-403f-923d-c8771195ec8e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:10.071921 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e666703-f948-4c28-be57-0801be9e20e7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:10.106458 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3335ad-261c-4196-ae47-3d1f4bf76995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:10.107068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3335ad-261c-4196-ae47-3d1f4bf76995 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:10.107348 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3335ad-261c-4196-ae47-3d1f4bf76995 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:10.107620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3335ad-261c-4196-ae47-3d1f4bf76995 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:10.108282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3335ad-261c-4196-ae47-3d1f4bf76995 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:10.108581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3335ad-261c-4196-ae47-3d1f4bf76995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:10.109979 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3335ad-261c-4196-ae47-3d1f4bf76995 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:10.119734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 532/1072] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:11:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:10.119734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466a7df-1e5e-4071-bbf7-c3c11ed454eb None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:10.119734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466a7df-1e5e-4071-bbf7-c3c11ed454eb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:10.119734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466a7df-1e5e-4071-bbf7-c3c11ed454eb None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:10.119734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 533/1073] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:10.125814 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466a7df-1e5e-4071-bbf7-c3c11ed454eb None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:10.128589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:10.157380 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:10.162986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf25029-3185-403f-923d-c8771195ec8e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:10.196865 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194017e9-d713-490f-9851-b73a6b131b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:10.197420 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194017e9-d713-490f-9851-b73a6b131b3f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:10.197686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194017e9-d713-490f-9851-b73a6b131b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:10.197989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194017e9-d713-490f-9851-b73a6b131b3f None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:10.198621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194017e9-d713-490f-9851-b73a6b131b3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:10.198921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194017e9-d713-490f-9851-b73a6b131b3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:10.200411 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194017e9-d713-490f-9851-b73a6b131b3f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:10.212208 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 541/1074] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:10.215015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a7d15-8c8b-44cb-b715-56e65d256568 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:10.215296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a7d15-8c8b-44cb-b715-56e65d256568 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:10.215567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a7d15-8c8b-44cb-b715-56e65d256568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:10.230030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466a7df-1e5e-4071-bbf7-c3c11ed454eb None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:10.235761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bf3a7d15-8c8b-44cb-b715-56e65d256568 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:10.236963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bf3a7d15-8c8b-44cb-b715-56e65d256568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:10.264604 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b55c2-1992-4d92-8812-8d6f2b1c1f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:10.265231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b55c2-1992-4d92-8812-8d6f2b1c1f66 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:10.265522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b55c2-1992-4d92-8812-8d6f2b1c1f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:10.265826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b55c2-1992-4d92-8812-8d6f2b1c1f66 None admin] PATH_INFO: `/v3/users/bbd4ed19de834d0db8898321fec4d029` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:10.266957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b55c2-1992-4d92-8812-8d6f2b1c1f66 None admin] RBAC: Authorizing `identity:get_user(user_id=bbd4ed19de834d0db8898321fec4d029)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:10.268375 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b55c2-1992-4d92-8812-8d6f2b1c1f66 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:10.271013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 534/1075] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:11:10 2022] GET /identity/v3/users/bbd4ed19de834d0db8898321fec4d029 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:10.271013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b55c2-1992-4d92-8812-8d6f2b1c1f66 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:10.304038 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 542/1076] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:10.304876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a7d15-8c8b-44cb-b715-56e65d256568 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:10.343288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:10.377466 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b55c2-1992-4d92-8812-8d6f2b1c1f66 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:10.412023 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:10.415454 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5d0a2-b05b-4a18-8d0e-b53285a39ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:10.416085 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5d0a2-b05b-4a18-8d0e-b53285a39ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:10.416446 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5d0a2-b05b-4a18-8d0e-b53285a39ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:10.417022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5d0a2-b05b-4a18-8d0e-b53285a39ce3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:10.424790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5d0a2-b05b-4a18-8d0e-b53285a39ce3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:10.426512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5d0a2-b05b-4a18-8d0e-b53285a39ce3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:10.428633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a7d15-8c8b-44cb-b715-56e65d256568 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:10.437974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c2e5d0a2-b05b-4a18-8d0e-b53285a39ce3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:11:10.437974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:10.437974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:10.437974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:10.437974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:10.437974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:10.437974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:10.437974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:10.437974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:10.437974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:10.437974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:10.437974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:10.437974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:11:10.437974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:11:10.437974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:10.439084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:10.445441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:11:10.445441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:11:10.445441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:11:10.445441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:11:10.445441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:11:10.445441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:11:10.445441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:11:10.445441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:10.445441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 535/1077] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:11:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:11:10.445441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5d0a2-b05b-4a18-8d0e-b53285a39ce3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:10.468931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504701d9-2152-467b-9ef0-95032818265a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:10.470228 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504701d9-2152-467b-9ef0-95032818265a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:10.470344 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504701d9-2152-467b-9ef0-95032818265a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:10.470753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504701d9-2152-467b-9ef0-95032818265a None admin] PATH_INFO: `/v3/projects/7a7f82b1b0ec4272bd372eb5c78f16e1` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:10.472333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504701d9-2152-467b-9ef0-95032818265a None admin] RBAC: Authorizing `identity:get_project(project_id=7a7f82b1b0ec4272bd372eb5c78f16e1)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:10.473902 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504701d9-2152-467b-9ef0-95032818265a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:10.480639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 543/1078] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:11:10 2022] GET /identity/v3/projects/7a7f82b1b0ec4272bd372eb5c78f16e1 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:10.481667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504701d9-2152-467b-9ef0-95032818265a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:10.567586 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5d0a2-b05b-4a18-8d0e-b53285a39ce3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:10.586060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504701d9-2152-467b-9ef0-95032818265a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:10.595690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:10.601750 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae48a5-ddea-40ba-b0e6-7417d1514da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:10.602363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae48a5-ddea-40ba-b0e6-7417d1514da1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:10.602642 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae48a5-ddea-40ba-b0e6-7417d1514da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:10.602914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae48a5-ddea-40ba-b0e6-7417d1514da1 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:10.603603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae48a5-ddea-40ba-b0e6-7417d1514da1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:10.603910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae48a5-ddea-40ba-b0e6-7417d1514da1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:10.605533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae48a5-ddea-40ba-b0e6-7417d1514da1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:10.619266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 536/1079] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:11:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:10.620945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae48a5-ddea-40ba-b0e6-7417d1514da1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:10.621543 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112ddc2-cdb1-4478-9d2f-bc7c86bee549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:10.622395 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112ddc2-cdb1-4478-9d2f-bc7c86bee549 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:10.622673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112ddc2-cdb1-4478-9d2f-bc7c86bee549 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:10.622945 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112ddc2-cdb1-4478-9d2f-bc7c86bee549 None admin] PATH_INFO: `/v3/projects/7a7f82b1b0ec4272bd372eb5c78f16e1/users/bbd4ed19de834d0db8898321fec4d029/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:10.624891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112ddc2-cdb1-4478-9d2f-bc7c86bee549 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a7f82b1b0ec4272bd372eb5c78f16e1, user_id=bbd4ed19de834d0db8898321fec4d029, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:10.626352 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112ddc2-cdb1-4478-9d2f-bc7c86bee549 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:10.712277 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 544/1080] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:11:10 2022] PUT /identity/v3/projects/7a7f82b1b0ec4272bd372eb5c78f16e1/users/bbd4ed19de834d0db8898321fec4d029/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:11:10.713075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112ddc2-cdb1-4478-9d2f-bc7c86bee549 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:10.721455 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae48a5-ddea-40ba-b0e6-7417d1514da1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:10.730504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:10.760516 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e223e3-9763-465f-ad9e-dd6bd1d4ec5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:10.761130 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e223e3-9763-465f-ad9e-dd6bd1d4ec5d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:10.761487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e223e3-9763-465f-ad9e-dd6bd1d4ec5d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:10.761779 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e223e3-9763-465f-ad9e-dd6bd1d4ec5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:10.828706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:10.833183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112ddc2-cdb1-4478-9d2f-bc7c86bee549 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:10.840663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e223e3-9763-465f-ad9e-dd6bd1d4ec5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:10.842188 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e223e3-9763-465f-ad9e-dd6bd1d4ec5d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:10.871335 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f70bdd-b187-4d3c-82ff-9295da6ebe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:10.872328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f70bdd-b187-4d3c-82ff-9295da6ebe7e None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:10.872603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f70bdd-b187-4d3c-82ff-9295da6ebe7e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:10.872873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f70bdd-b187-4d3c-82ff-9295da6ebe7e None admin] PATH_INFO: `/v3/projects/718a472b7d564c429849b127a44aaaad/users/6dbf682960cc447099c11862afa3206b/roles/761366d21b194095aa29578e791fe568` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:10.875103 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f70bdd-b187-4d3c-82ff-9295da6ebe7e None admin] RBAC: Authorizing `identity:create_grant(project_id=718a472b7d564c429849b127a44aaaad, user_id=6dbf682960cc447099c11862afa3206b, role_id=761366d21b194095aa29578e791fe568)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:10.876576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f70bdd-b187-4d3c-82ff-9295da6ebe7e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:10.948546 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 537/1081] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:11:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:10.954512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e223e3-9763-465f-ad9e-dd6bd1d4ec5d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:10.980066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 545/1082] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:11:10 2022] PUT /identity/v3/projects/718a472b7d564c429849b127a44aaaad/users/6dbf682960cc447099c11862afa3206b/roles/761366d21b194095aa29578e791fe568 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:11:11.058040 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:11.068326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e223e3-9763-465f-ad9e-dd6bd1d4ec5d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:11.107551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57cc3a-1dd9-4c29-ac41-9f0cf9065b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:11.108199 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57cc3a-1dd9-4c29-ac41-9f0cf9065b87 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:11.108473 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57cc3a-1dd9-4c29-ac41-9f0cf9065b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:11.108741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57cc3a-1dd9-4c29-ac41-9f0cf9065b87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:11.120931 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57cc3a-1dd9-4c29-ac41-9f0cf9065b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:11.122418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57cc3a-1dd9-4c29-ac41-9f0cf9065b87 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:11.138932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-2d57cc3a-1dd9-4c29-ac41-9f0cf9065b87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:11:11.138932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:11.138932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:11.138932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:11.138932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:11.138932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:11.138932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:11.138932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:11.138932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:11.138932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:11.138932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:11.138932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:11.138932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:11:11.138932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:11:11.138932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:11:11.138932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:11.139976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:11:11.140883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:11:11.140883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:11:11.140883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:11.140883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 538/1083] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:11:11.146310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f70bdd-b187-4d3c-82ff-9295da6ebe7e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:11.226960 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:11.252935 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f70bdd-b187-4d3c-82ff-9295da6ebe7e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:11.289891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f7f06-b33d-4d60-84b2-475a41b60bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:11.290762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f7f06-b33d-4d60-84b2-475a41b60bca None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:11.291042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f7f06-b33d-4d60-84b2-475a41b60bca None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:11.291318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f7f06-b33d-4d60-84b2-475a41b60bca None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:11.291961 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f7f06-b33d-4d60-84b2-475a41b60bca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:11.292262 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f7f06-b33d-4d60-84b2-475a41b60bca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:11.293646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f7f06-b33d-4d60-84b2-475a41b60bca None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:11.309114 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 546/1084] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:12.928942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50a9bf-3c6c-4a23-813b-7892af225a6f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:12.929483 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50a9bf-3c6c-4a23-813b-7892af225a6f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:12.929483 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50a9bf-3c6c-4a23-813b-7892af225a6f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:12.933148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 539/1085] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:12.936598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464163dd-6edb-4d4b-901d-e33d82186efd None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:12.937031 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464163dd-6edb-4d4b-901d-e33d82186efd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:12.937130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464163dd-6edb-4d4b-901d-e33d82186efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:12.955565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-464163dd-6edb-4d4b-901d-e33d82186efd None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:12.956742 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-464163dd-6edb-4d4b-901d-e33d82186efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:13.026924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 547/1086] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:13.173765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efeb965-fdde-43ee-a802-a1f45ffbc661 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:13.174029 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efeb965-fdde-43ee-a802-a1f45ffbc661 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:13.174303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efeb965-fdde-43ee-a802-a1f45ffbc661 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:13.175822 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 540/1087] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:13.181058 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8adc0e-35e2-48c2-9cef-afa48edaf095 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:13.181355 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8adc0e-35e2-48c2-9cef-afa48edaf095 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:13.181634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8adc0e-35e2-48c2-9cef-afa48edaf095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:13.200489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7a8adc0e-35e2-48c2-9cef-afa48edaf095 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:13.201670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7a8adc0e-35e2-48c2-9cef-afa48edaf095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:13.260716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:13.269311 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 548/1088] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:11:13.302853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efeb965-fdde-43ee-a802-a1f45ffbc661 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:13.404534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efeb965-fdde-43ee-a802-a1f45ffbc661 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:13.439804 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e894e66-f067-4a0c-a965-c7f31fa28228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:13.440357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e894e66-f067-4a0c-a965-c7f31fa28228 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:13.440637 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e894e66-f067-4a0c-a965-c7f31fa28228 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:13.440906 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e894e66-f067-4a0c-a965-c7f31fa28228 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:13.452109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e894e66-f067-4a0c-a965-c7f31fa28228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:11:13.456924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4e894e66-f067-4a0c-a965-c7f31fa28228 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:11:13.456924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:13.456924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:13.456924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:13.456924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:13.456924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:13.456924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:13.456924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:13.456924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:13.456924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:13.456924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:13.456924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:13.456924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:11:13.456924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:11:13.456924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:11:13.456924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:11:13.458084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:11:13.458084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:11:13.458084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:11:13.458084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:11:13.458084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:13.458084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:13.458084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:13.458084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:13.458084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:13.458084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:13.458084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:13.458084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:13.458084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:13.458084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:13.458084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:13.458084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:13.459308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:13.459308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:13.459308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:13.459308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:13.459308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:11:13.459308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:11:13.459308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:11:13.459308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:11:13.459308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:11:13.459308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:11:13.459308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:11:13.459308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:13.459308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 541/1089] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:11:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:11:13.464060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8adc0e-35e2-48c2-9cef-afa48edaf095 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:13.536597 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e894e66-f067-4a0c-a965-c7f31fa28228 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:13.541837 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:13.569248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8adc0e-35e2-48c2-9cef-afa48edaf095 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:13.604700 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb56ba-15e5-4a83-9bf7-97843ca9b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:13.605304 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb56ba-15e5-4a83-9bf7-97843ca9b6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:13.605586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb56ba-15e5-4a83-9bf7-97843ca9b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:13.605892 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb56ba-15e5-4a83-9bf7-97843ca9b6f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:13.606563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb56ba-15e5-4a83-9bf7-97843ca9b6f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:13.606865 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb56ba-15e5-4a83-9bf7-97843ca9b6f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:13.608248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb56ba-15e5-4a83-9bf7-97843ca9b6f9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:13.617225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 549/1090] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:11:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:13.623339 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb56ba-15e5-4a83-9bf7-97843ca9b6f9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:13.641816 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e894e66-f067-4a0c-a965-c7f31fa28228 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:13.676344 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc1d66-f3d3-4333-a773-3a4171d4286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:13.676994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc1d66-f3d3-4333-a773-3a4171d4286e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:13.677268 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc1d66-f3d3-4333-a773-3a4171d4286e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:13.677541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc1d66-f3d3-4333-a773-3a4171d4286e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:13.681417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:13.688519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc1d66-f3d3-4333-a773-3a4171d4286e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:11:13.693371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-d5cc1d66-f3d3-4333-a773-3a4171d4286e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 15:11:13.693371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:13.693371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:13.693371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:13.693371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:13.693371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:13.693371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:13.693371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:13.693371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:13.693371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:13.693371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:13.693371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:13.693371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:11:13.693371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:11:13.693371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:11:13.693371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:11:13.694555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:11:13.694555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:11:13.694555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:11:13.694555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:11:13.694555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:13.694555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:13.694555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:13.694555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:13.694555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:13.694555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:13.694555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:13.694555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:13.694555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:13.694555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:13.694555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:13.694555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:13.695592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:13.695592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:13.695592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:13.695592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:13.695592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:11:13.695592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:11:13.695592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:11:13.695592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:11:13.695592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:11:13.695592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:11:13.695592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 15:11:13.695592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:13.695592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 542/1091] 10.222.0.82 () {56 vars in 1120 bytes} [Fri Sep 23 15:11:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:11:13.700484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc1d66-f3d3-4333-a773-3a4171d4286e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:13.727313 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb56ba-15e5-4a83-9bf7-97843ca9b6f9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:13.760600 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f3e31-4283-4f3d-9493-4a28b3de2540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:13.761233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3e31-4283-4f3d-9493-4a28b3de2540 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:13.761507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3e31-4283-4f3d-9493-4a28b3de2540 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:13.761803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3e31-4283-4f3d-9493-4a28b3de2540 None admin] PATH_INFO: `/v3/users/bbd4ed19de834d0db8898321fec4d029` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:13.762922 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f3e31-4283-4f3d-9493-4a28b3de2540 None admin] RBAC: Authorizing `identity:get_user(user_id=bbd4ed19de834d0db8898321fec4d029)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:13.763263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:13.764367 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f3e31-4283-4f3d-9493-4a28b3de2540 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:13.765979 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 550/1092] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:11:13 2022] GET /identity/v3/users/bbd4ed19de834d0db8898321fec4d029 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:13.771745 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f3e31-4283-4f3d-9493-4a28b3de2540 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:13.803540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc1d66-f3d3-4333-a773-3a4171d4286e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:13.838629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660da1d-32da-4f3e-9c3d-ed9f55896de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:13.839238 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660da1d-32da-4f3e-9c3d-ed9f55896de4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:13.839519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660da1d-32da-4f3e-9c3d-ed9f55896de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:13.839794 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660da1d-32da-4f3e-9c3d-ed9f55896de4 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:13.840451 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660da1d-32da-4f3e-9c3d-ed9f55896de4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:13.840759 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660da1d-32da-4f3e-9c3d-ed9f55896de4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:13.842379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660da1d-32da-4f3e-9c3d-ed9f55896de4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:13.851019 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 543/1093] 10.222.0.82 () {56 vars in 1115 bytes} [Fri Sep 23 15:11:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:13.856788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660da1d-32da-4f3e-9c3d-ed9f55896de4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:13.873030 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f3e31-4283-4f3d-9493-4a28b3de2540 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:13.895690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:13.906676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bcedf-e124-4d54-b58e-fc1bbe5e286d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:13.907361 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bcedf-e124-4d54-b58e-fc1bbe5e286d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:13.907646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bcedf-e124-4d54-b58e-fc1bbe5e286d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:13.910183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bcedf-e124-4d54-b58e-fc1bbe5e286d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:13.956004 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660da1d-32da-4f3e-9c3d-ed9f55896de4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:13.978510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bcedf-e124-4d54-b58e-fc1bbe5e286d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:13.979983 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bcedf-e124-4d54-b58e-fc1bbe5e286d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:13.981982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:13.992649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15012f7-a17d-4684-bf14-09e2ce9ac1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:13.993274 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15012f7-a17d-4684-bf14-09e2ce9ac1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:13.993555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15012f7-a17d-4684-bf14-09e2ce9ac1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:13.993846 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15012f7-a17d-4684-bf14-09e2ce9ac1e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:14.004605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15012f7-a17d-4684-bf14-09e2ce9ac1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:14.006088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15012f7-a17d-4684-bf14-09e2ce9ac1e6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:14.020701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e15012f7-a17d-4684-bf14-09e2ce9ac1e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:11:14.020701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:14.020701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:14.020701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:14.020701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:14.020701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:14.020701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:14.020701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:14.020701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:14.020701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:14.020701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:14.020701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:14.020701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:11:14.020701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:11:14.020701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:11:14.020701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:14.021723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:11:14.023343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:11:14.023343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:11:14.023343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:14.023343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 544/1094] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:11:14.028438 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15012f7-a17d-4684-bf14-09e2ce9ac1e6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:14.083861 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 551/1095] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:11:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 23 15:11:14.090510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bcedf-e124-4d54-b58e-fc1bbe5e286d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:14.115087 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:14.134331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15012f7-a17d-4684-bf14-09e2ce9ac1e6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:14.169489 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7b824-3174-4c3e-bbe1-07570375fd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:14.170127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7b824-3174-4c3e-bbe1-07570375fd4a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:14.170409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7b824-3174-4c3e-bbe1-07570375fd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:14.170684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7b824-3174-4c3e-bbe1-07570375fd4a None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:14.171335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7b824-3174-4c3e-bbe1-07570375fd4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:14.171639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7b824-3174-4c3e-bbe1-07570375fd4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:14.173011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7b824-3174-4c3e-bbe1-07570375fd4a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:14.184882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 545/1096] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:14.188747 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bcedf-e124-4d54-b58e-fc1bbe5e286d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:14.190510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7b824-3174-4c3e-bbe1-07570375fd4a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:14.224618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:14.225504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb631c-7030-4889-9436-03298471b34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:14.226705 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb631c-7030-4889-9436-03298471b34f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:14.226980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb631c-7030-4889-9436-03298471b34f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:14.227250 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb631c-7030-4889-9436-03298471b34f None admin] PATH_INFO: `/v3/projects/7a7f82b1b0ec4272bd372eb5c78f16e1` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:14.228372 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb631c-7030-4889-9436-03298471b34f None admin] RBAC: Authorizing `identity:get_project(project_id=7a7f82b1b0ec4272bd372eb5c78f16e1)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:14.229837 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb631c-7030-4889-9436-03298471b34f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:14.231479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 552/1097] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:11:14 2022] GET /identity/v3/projects/7a7f82b1b0ec4272bd372eb5c78f16e1 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:14.237916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb631c-7030-4889-9436-03298471b34f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:14.293438 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7b824-3174-4c3e-bbe1-07570375fd4a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:14.327567 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07146f35-3a60-4024-9920-2341320e82b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:14.328203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07146f35-3a60-4024-9920-2341320e82b2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:14.328487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07146f35-3a60-4024-9920-2341320e82b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:14.328804 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07146f35-3a60-4024-9920-2341320e82b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:14.331907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:14.336721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07146f35-3a60-4024-9920-2341320e82b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:14.338188 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07146f35-3a60-4024-9920-2341320e82b2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:14.341273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb631c-7030-4889-9436-03298471b34f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:14.350012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-07146f35-3a60-4024-9920-2341320e82b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:11:14.350012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:14.350012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:14.350012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:14.350012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:14.350012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:14.350012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:14.350012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:14.350012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:14.350012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:14.350012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:14.350012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:14.350012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:11:14.350012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:11:14.350012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:11:14.350012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:14.351900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:14.352878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:14.352878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:14.352878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:11:14.352878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:11:14.352878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:11:14.352878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:11:14.352878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:11:14.352878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:11:14.352878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 15:11:14.352878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:14.352878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 546/1098] 10.222.0.82 () {56 vars in 1093 bytes} [Fri Sep 23 15:11:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:11:14.357713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07146f35-3a60-4024-9920-2341320e82b2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:14.376414 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3d1bb-725f-420f-802b-e88ba51b2dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:14.377015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3d1bb-725f-420f-802b-e88ba51b2dac None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:14.377291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3d1bb-725f-420f-802b-e88ba51b2dac None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:14.377560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3d1bb-725f-420f-802b-e88ba51b2dac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:14.378472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3d1bb-725f-420f-802b-e88ba51b2dac None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=7a7f82b1b0ec4272bd372eb5c78f16e1, user.id=bbd4ed19de834d0db8898321fec4d029) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:14.378985 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3d1bb-725f-420f-802b-e88ba51b2dac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:14.389026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3d1bb-725f-420f-802b-e88ba51b2dac None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:14.389026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 553/1099] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:11:14 2022] GET /identity/v3/role_assignments?user.id=bbd4ed19de834d0db8898321fec4d029&scope.project.id=7a7f82b1b0ec4272bd372eb5c78f16e1&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:14.463102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:14.469272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07146f35-3a60-4024-9920-2341320e82b2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:14.511529 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ff770-781a-4b78-9045-c0aefc7c6098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:14.512150 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ff770-781a-4b78-9045-c0aefc7c6098 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:14.512430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ff770-781a-4b78-9045-c0aefc7c6098 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:14.512700 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ff770-781a-4b78-9045-c0aefc7c6098 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:14.513444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ff770-781a-4b78-9045-c0aefc7c6098 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:14.513775 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ff770-781a-4b78-9045-c0aefc7c6098 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:14.515223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ff770-781a-4b78-9045-c0aefc7c6098 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:14.535373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 547/1100] 10.222.0.82 () {56 vars in 1133 bytes} [Fri Sep 23 15:11:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:14.541977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3d1bb-725f-420f-802b-e88ba51b2dac None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:14.649061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3d1bb-725f-420f-802b-e88ba51b2dac None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:14.683520 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fbf10-6b8a-48ac-b3cc-78409aae3cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:14.684125 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fbf10-6b8a-48ac-b3cc-78409aae3cea None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:14.684402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fbf10-6b8a-48ac-b3cc-78409aae3cea None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:14.684672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fbf10-6b8a-48ac-b3cc-78409aae3cea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:14.710990 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:14.755789 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fbf10-6b8a-48ac-b3cc-78409aae3cea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:14.758007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fbf10-6b8a-48ac-b3cc-78409aae3cea None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:14.862742 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 554/1101] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:11:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:14.869539 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ff770-781a-4b78-9045-c0aefc7c6098 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:14.973008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ff770-781a-4b78-9045-c0aefc7c6098 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:15.007894 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6924b1-1898-4233-a253-97f7c289c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:15.008518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6924b1-1898-4233-a253-97f7c289c5ac None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:15.008794 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6924b1-1898-4233-a253-97f7c289c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:15.009065 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6924b1-1898-4233-a253-97f7c289c5ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:15.019483 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6924b1-1898-4233-a253-97f7c289c5ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:15.020922 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6924b1-1898-4233-a253-97f7c289c5ac None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:15.035439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4f6924b1-1898-4233-a253-97f7c289c5ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:11:15.035439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:15.035439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:15.035439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:15.035439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:15.035439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:15.035439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:15.035439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:15.035439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:15.035439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:15.035439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:15.035439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:15.035439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:11:15.035439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:11:15.035439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:11:15.035439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:15.036418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:11:15.037337 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:11:15.037337 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:11:15.037337 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:15.037337 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 548/1102] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:11:15.042888 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fbf10-6b8a-48ac-b3cc-78409aae3cea None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:15.100082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:15.145110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fbf10-6b8a-48ac-b3cc-78409aae3cea None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:15.180879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46e9d9-7e03-4225-928b-be694ac7d321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:15.181485 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46e9d9-7e03-4225-928b-be694ac7d321 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:15.181794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46e9d9-7e03-4225-928b-be694ac7d321 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:15.182071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46e9d9-7e03-4225-928b-be694ac7d321 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:15.182712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46e9d9-7e03-4225-928b-be694ac7d321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:15.183014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46e9d9-7e03-4225-928b-be694ac7d321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:15.184490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46e9d9-7e03-4225-928b-be694ac7d321 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:15.195957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 555/1103] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:15.201717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6924b1-1898-4233-a253-97f7c289c5ac None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:15.211417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:15.302193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6924b1-1898-4233-a253-97f7c289c5ac None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:15.338008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a7088-27cd-47b4-bcb8-eb1fc216d48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:15.338657 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a7088-27cd-47b4-bcb8-eb1fc216d48f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:15.338933 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a7088-27cd-47b4-bcb8-eb1fc216d48f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:15.339208 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a7088-27cd-47b4-bcb8-eb1fc216d48f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:15.346284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a7088-27cd-47b4-bcb8-eb1fc216d48f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:15.347727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a7088-27cd-47b4-bcb8-eb1fc216d48f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:15.360741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-389a7088-27cd-47b4-bcb8-eb1fc216d48f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:11:15.360741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:15.360741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:15.360741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:15.360741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:15.360741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:15.360741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:15.360741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:15.360741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:15.360741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:15.360741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:15.360741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:15.360741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:11:15.360741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:11:15.360741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:15.361801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:15.362727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:11:15.362727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:11:15.362727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:11:15.362727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:11:15.362727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:11:15.362727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:11:15.362727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:11:15.362727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:15.365895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 549/1104] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:11:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:11:15.368318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46e9d9-7e03-4225-928b-be694ac7d321 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:15.478150 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46e9d9-7e03-4225-928b-be694ac7d321 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:15.497464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:15.516651 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3bbea-e168-44a3-8e5c-8b98da6054bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:15.517254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3bbea-e168-44a3-8e5c-8b98da6054bd None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:15.517531 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3bbea-e168-44a3-8e5c-8b98da6054bd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:15.517829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3bbea-e168-44a3-8e5c-8b98da6054bd None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:15.518520 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3bbea-e168-44a3-8e5c-8b98da6054bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:15.518826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3bbea-e168-44a3-8e5c-8b98da6054bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:15.520265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3bbea-e168-44a3-8e5c-8b98da6054bd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:15.533806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 556/1105] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:11:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:15.540998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a7088-27cd-47b4-bcb8-eb1fc216d48f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:15.606676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:15.640971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a7088-27cd-47b4-bcb8-eb1fc216d48f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:15.675885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01358e95-b204-480a-85ed-71685f86ce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:15.676483 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01358e95-b204-480a-85ed-71685f86ce60 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:15.676761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01358e95-b204-480a-85ed-71685f86ce60 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:15.677029 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01358e95-b204-480a-85ed-71685f86ce60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:15.677767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01358e95-b204-480a-85ed-71685f86ce60 None admin] RBAC: Adding query filter params (role.id=761366d21b194095aa29578e791fe568, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=6dbf682960cc447099c11862afa3206b) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:15.678077 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01358e95-b204-480a-85ed-71685f86ce60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:15.679546 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01358e95-b204-480a-85ed-71685f86ce60 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:15.685395 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 550/1106] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:11:15 2022] GET /identity/v3/role_assignments?user.id=6dbf682960cc447099c11862afa3206b&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=761366d21b194095aa29578e791fe568 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:16.631512 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47731b-ac7f-4056-a716-e287e41d2221 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:16.632079 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47731b-ac7f-4056-a716-e287e41d2221 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:16.632079 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47731b-ac7f-4056-a716-e287e41d2221 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:16.633421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 557/1107] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:16.638871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d3269-dc27-42e3-9713-f9e1e86e40f9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:16.639307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d3269-dc27-42e3-9713-f9e1e86e40f9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:16.639422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d3269-dc27-42e3-9713-f9e1e86e40f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:16.657652 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-492d3269-dc27-42e3-9713-f9e1e86e40f9 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:16.658922 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-492d3269-dc27-42e3-9713-f9e1e86e40f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:16.725055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 551/1108] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:11:16.997152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47731b-ac7f-4056-a716-e287e41d2221 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:17.098508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47731b-ac7f-4056-a716-e287e41d2221 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:17.132325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fc934-04ca-4bb4-b7e1-39bc569babbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:17.132945 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fc934-04ca-4bb4-b7e1-39bc569babbb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:17.133222 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fc934-04ca-4bb4-b7e1-39bc569babbb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:17.133493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fc934-04ca-4bb4-b7e1-39bc569babbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:17.134652 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fc934-04ca-4bb4-b7e1-39bc569babbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:17.136092 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fc934-04ca-4bb4-b7e1-39bc569babbb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:17.137692 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 558/1109] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:11:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:17.150713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d3269-dc27-42e3-9713-f9e1e86e40f9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:17.207624 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:17.247418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d3269-dc27-42e3-9713-f9e1e86e40f9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:17.280030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ee0c9-f23d-4034-9c1d-075337aae265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:17.280630 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ee0c9-f23d-4034-9c1d-075337aae265 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:17.280909 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ee0c9-f23d-4034-9c1d-075337aae265 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:17.281208 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ee0c9-f23d-4034-9c1d-075337aae265 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:17.281883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ee0c9-f23d-4034-9c1d-075337aae265 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:17.283307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ee0c9-f23d-4034-9c1d-075337aae265 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:17.379077 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 552/1110] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:11:17 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:11:19.579540 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf76582-ce24-47a7-b34f-e5b4b732ddbb None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:19.580140 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf76582-ce24-47a7-b34f-e5b4b732ddbb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:19.580140 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf76582-ce24-47a7-b34f-e5b4b732ddbb None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:19.581528 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 559/1111] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:19.588146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b88d1-7fb6-4f9c-b4ac-4a5cace97137 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:19.588682 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b88d1-7fb6-4f9c-b4ac-4a5cace97137 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:19.588682 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b88d1-7fb6-4f9c-b4ac-4a5cace97137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:19.608717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-160b88d1-7fb6-4f9c-b4ac-4a5cace97137 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:19.609975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-160b88d1-7fb6-4f9c-b4ac-4a5cace97137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:19.679833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 553/1112] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:19.948120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf76582-ce24-47a7-b34f-e5b4b732ddbb None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:19.995733 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:20.050130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf76582-ce24-47a7-b34f-e5b4b732ddbb None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:20.089917 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf55f2-da03-4077-8dfa-8aa8bc3dd238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:20.090581 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf55f2-da03-4077-8dfa-8aa8bc3dd238 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:20.090910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf55f2-da03-4077-8dfa-8aa8bc3dd238 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:20.091191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf55f2-da03-4077-8dfa-8aa8bc3dd238 None admin] PATH_INFO: `/v3/roles/acaa0e7c8246470aa47504d9bc3ae56f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:20.092866 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf55f2-da03-4077-8dfa-8aa8bc3dd238 None admin] RBAC: Authorizing `identity:get_role(role_id=acaa0e7c8246470aa47504d9bc3ae56f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:20.094340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf55f2-da03-4077-8dfa-8aa8bc3dd238 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:20.095868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 560/1113] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:11:19 2022] GET /identity/v3/roles/acaa0e7c8246470aa47504d9bc3ae56f => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:20.102037 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b88d1-7fb6-4f9c-b4ac-4a5cace97137 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:20.152696 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:20.209356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b88d1-7fb6-4f9c-b4ac-4a5cace97137 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:20.245313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e046a-a7c0-4f0c-9c3e-5bf6627c03da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:20.245982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e046a-a7c0-4f0c-9c3e-5bf6627c03da None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:20.246257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e046a-a7c0-4f0c-9c3e-5bf6627c03da None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:20.246618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e046a-a7c0-4f0c-9c3e-5bf6627c03da None admin] PATH_INFO: `/v3/users/64286d53d2f04295a8d24037e8dc4d1d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:20.262275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e046a-a7c0-4f0c-9c3e-5bf6627c03da None admin] RBAC: Authorizing `identity:get_user(user_id=64286d53d2f04295a8d24037e8dc4d1d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:20.263728 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e046a-a7c0-4f0c-9c3e-5bf6627c03da None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:20.265409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 554/1114] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:11:20 2022] GET /identity/v3/users/64286d53d2f04295a8d24037e8dc4d1d => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:20.271392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf55f2-da03-4077-8dfa-8aa8bc3dd238 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:20.379569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf55f2-da03-4077-8dfa-8aa8bc3dd238 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:20.394213 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:20.416419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8531497-fa49-4b8e-9143-3794f25ea777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:20.417037 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8531497-fa49-4b8e-9143-3794f25ea777 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:20.417316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8531497-fa49-4b8e-9143-3794f25ea777 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:20.417587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8531497-fa49-4b8e-9143-3794f25ea777 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:20.489661 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8531497-fa49-4b8e-9143-3794f25ea777 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:20.491627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8531497-fa49-4b8e-9143-3794f25ea777 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:20.593626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 561/1115] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:11:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:20.599776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e046a-a7c0-4f0c-9c3e-5bf6627c03da None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:20.703505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e046a-a7c0-4f0c-9c3e-5bf6627c03da None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:20.705903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:20.738860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dbcdc-811c-4254-a14d-52819e7f05ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:20.739496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dbcdc-811c-4254-a14d-52819e7f05ba None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:20.739825 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dbcdc-811c-4254-a14d-52819e7f05ba None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:20.740048 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dbcdc-811c-4254-a14d-52819e7f05ba None admin] PATH_INFO: `/v3/projects/7a7f82b1b0ec4272bd372eb5c78f16e1` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:20.741217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9dbcdc-811c-4254-a14d-52819e7f05ba None admin] RBAC: Authorizing `identity:get_project(project_id=7a7f82b1b0ec4272bd372eb5c78f16e1)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:20.742725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9dbcdc-811c-4254-a14d-52819e7f05ba None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:20.744382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 555/1116] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:11:20 2022] GET /identity/v3/projects/7a7f82b1b0ec4272bd372eb5c78f16e1 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:20.750738 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8531497-fa49-4b8e-9143-3794f25ea777 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:20.765105 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:20.859456 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8531497-fa49-4b8e-9143-3794f25ea777 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:20.897713 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7473ea-854f-40ce-a62a-ccbc4b56501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:20.898362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7473ea-854f-40ce-a62a-ccbc4b56501b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:20.898645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7473ea-854f-40ce-a62a-ccbc4b56501b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:20.898918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7473ea-854f-40ce-a62a-ccbc4b56501b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:20.899669 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7473ea-854f-40ce-a62a-ccbc4b56501b None admin] RBAC: Adding query filter params (role.id=acaa0e7c8246470aa47504d9bc3ae56f, scope.project.id=7a7f82b1b0ec4272bd372eb5c78f16e1, user.id=64286d53d2f04295a8d24037e8dc4d1d) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:20.900004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7473ea-854f-40ce-a62a-ccbc4b56501b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:20.901487 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7473ea-854f-40ce-a62a-ccbc4b56501b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:20.907546 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 562/1117] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:11:20 2022] GET /identity/v3/role_assignments?user.id=64286d53d2f04295a8d24037e8dc4d1d&scope.project.id=7a7f82b1b0ec4272bd372eb5c78f16e1&role.id=acaa0e7c8246470aa47504d9bc3ae56f => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:23.077518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159a8eb-757b-4d72-943a-05178b2fdf8e None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:23.078077 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159a8eb-757b-4d72-943a-05178b2fdf8e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:23.078077 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159a8eb-757b-4d72-943a-05178b2fdf8e None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:23.079524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 556/1118] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:23.085052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b098e41-2ac6-45fc-9750-691a3ba5a2dd None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:23.085496 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b098e41-2ac6-45fc-9750-691a3ba5a2dd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:23.085629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b098e41-2ac6-45fc-9750-691a3ba5a2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:23.105465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9b098e41-2ac6-45fc-9750-691a3ba5a2dd None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:23.106715 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9b098e41-2ac6-45fc-9750-691a3ba5a2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:23.183574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 563/1119] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:23.465527 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159a8eb-757b-4d72-943a-05178b2fdf8e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:23.568432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159a8eb-757b-4d72-943a-05178b2fdf8e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:23.605444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b59bfc-f8b0-43ea-8c9b-07931c6da0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:23.606094 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b59bfc-f8b0-43ea-8c9b-07931c6da0ec None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:23.606382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b59bfc-f8b0-43ea-8c9b-07931c6da0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:23.606653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b59bfc-f8b0-43ea-8c9b-07931c6da0ec None admin] PATH_INFO: `/v3/roles/acaa0e7c8246470aa47504d9bc3ae56f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:23.608032 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b59bfc-f8b0-43ea-8c9b-07931c6da0ec None admin] RBAC: Authorizing `identity:get_role(role_id=acaa0e7c8246470aa47504d9bc3ae56f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:23.609394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b59bfc-f8b0-43ea-8c9b-07931c6da0ec None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:23.610743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 557/1120] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:11:23 2022] GET /identity/v3/roles/acaa0e7c8246470aa47504d9bc3ae56f => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:23.620400 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b098e41-2ac6-45fc-9750-691a3ba5a2dd None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:23.629091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:23.722209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b098e41-2ac6-45fc-9750-691a3ba5a2dd None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:23.756260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54c3f0-7a0d-4bf2-932b-b2ab8d6b5811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:23.756914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54c3f0-7a0d-4bf2-932b-b2ab8d6b5811 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:23.757191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54c3f0-7a0d-4bf2-932b-b2ab8d6b5811 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:23.757462 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54c3f0-7a0d-4bf2-932b-b2ab8d6b5811 None admin] PATH_INFO: `/v3/users/64286d53d2f04295a8d24037e8dc4d1d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:23.758600 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54c3f0-7a0d-4bf2-932b-b2ab8d6b5811 None admin] RBAC: Authorizing `identity:get_user(user_id=64286d53d2f04295a8d24037e8dc4d1d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:23.760041 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54c3f0-7a0d-4bf2-932b-b2ab8d6b5811 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:23.761615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 564/1121] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:11:23 2022] GET /identity/v3/users/64286d53d2f04295a8d24037e8dc4d1d => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:23.767482 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b59bfc-f8b0-43ea-8c9b-07931c6da0ec None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:23.809129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:23.864593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b59bfc-f8b0-43ea-8c9b-07931c6da0ec None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:23.898046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16379e1d-a6fc-4306-96bd-cbb7ffa28282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:23.898672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16379e1d-a6fc-4306-96bd-cbb7ffa28282 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:23.898951 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16379e1d-a6fc-4306-96bd-cbb7ffa28282 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:23.899220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16379e1d-a6fc-4306-96bd-cbb7ffa28282 None admin] PATH_INFO: `/v3/projects/7a7f82b1b0ec4272bd372eb5c78f16e1` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:23.900317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16379e1d-a6fc-4306-96bd-cbb7ffa28282 None admin] RBAC: Authorizing `identity:get_project(project_id=7a7f82b1b0ec4272bd372eb5c78f16e1)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:23.901753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16379e1d-a6fc-4306-96bd-cbb7ffa28282 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:23.903370 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 558/1122] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:11:23 2022] GET /identity/v3/projects/7a7f82b1b0ec4272bd372eb5c78f16e1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:23.909437 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54c3f0-7a0d-4bf2-932b-b2ab8d6b5811 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:23.986628 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:24.010331 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54c3f0-7a0d-4bf2-932b-b2ab8d6b5811 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:24.049164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec46f27-33c7-4bed-ad0e-993dd941aac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:24.049852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec46f27-33c7-4bed-ad0e-993dd941aac3 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:24.050133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec46f27-33c7-4bed-ad0e-993dd941aac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:24.050410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec46f27-33c7-4bed-ad0e-993dd941aac3 None admin] PATH_INFO: `/v3/projects/7a7f82b1b0ec4272bd372eb5c78f16e1/users/64286d53d2f04295a8d24037e8dc4d1d/roles/acaa0e7c8246470aa47504d9bc3ae56f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:24.052534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec46f27-33c7-4bed-ad0e-993dd941aac3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a7f82b1b0ec4272bd372eb5c78f16e1, user_id=64286d53d2f04295a8d24037e8dc4d1d, role_id=acaa0e7c8246470aa47504d9bc3ae56f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:24.054007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec46f27-33c7-4bed-ad0e-993dd941aac3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:24.191517 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 565/1123] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:11:23 2022] PUT /identity/v3/projects/7a7f82b1b0ec4272bd372eb5c78f16e1/users/64286d53d2f04295a8d24037e8dc4d1d/roles/acaa0e7c8246470aa47504d9bc3ae56f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:11:26.379035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a6f44-b330-4362-9333-eccfff250671 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:26.379545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a6f44-b330-4362-9333-eccfff250671 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:26.379545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a6f44-b330-4362-9333-eccfff250671 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:26.380815 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 559/1124] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:26.386642 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1d7fc-5769-410c-b9b0-b580236bc278 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:26.387073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1d7fc-5769-410c-b9b0-b580236bc278 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:26.387230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1d7fc-5769-410c-b9b0-b580236bc278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:26.405856 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b9c1d7fc-5769-410c-b9b0-b580236bc278 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:26.407167 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b9c1d7fc-5769-410c-b9b0-b580236bc278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:26.474277 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 566/1125] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:26.746619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a6f44-b330-4362-9333-eccfff250671 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:26.848808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a6f44-b330-4362-9333-eccfff250671 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:26.858577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:26.882959 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320778f-1d71-4f6c-84e7-e8f5173778e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:26.883585 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320778f-1d71-4f6c-84e7-e8f5173778e0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:26.883864 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320778f-1d71-4f6c-84e7-e8f5173778e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:26.884133 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320778f-1d71-4f6c-84e7-e8f5173778e0 None admin] PATH_INFO: `/v3/roles/acaa0e7c8246470aa47504d9bc3ae56f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:26.885555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320778f-1d71-4f6c-84e7-e8f5173778e0 None admin] RBAC: Authorizing `identity:get_role(role_id=acaa0e7c8246470aa47504d9bc3ae56f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:26.886977 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320778f-1d71-4f6c-84e7-e8f5173778e0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:26.888298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 560/1126] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:11:26 2022] GET /identity/v3/roles/acaa0e7c8246470aa47504d9bc3ae56f => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:26.894311 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1d7fc-5769-410c-b9b0-b580236bc278 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:26.954568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:26.997374 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1d7fc-5769-410c-b9b0-b580236bc278 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:27.041097 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e29b5-5383-4844-9021-185872b3e307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:27.041772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e29b5-5383-4844-9021-185872b3e307 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:27.042349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e29b5-5383-4844-9021-185872b3e307 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:27.042877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e29b5-5383-4844-9021-185872b3e307 None admin] PATH_INFO: `/v3/users/64286d53d2f04295a8d24037e8dc4d1d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:27.044595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e29b5-5383-4844-9021-185872b3e307 None admin] RBAC: Authorizing `identity:get_user(user_id=64286d53d2f04295a8d24037e8dc4d1d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:27.046088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e29b5-5383-4844-9021-185872b3e307 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:27.047735 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 567/1127] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:11:26 2022] GET /identity/v3/users/64286d53d2f04295a8d24037e8dc4d1d => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:27.054921 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320778f-1d71-4f6c-84e7-e8f5173778e0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:27.157837 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320778f-1d71-4f6c-84e7-e8f5173778e0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:27.191610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642844a-e9ad-49b7-a79a-7613009ee605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:27.192209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642844a-e9ad-49b7-a79a-7613009ee605 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:27.192487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642844a-e9ad-49b7-a79a-7613009ee605 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:27.192756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642844a-e9ad-49b7-a79a-7613009ee605 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:27.236874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:27.259064 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642844a-e9ad-49b7-a79a-7613009ee605 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:27.260432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642844a-e9ad-49b7-a79a-7613009ee605 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:27.364954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 561/1128] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:11:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:27.371466 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e29b5-5383-4844-9021-185872b3e307 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:27.474326 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e29b5-5383-4844-9021-185872b3e307 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:27.507149 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:27.512229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c6fa2-70f8-46b4-a691-47e7362d9abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:27.512803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c6fa2-70f8-46b4-a691-47e7362d9abe None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:27.513078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c6fa2-70f8-46b4-a691-47e7362d9abe None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:27.513346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c6fa2-70f8-46b4-a691-47e7362d9abe None admin] PATH_INFO: `/v3/projects/7a7f82b1b0ec4272bd372eb5c78f16e1` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:27.514474 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c6fa2-70f8-46b4-a691-47e7362d9abe None admin] RBAC: Authorizing `identity:get_project(project_id=7a7f82b1b0ec4272bd372eb5c78f16e1)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:27.515904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c6fa2-70f8-46b4-a691-47e7362d9abe None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:27.517538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 568/1129] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:11:27 2022] GET /identity/v3/projects/7a7f82b1b0ec4272bd372eb5c78f16e1 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:27.524519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642844a-e9ad-49b7-a79a-7613009ee605 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:27.611219 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:27.634353 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642844a-e9ad-49b7-a79a-7613009ee605 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:27.670968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ee7ca-c22f-4ace-abe0-3588f5af320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:27.671578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ee7ca-c22f-4ace-abe0-3588f5af320b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:27.671855 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ee7ca-c22f-4ace-abe0-3588f5af320b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:27.672123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ee7ca-c22f-4ace-abe0-3588f5af320b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:27.672846 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ee7ca-c22f-4ace-abe0-3588f5af320b None admin] RBAC: Adding query filter params (role.id=acaa0e7c8246470aa47504d9bc3ae56f, scope.project.id=7a7f82b1b0ec4272bd372eb5c78f16e1, user.id=64286d53d2f04295a8d24037e8dc4d1d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:27.673150 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ee7ca-c22f-4ace-abe0-3588f5af320b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:27.674605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ee7ca-c22f-4ace-abe0-3588f5af320b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:27.681613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 562/1130] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:11:27 2022] GET /identity/v3/role_assignments?user.id=64286d53d2f04295a8d24037e8dc4d1d&scope.project.id=7a7f82b1b0ec4272bd372eb5c78f16e1&role.id=acaa0e7c8246470aa47504d9bc3ae56f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:29.891481 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c004267-c81e-4540-a7d6-24d85d594a37 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:29.892057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c004267-c81e-4540-a7d6-24d85d594a37 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:29.892057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c004267-c81e-4540-a7d6-24d85d594a37 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:29.893373 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 569/1131] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:29.899118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1cb94-969e-4647-911e-63be74344498 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:29.899526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1cb94-969e-4647-911e-63be74344498 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:29.899642 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1cb94-969e-4647-911e-63be74344498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:29.917931 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-90c1cb94-969e-4647-911e-63be74344498 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:29.919102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-90c1cb94-969e-4647-911e-63be74344498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:29.984568 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 563/1132] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:30.252633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c004267-c81e-4540-a7d6-24d85d594a37 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:30.354768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c004267-c81e-4540-a7d6-24d85d594a37 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:30.388241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb84c1f-ea1a-4668-9236-dcfa0f9c058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:30.388863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb84c1f-ea1a-4668-9236-dcfa0f9c058f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:30.389143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb84c1f-ea1a-4668-9236-dcfa0f9c058f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:30.389410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb84c1f-ea1a-4668-9236-dcfa0f9c058f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:30.390545 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb84c1f-ea1a-4668-9236-dcfa0f9c058f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:30.391970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb84c1f-ea1a-4668-9236-dcfa0f9c058f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:30.393535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 570/1133] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:11:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:30.399590 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1cb94-969e-4647-911e-63be74344498 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:30.466939 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:30.496290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1cb94-969e-4647-911e-63be74344498 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:30.531751 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6742c-1370-4329-aa3b-dd388064c46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:30.532277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6742c-1370-4329-aa3b-dd388064c46c None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:30.532554 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6742c-1370-4329-aa3b-dd388064c46c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:30.532827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6742c-1370-4329-aa3b-dd388064c46c None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:30.533470 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6742c-1370-4329-aa3b-dd388064c46c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:30.534925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6742c-1370-4329-aa3b-dd388064c46c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:30.660968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 564/1134] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Sep 23 15:11:30 2022] POST /identity/v3/projects => generated 311 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:11:32.845845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af9577-ff23-4d78-b9dc-1174dc51a392 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:32.846421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af9577-ff23-4d78-b9dc-1174dc51a392 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:32.846527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af9577-ff23-4d78-b9dc-1174dc51a392 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:32.847795 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 571/1135] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:32.853144 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac337cee-e440-4821-b9d6-eca1902c03f1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:32.853533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac337cee-e440-4821-b9d6-eca1902c03f1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:32.853685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac337cee-e440-4821-b9d6-eca1902c03f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:32.871618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ac337cee-e440-4821-b9d6-eca1902c03f1 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:32.872806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ac337cee-e440-4821-b9d6-eca1902c03f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:32.938214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 565/1136] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:33.206977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af9577-ff23-4d78-b9dc-1174dc51a392 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:33.274266 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:33.308412 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af9577-ff23-4d78-b9dc-1174dc51a392 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:33.343239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d8360-eba3-4ec7-9390-cf45423ac460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:33.343860 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d8360-eba3-4ec7-9390-cf45423ac460 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:33.344133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d8360-eba3-4ec7-9390-cf45423ac460 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:33.344402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d8360-eba3-4ec7-9390-cf45423ac460 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:33.345515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d8360-eba3-4ec7-9390-cf45423ac460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:33.346974 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d8360-eba3-4ec7-9390-cf45423ac460 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:33.348547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 572/1137] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:11:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:33.354575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac337cee-e440-4821-b9d6-eca1902c03f1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:33.408781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:33.456807 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac337cee-e440-4821-b9d6-eca1902c03f1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:33.491174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b0f2a-a041-49b9-b34b-335b6a4cfc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:33.491691 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0f2a-a041-49b9-b34b-335b6a4cfc88 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:33.491966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0f2a-a041-49b9-b34b-335b6a4cfc88 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:33.492230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0f2a-a041-49b9-b34b-335b6a4cfc88 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:33.492880 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b0f2a-a041-49b9-b34b-335b6a4cfc88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:33.494376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b0f2a-a041-49b9-b34b-335b6a4cfc88 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:33.608408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 566/1138] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:11:33 2022] POST /identity/v3/users => generated 286 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:11:35.838465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb78c9f-08d6-4728-85b7-ca7f6ed89c82 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:35.839022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb78c9f-08d6-4728-85b7-ca7f6ed89c82 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:35.839022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb78c9f-08d6-4728-85b7-ca7f6ed89c82 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:35.840359 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 573/1139] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:35.845675 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdca8d-a778-42fd-8a74-5e982c2b1a56 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:35.846195 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdca8d-a778-42fd-8a74-5e982c2b1a56 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:35.846335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdca8d-a778-42fd-8a74-5e982c2b1a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:35.864307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-34cdca8d-a778-42fd-8a74-5e982c2b1a56 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:35.865874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-34cdca8d-a778-42fd-8a74-5e982c2b1a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:35.951175 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 567/1140] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:11:36.236008 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb78c9f-08d6-4728-85b7-ca7f6ed89c82 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:36.362812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb78c9f-08d6-4728-85b7-ca7f6ed89c82 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:36.399045 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f2302-352f-4a88-a153-4a92bc4e1241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:36.399675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2302-352f-4a88-a153-4a92bc4e1241 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:36.399949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2302-352f-4a88-a153-4a92bc4e1241 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:36.400218 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2302-352f-4a88-a153-4a92bc4e1241 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:36.402855 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:36.410785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f2302-352f-4a88-a153-4a92bc4e1241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:11:36.416026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-5d9f2302-352f-4a88-a153-4a92bc4e1241 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:11:36.416026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:36.416026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:36.416026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:36.416026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:36.416026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:36.416026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:36.416026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:36.416026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:36.416026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:36.416026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:36.416026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:36.416026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:11:36.416026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:11:36.416026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:11:36.416026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:11:36.417216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:11:36.417216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:11:36.417216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:11:36.417216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:11:36.417216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:36.417216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:36.417216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:36.417216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:36.417216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:36.417216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:36.417216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:36.417216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:36.417216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:36.417216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:36.417216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:36.417216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:36.418209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:36.418209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:36.418209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:36.418209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:36.418209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:11:36.418209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:11:36.418209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:11:36.418209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:11:36.418209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:11:36.418209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:11:36.418209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:11:36.418209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:11:36.418209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 574/1141] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:11:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:11:36.423844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdca8d-a778-42fd-8a74-5e982c2b1a56 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:36.514028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:36.585334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdca8d-a778-42fd-8a74-5e982c2b1a56 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:36.624237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2783da3-d77b-44be-9976-bbc9a1f36652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:36.624896 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2783da3-d77b-44be-9976-bbc9a1f36652 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:36.625172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2783da3-d77b-44be-9976-bbc9a1f36652 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:36.625476 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2783da3-d77b-44be-9976-bbc9a1f36652 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:36.626165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2783da3-d77b-44be-9976-bbc9a1f36652 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:36.626468 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2783da3-d77b-44be-9976-bbc9a1f36652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:36.627855 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2783da3-d77b-44be-9976-bbc9a1f36652 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:36.639916 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 568/1142] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:11:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:36.646372 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f2302-352f-4a88-a153-4a92bc4e1241 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:36.755877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f2302-352f-4a88-a153-4a92bc4e1241 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:36.791409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f341dbc-910d-4738-94f0-15aa8d3e5dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:36.791947 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f341dbc-910d-4738-94f0-15aa8d3e5dbb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:36.792223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f341dbc-910d-4738-94f0-15aa8d3e5dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:36.792494 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f341dbc-910d-4738-94f0-15aa8d3e5dbb None admin] PATH_INFO: `/v3/users/4d167f846ff04a558bbfb0392cb81efd` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:36.807033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f341dbc-910d-4738-94f0-15aa8d3e5dbb None admin] RBAC: Authorizing `identity:get_user(user_id=4d167f846ff04a558bbfb0392cb81efd)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:36.808493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f341dbc-910d-4738-94f0-15aa8d3e5dbb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:36.810220 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 575/1143] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:11:36 2022] GET /identity/v3/users/4d167f846ff04a558bbfb0392cb81efd => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:36.816882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2783da3-d77b-44be-9976-bbc9a1f36652 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:36.916127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:36.919211 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2783da3-d77b-44be-9976-bbc9a1f36652 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:36.953219 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a31904-90e2-4838-a250-f43cc36ac57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:36.953862 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a31904-90e2-4838-a250-f43cc36ac57f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:36.954145 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a31904-90e2-4838-a250-f43cc36ac57f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:36.954441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a31904-90e2-4838-a250-f43cc36ac57f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:37.023318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a31904-90e2-4838-a250-f43cc36ac57f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:37.024776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a31904-90e2-4838-a250-f43cc36ac57f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:37.118251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:37.121818 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 569/1144] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:11:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 23 15:11:37.127757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f341dbc-910d-4738-94f0-15aa8d3e5dbb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:37.185541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:37.231724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f341dbc-910d-4738-94f0-15aa8d3e5dbb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:37.273124 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e0e2d-7e27-48ca-9b69-dc80130b69ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:37.273775 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e0e2d-7e27-48ca-9b69-dc80130b69ef None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:37.274063 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e0e2d-7e27-48ca-9b69-dc80130b69ef None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:37.274337 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e0e2d-7e27-48ca-9b69-dc80130b69ef None admin] PATH_INFO: `/v3/projects/6fad4caf72c7423593f7f2c129d4b692` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:37.275456 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e0e2d-7e27-48ca-9b69-dc80130b69ef None admin] RBAC: Authorizing `identity:get_project(project_id=6fad4caf72c7423593f7f2c129d4b692)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:37.277095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e0e2d-7e27-48ca-9b69-dc80130b69ef None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:37.278771 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 576/1145] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:11:37 2022] GET /identity/v3/projects/6fad4caf72c7423593f7f2c129d4b692 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:37.285650 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a31904-90e2-4838-a250-f43cc36ac57f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:37.385174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a31904-90e2-4838-a250-f43cc36ac57f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:37.420014 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b82f26-63c9-4757-8ecd-245e60e1fe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:37.420614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b82f26-63c9-4757-8ecd-245e60e1fe80 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:37.420891 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b82f26-63c9-4757-8ecd-245e60e1fe80 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:37.421161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b82f26-63c9-4757-8ecd-245e60e1fe80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:37.421910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b82f26-63c9-4757-8ecd-245e60e1fe80 None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=6fad4caf72c7423593f7f2c129d4b692, user.id=4d167f846ff04a558bbfb0392cb81efd) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:37.422216 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b82f26-63c9-4757-8ecd-245e60e1fe80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:37.423631 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b82f26-63c9-4757-8ecd-245e60e1fe80 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:37.430030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 570/1146] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:11:37 2022] GET /identity/v3/role_assignments?user.id=4d167f846ff04a558bbfb0392cb81efd&scope.project.id=6fad4caf72c7423593f7f2c129d4b692&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:39.635573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3a32-22ce-440f-8ebc-57404a31e821 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:39.636151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3a32-22ce-440f-8ebc-57404a31e821 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:39.636151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3a32-22ce-440f-8ebc-57404a31e821 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:39.637460 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 577/1147] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:39.642848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22301117-5449-4157-8fcc-0eb5c132963f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:39.643267 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22301117-5449-4157-8fcc-0eb5c132963f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:39.643370 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22301117-5449-4157-8fcc-0eb5c132963f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:39.661313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-22301117-5449-4157-8fcc-0eb5c132963f None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:39.663123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-22301117-5449-4157-8fcc-0eb5c132963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:39.728273 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:39.736999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 571/1148] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:40.006891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f3a32-22ce-440f-8ebc-57404a31e821 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:40.126498 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f3a32-22ce-440f-8ebc-57404a31e821 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:40.150224 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:40.161402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29482db-35be-43ce-81fd-3f372110e0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:40.162075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29482db-35be-43ce-81fd-3f372110e0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:40.162415 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29482db-35be-43ce-81fd-3f372110e0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:40.163179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29482db-35be-43ce-81fd-3f372110e0f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:40.175048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29482db-35be-43ce-81fd-3f372110e0f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:11:40.179873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e29482db-35be-43ce-81fd-3f372110e0f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:11:40.179873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:40.179873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:40.179873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:40.179873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:40.179873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:40.179873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:40.179873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:40.179873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:40.179873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:40.179873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:40.179873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:40.179873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:11:40.179873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:11:40.179873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:11:40.179873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:11:40.181000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:11:40.181000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:11:40.181000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:11:40.181000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:11:40.181000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:40.181000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:40.181000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:40.181000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:40.181000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:40.181000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:40.181000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:40.181000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:40.181000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:40.181000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:40.181000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:40.181000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:40.182032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:40.182032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:40.182032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:40.182032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:40.182032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:11:40.182032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:11:40.182032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:11:40.182032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:11:40.182032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:11:40.182032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:11:40.182032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:11:40.182032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:11:40.182032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 578/1149] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:11:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:11:40.187142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22301117-5449-4157-8fcc-0eb5c132963f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:40.294007 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22301117-5449-4157-8fcc-0eb5c132963f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:40.327456 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca79cd-23ed-45fa-ae06-eeef35ff2550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:40.328144 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca79cd-23ed-45fa-ae06-eeef35ff2550 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:40.328420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca79cd-23ed-45fa-ae06-eeef35ff2550 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:40.328688 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca79cd-23ed-45fa-ae06-eeef35ff2550 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:40.329351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca79cd-23ed-45fa-ae06-eeef35ff2550 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:40.329650 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca79cd-23ed-45fa-ae06-eeef35ff2550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:40.331039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca79cd-23ed-45fa-ae06-eeef35ff2550 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:40.339734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 572/1150] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:11:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:40.345683 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29482db-35be-43ce-81fd-3f372110e0f5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:40.453504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29482db-35be-43ce-81fd-3f372110e0f5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:40.487919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6205b-fa41-4000-8711-8d54f22f1ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:40.488547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6205b-fa41-4000-8711-8d54f22f1ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:40.488827 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6205b-fa41-4000-8711-8d54f22f1ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:40.489102 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6205b-fa41-4000-8711-8d54f22f1ac5 None admin] PATH_INFO: `/v3/users/4d167f846ff04a558bbfb0392cb81efd` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:40.490254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6205b-fa41-4000-8711-8d54f22f1ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=4d167f846ff04a558bbfb0392cb81efd)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:40.491887 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6205b-fa41-4000-8711-8d54f22f1ac5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:40.493474 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 579/1151] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:11:40 2022] GET /identity/v3/users/4d167f846ff04a558bbfb0392cb81efd => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:40.499402 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca79cd-23ed-45fa-ae06-eeef35ff2550 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:40.555451 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:40.599989 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca79cd-23ed-45fa-ae06-eeef35ff2550 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:40.634856 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08341f1-f893-4bbd-b488-235088484958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:40.635477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08341f1-f893-4bbd-b488-235088484958 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:40.635750 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08341f1-f893-4bbd-b488-235088484958 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:40.636023 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08341f1-f893-4bbd-b488-235088484958 None admin] PATH_INFO: `/v3/projects/6fad4caf72c7423593f7f2c129d4b692` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:40.637211 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08341f1-f893-4bbd-b488-235088484958 None admin] RBAC: Authorizing `identity:get_project(project_id=6fad4caf72c7423593f7f2c129d4b692)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:40.638734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08341f1-f893-4bbd-b488-235088484958 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:40.640355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 573/1152] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:11:40 2022] GET /identity/v3/projects/6fad4caf72c7423593f7f2c129d4b692 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:40.646672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6205b-fa41-4000-8711-8d54f22f1ac5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:40.699900 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:40.754073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6205b-fa41-4000-8711-8d54f22f1ac5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:40.787845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a13624-23c3-4540-99bb-cb9370076199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:40.788488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13624-23c3-4540-99bb-cb9370076199 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:40.788761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13624-23c3-4540-99bb-cb9370076199 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:40.789029 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13624-23c3-4540-99bb-cb9370076199 None admin] PATH_INFO: `/v3/projects/6fad4caf72c7423593f7f2c129d4b692/users/4d167f846ff04a558bbfb0392cb81efd/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:40.791209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a13624-23c3-4540-99bb-cb9370076199 None admin] RBAC: Authorizing `identity:create_grant(project_id=6fad4caf72c7423593f7f2c129d4b692, user_id=4d167f846ff04a558bbfb0392cb81efd, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:40.792709 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a13624-23c3-4540-99bb-cb9370076199 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:40.888814 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 580/1153] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:11:40 2022] PUT /identity/v3/projects/6fad4caf72c7423593f7f2c129d4b692/users/4d167f846ff04a558bbfb0392cb81efd/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:11:43.081206 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258d23c-0bcc-4ef0-87cc-0f7516d42f1a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:43.081789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258d23c-0bcc-4ef0-87cc-0f7516d42f1a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:43.081789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258d23c-0bcc-4ef0-87cc-0f7516d42f1a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:43.083135 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 574/1154] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:43.089050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821569f5-ec5b-40d1-9db4-4f709a218175 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:43.089519 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821569f5-ec5b-40d1-9db4-4f709a218175 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:43.090719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821569f5-ec5b-40d1-9db4-4f709a218175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:43.114875 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-821569f5-ec5b-40d1-9db4-4f709a218175 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:43.116094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-821569f5-ec5b-40d1-9db4-4f709a218175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:43.183545 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 581/1155] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:43.451839 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258d23c-0bcc-4ef0-87cc-0f7516d42f1a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:43.552010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258d23c-0bcc-4ef0-87cc-0f7516d42f1a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:43.576975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:43.587807 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c2447-5b80-4b38-8d84-afa8ea3a6301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:43.588434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c2447-5b80-4b38-8d84-afa8ea3a6301 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:43.588706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c2447-5b80-4b38-8d84-afa8ea3a6301 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:43.588972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c2447-5b80-4b38-8d84-afa8ea3a6301 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:43.598703 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c2447-5b80-4b38-8d84-afa8ea3a6301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:11:43.603535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-9f3c2447-5b80-4b38-8d84-afa8ea3a6301 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:11:43.603535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:43.603535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:43.603535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:43.603535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:43.603535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:43.603535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:43.603535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:43.603535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:43.603535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:43.603535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:43.603535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:43.603535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:11:43.603535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:11:43.603535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:11:43.603535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:11:43.604591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:11:43.604591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:11:43.604591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:11:43.604591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:11:43.604591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:43.604591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:43.604591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:43.604591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:43.604591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:43.604591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:43.604591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:43.604591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:43.604591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:43.604591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:43.604591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:43.604591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:43.605609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:43.605609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:43.605609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:43.605609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:43.605609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:11:43.605609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:11:43.605609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:11:43.605609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:11:43.605609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:11:43.605609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:11:43.605609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:11:43.605609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:43.605609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 575/1156] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:11:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:11:43.610776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821569f5-ec5b-40d1-9db4-4f709a218175 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:43.651954 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:43.712724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821569f5-ec5b-40d1-9db4-4f709a218175 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:43.750556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ed1a8-c1a8-4b24-97ee-63f4b0275c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:43.751678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ed1a8-c1a8-4b24-97ee-63f4b0275c81 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:43.751955 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ed1a8-c1a8-4b24-97ee-63f4b0275c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:43.752226 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ed1a8-c1a8-4b24-97ee-63f4b0275c81 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:43.752887 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ed1a8-c1a8-4b24-97ee-63f4b0275c81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:43.753189 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ed1a8-c1a8-4b24-97ee-63f4b0275c81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:43.754592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ed1a8-c1a8-4b24-97ee-63f4b0275c81 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:43.763194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 582/1157] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:11:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:43.769132 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c2447-5b80-4b38-8d84-afa8ea3a6301 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:43.866213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c2447-5b80-4b38-8d84-afa8ea3a6301 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:43.900104 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ab9e7-8efb-44ca-acd7-a34d4b82236b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:43.900729 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ab9e7-8efb-44ca-acd7-a34d4b82236b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:43.901011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ab9e7-8efb-44ca-acd7-a34d4b82236b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:43.901287 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ab9e7-8efb-44ca-acd7-a34d4b82236b None admin] PATH_INFO: `/v3/users/4d167f846ff04a558bbfb0392cb81efd` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:43.902472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ab9e7-8efb-44ca-acd7-a34d4b82236b None admin] RBAC: Authorizing `identity:get_user(user_id=4d167f846ff04a558bbfb0392cb81efd)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:43.903953 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ab9e7-8efb-44ca-acd7-a34d4b82236b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:43.905544 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 576/1158] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:11:43 2022] GET /identity/v3/users/4d167f846ff04a558bbfb0392cb81efd => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:43.911467 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ed1a8-c1a8-4b24-97ee-63f4b0275c81 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:44.015197 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ed1a8-c1a8-4b24-97ee-63f4b0275c81 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:44.016749 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:44.050392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533ba63-3bc4-4e2b-b5c5-3d17eb5414db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:44.051013 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533ba63-3bc4-4e2b-b5c5-3d17eb5414db None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:44.051269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533ba63-3bc4-4e2b-b5c5-3d17eb5414db None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:44.051539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533ba63-3bc4-4e2b-b5c5-3d17eb5414db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:44.119261 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533ba63-3bc4-4e2b-b5c5-3d17eb5414db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:44.120751 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533ba63-3bc4-4e2b-b5c5-3d17eb5414db None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:44.219154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 583/1159] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:11:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:44.225554 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ab9e7-8efb-44ca-acd7-a34d4b82236b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:44.276780 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:44.327231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ab9e7-8efb-44ca-acd7-a34d4b82236b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:44.361019 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52fb9c-901e-4675-b132-2e6d68749e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:44.361648 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52fb9c-901e-4675-b132-2e6d68749e3f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:44.361947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52fb9c-901e-4675-b132-2e6d68749e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:44.362215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52fb9c-901e-4675-b132-2e6d68749e3f None admin] PATH_INFO: `/v3/projects/6fad4caf72c7423593f7f2c129d4b692` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:44.363302 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52fb9c-901e-4675-b132-2e6d68749e3f None admin] RBAC: Authorizing `identity:get_project(project_id=6fad4caf72c7423593f7f2c129d4b692)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:44.364718 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52fb9c-901e-4675-b132-2e6d68749e3f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:44.366953 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 577/1160] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:11:44 2022] GET /identity/v3/projects/6fad4caf72c7423593f7f2c129d4b692 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:44.373111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533ba63-3bc4-4e2b-b5c5-3d17eb5414db None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:44.375296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:44.469653 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533ba63-3bc4-4e2b-b5c5-3d17eb5414db None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:44.503460 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5344f8-ce37-4ac8-a65d-5133e8ada5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:44.504062 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5344f8-ce37-4ac8-a65d-5133e8ada5fd None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:44.504340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5344f8-ce37-4ac8-a65d-5133e8ada5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:44.504614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5344f8-ce37-4ac8-a65d-5133e8ada5fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:44.505330 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5344f8-ce37-4ac8-a65d-5133e8ada5fd None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=6fad4caf72c7423593f7f2c129d4b692, user.id=4d167f846ff04a558bbfb0392cb81efd) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:44.505634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5344f8-ce37-4ac8-a65d-5133e8ada5fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:44.507128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5344f8-ce37-4ac8-a65d-5133e8ada5fd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:44.512902 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 584/1161] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:11:44 2022] GET /identity/v3/role_assignments?user.id=4d167f846ff04a558bbfb0392cb81efd&scope.project.id=6fad4caf72c7423593f7f2c129d4b692&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:46.686136 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30cea2-dc39-4007-8533-42c14fca9b3e None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:46.686663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30cea2-dc39-4007-8533-42c14fca9b3e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:46.686663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30cea2-dc39-4007-8533-42c14fca9b3e None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:46.687999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 578/1162] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:46.693243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b929f27-4a46-469f-8c26-d903649ac345 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:46.693646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b929f27-4a46-469f-8c26-d903649ac345 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:46.693862 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b929f27-4a46-469f-8c26-d903649ac345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:46.712149 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8b929f27-4a46-469f-8c26-d903649ac345 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:46.713339 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8b929f27-4a46-469f-8c26-d903649ac345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:46.771972 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:46.779430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 585/1163] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:47.047316 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30cea2-dc39-4007-8533-42c14fca9b3e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:47.143864 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30cea2-dc39-4007-8533-42c14fca9b3e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:47.163822 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:47.177547 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc65fb-b23f-4adc-82df-440a14569c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:47.178207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc65fb-b23f-4adc-82df-440a14569c5f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:47.180882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc65fb-b23f-4adc-82df-440a14569c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:47.180882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc65fb-b23f-4adc-82df-440a14569c5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:47.245691 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc65fb-b23f-4adc-82df-440a14569c5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:47.247077 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc65fb-b23f-4adc-82df-440a14569c5f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:47.348410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 579/1164] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:11:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:47.354648 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b929f27-4a46-469f-8c26-d903649ac345 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:47.454352 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b929f27-4a46-469f-8c26-d903649ac345 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:47.486858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5347bc-c9fc-4585-a563-8e1ce5bf3768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:47.487421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5347bc-c9fc-4585-a563-8e1ce5bf3768 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:47.487696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5347bc-c9fc-4585-a563-8e1ce5bf3768 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:47.487968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5347bc-c9fc-4585-a563-8e1ce5bf3768 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:47.497365 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5347bc-c9fc-4585-a563-8e1ce5bf3768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:47.498784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5347bc-c9fc-4585-a563-8e1ce5bf3768 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-2c5347bc-c9fc-4585-a563-8e1ce5bf3768 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:47.512488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:47.513804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:47.513804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:47.513804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:47.513804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:47.513804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:47.513804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:47.513804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:11:47.513804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:11:47.513804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:11:47.513804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:11:47.513804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:47.513804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:47.513804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:47.513804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:47.513804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:47.513804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:47.514967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:47.514967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:47.514967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:47.514967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:47.514967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:47.514967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:47.514967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:47.514967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:47.514967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:47.514967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:47.514967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 23 15:11:47.514967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:11:47.514967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 23 15:11:47.514967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:11:47.514967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 586/1165] 10.222.0.82 () {56 vars in 1117 bytes} [Fri Sep 23 15:11:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:11:47.519657 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc65fb-b23f-4adc-82df-440a14569c5f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:47.540031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:47.614585 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc65fb-b23f-4adc-82df-440a14569c5f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:47.649714 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cc57e-db01-4407-96f3-4bcdb6dcdbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:47.650334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cc57e-db01-4407-96f3-4bcdb6dcdbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:47.650606 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cc57e-db01-4407-96f3-4bcdb6dcdbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:47.650874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cc57e-db01-4407-96f3-4bcdb6dcdbb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:47.651500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cc57e-db01-4407-96f3-4bcdb6dcdbb1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:47.651798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cc57e-db01-4407-96f3-4bcdb6dcdbb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:47.653148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cc57e-db01-4407-96f3-4bcdb6dcdbb1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:47.660199 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 580/1166] 10.222.0.82 () {56 vars in 1115 bytes} [Fri Sep 23 15:11:47 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:49.840936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1941476-4a8c-40f7-b81a-c958120ad7db None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:49.841459 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1941476-4a8c-40f7-b81a-c958120ad7db None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:49.841459 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1941476-4a8c-40f7-b81a-c958120ad7db None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:49.842906 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 587/1167] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:49.848408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c0e20-ec81-43d0-8a86-f8a8e55bd5dc None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:49.848859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c0e20-ec81-43d0-8a86-f8a8e55bd5dc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:49.848952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c0e20-ec81-43d0-8a86-f8a8e55bd5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:49.867906 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-014c0e20-ec81-43d0-8a86-f8a8e55bd5dc None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:49.869129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-014c0e20-ec81-43d0-8a86-f8a8e55bd5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:49.934798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 581/1168] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:11:50.204671 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1941476-4a8c-40f7-b81a-c958120ad7db None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:50.262015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:50.307670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1941476-4a8c-40f7-b81a-c958120ad7db None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:50.340535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55677e-d5fa-43c6-a1e9-d84cff340163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:50.341128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55677e-d5fa-43c6-a1e9-d84cff340163 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:50.341403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55677e-d5fa-43c6-a1e9-d84cff340163 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:50.341675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55677e-d5fa-43c6-a1e9-d84cff340163 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:50.342357 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55677e-d5fa-43c6-a1e9-d84cff340163 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:50.343726 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55677e-d5fa-43c6-a1e9-d84cff340163 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:50.438013 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 588/1169] 10.222.0.82 () {60 vars in 1138 bytes} [Fri Sep 23 15:11:50 2022] POST /identity/v3/domains => generated 267 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:11:52.600831 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76835d-20ce-4045-bb0a-82381d82463a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:52.601368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76835d-20ce-4045-bb0a-82381d82463a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:52.601368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76835d-20ce-4045-bb0a-82381d82463a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:52.602773 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 582/1170] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:52.608091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c02016-9914-4a25-8794-a2b044609b5b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:52.608563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c02016-9914-4a25-8794-a2b044609b5b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:52.608667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c02016-9914-4a25-8794-a2b044609b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:52.626648 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-81c02016-9914-4a25-8794-a2b044609b5b None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:52.627843 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-81c02016-9914-4a25-8794-a2b044609b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:52.702970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 589/1171] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:52.970037 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76835d-20ce-4045-bb0a-82381d82463a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:52.985382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:53.071151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76835d-20ce-4045-bb0a-82381d82463a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:53.105279 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049a657-0894-4214-8ced-a6d8f91d6956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:53.105937 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049a657-0894-4214-8ced-a6d8f91d6956 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:53.106219 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049a657-0894-4214-8ced-a6d8f91d6956 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:53.106493 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049a657-0894-4214-8ced-a6d8f91d6956 None admin] PATH_INFO: `/v3/domains/1696a4cb8a4c46e7bbcec6aa6c51365d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:53.117348 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049a657-0894-4214-8ced-a6d8f91d6956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1696a4cb8a4c46e7bbcec6aa6c51365d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:53.118812 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049a657-0894-4214-8ced-a6d8f91d6956 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:53.120416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 583/1172] 10.222.0.82 () {56 vars in 1183 bytes} [Fri Sep 23 15:11:52 2022] GET /identity/v3/domains/1696a4cb8a4c46e7bbcec6aa6c51365d => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:53.126529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c02016-9914-4a25-8794-a2b044609b5b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:53.171965 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:53.224419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c02016-9914-4a25-8794-a2b044609b5b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:53.260717 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93655b09-f12f-4b11-8590-342a3f194f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:53.261324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93655b09-f12f-4b11-8590-342a3f194f7b None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:53.261606 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93655b09-f12f-4b11-8590-342a3f194f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:53.261919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93655b09-f12f-4b11-8590-342a3f194f7b None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:53.262657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93655b09-f12f-4b11-8590-342a3f194f7b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:53.264097 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93655b09-f12f-4b11-8590-342a3f194f7b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:53.380475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 590/1173] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Sep 23 15:11:53 2022] POST /identity/v3/projects => generated 361 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:11:55.587895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d85c99-e849-44eb-b267-2275154887ab None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:55.588484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d85c99-e849-44eb-b267-2275154887ab None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:55.588484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d85c99-e849-44eb-b267-2275154887ab None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:55.589910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 584/1174] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:11:55.595387 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c97e08-169f-4fd3-8b86-2f8ff79e2002 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:55.595847 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c97e08-169f-4fd3-8b86-2f8ff79e2002 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:55.595962 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c97e08-169f-4fd3-8b86-2f8ff79e2002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:55.616168 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-19c97e08-169f-4fd3-8b86-2f8ff79e2002 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:55.617396 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-19c97e08-169f-4fd3-8b86-2f8ff79e2002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:55.689410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 591/1175] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:11:55.968164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d85c99-e849-44eb-b267-2275154887ab None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:56.049395 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:56.075269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d85c99-e849-44eb-b267-2275154887ab None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:56.112319 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e1049-6055-4426-a5e5-58da8dd8fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:56.112959 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e1049-6055-4426-a5e5-58da8dd8fbfe None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:56.113236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e1049-6055-4426-a5e5-58da8dd8fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:56.113514 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e1049-6055-4426-a5e5-58da8dd8fbfe None admin] PATH_INFO: `/v3/domains/1696a4cb8a4c46e7bbcec6aa6c51365d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:56.114722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e1049-6055-4426-a5e5-58da8dd8fbfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=1696a4cb8a4c46e7bbcec6aa6c51365d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:56.116198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e1049-6055-4426-a5e5-58da8dd8fbfe None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:56.117886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 585/1176] 10.222.0.82 () {56 vars in 1183 bytes} [Fri Sep 23 15:11:55 2022] GET /identity/v3/domains/1696a4cb8a4c46e7bbcec6aa6c51365d => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:56.123889 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c97e08-169f-4fd3-8b86-2f8ff79e2002 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:56.155776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:56.230487 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c97e08-169f-4fd3-8b86-2f8ff79e2002 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:56.265228 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568b23e-6fd9-4105-b63b-20e54d0e341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:56.265863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568b23e-6fd9-4105-b63b-20e54d0e341b None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:56.266127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568b23e-6fd9-4105-b63b-20e54d0e341b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:56.266393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568b23e-6fd9-4105-b63b-20e54d0e341b None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:56.267058 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568b23e-6fd9-4105-b63b-20e54d0e341b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:56.268496 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568b23e-6fd9-4105-b63b-20e54d0e341b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:56.373540 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 592/1177] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:11:56 2022] POST /identity/v3/users => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:11:58.632021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7db37-fc52-436f-8d2d-a3ed510c7c96 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:58.632664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7db37-fc52-436f-8d2d-a3ed510c7c96 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:58.632664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7db37-fc52-436f-8d2d-a3ed510c7c96 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:58.634129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 586/1178] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:11:58.640016 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ff03-c722-4bb5-806f-161189075be2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:58.640558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ff03-c722-4bb5-806f-161189075be2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:58.640558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ff03-c722-4bb5-806f-161189075be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:58.660005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-aec0ff03-c722-4bb5-806f-161189075be2 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:11:58.661252 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-aec0ff03-c722-4bb5-806f-161189075be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:11:58.734326 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 593/1179] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:11:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:11:59.009052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7db37-fc52-436f-8d2d-a3ed510c7c96 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:59.136514 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7db37-fc52-436f-8d2d-a3ed510c7c96 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:59.174655 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c803dc-a2e6-457e-b3a0-1668bcc2c3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:59.175291 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c803dc-a2e6-457e-b3a0-1668bcc2c3ad None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:59.175571 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c803dc-a2e6-457e-b3a0-1668bcc2c3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:59.175842 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c803dc-a2e6-457e-b3a0-1668bcc2c3ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:59.187480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c803dc-a2e6-457e-b3a0-1668bcc2c3ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:11:59.192351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-24c803dc-a2e6-457e-b3a0-1668bcc2c3ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:11:59.192351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:11:59.192351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:11:59.192351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:11:59.192351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:11:59.192351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:11:59.192351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:11:59.192351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:11:59.192351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:11:59.192351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:11:59.192351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:11:59.192351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:11:59.192351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:11:59.192351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:11:59.192351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:11:59.192351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:11:59.194057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:11:59.194057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:11:59.194057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:11:59.194057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:11:59.194057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:11:59.194057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:11:59.194057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:11:59.194057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:11:59.194057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:11:59.194057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:11:59.194057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:11:59.194057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:11:59.194057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:11:59.194057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:11:59.194057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:11:59.194057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:11:59.195016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:11:59.195016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:11:59.195016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:11:59.195016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:11:59.195016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:11:59.195016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:11:59.195016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:11:59.195016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:11:59.195016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:11:59.195016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:11:59.195016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:11:59.195016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:11:59.195016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 587/1180] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:11:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:11:59.203234 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ff03-c722-4bb5-806f-161189075be2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:59.228893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:59.333888 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ff03-c722-4bb5-806f-161189075be2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:59.376936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f2c59-1ed9-4b5f-b3ec-03e9fc297b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:59.380910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f2c59-1ed9-4b5f-b3ec-03e9fc297b69 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:59.380910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f2c59-1ed9-4b5f-b3ec-03e9fc297b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:59.380910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f2c59-1ed9-4b5f-b3ec-03e9fc297b69 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:59.380910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f2c59-1ed9-4b5f-b3ec-03e9fc297b69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:11:59.380910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f2c59-1ed9-4b5f-b3ec-03e9fc297b69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:59.380910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f2c59-1ed9-4b5f-b3ec-03e9fc297b69 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:59.389153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 594/1181] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:11:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:11:59.395243 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c803dc-a2e6-457e-b3a0-1668bcc2c3ad None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:59.399311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:59.508502 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c803dc-a2e6-457e-b3a0-1668bcc2c3ad None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:59.544290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef0ce4-44c3-42a0-a91f-f5cc7fd64bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:59.544927 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef0ce4-44c3-42a0-a91f-f5cc7fd64bdc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:59.545204 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef0ce4-44c3-42a0-a91f-f5cc7fd64bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:59.545475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef0ce4-44c3-42a0-a91f-f5cc7fd64bdc None admin] PATH_INFO: `/v3/users/f476c97be5114ced9af89dd7f92630df` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:59.560197 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef0ce4-44c3-42a0-a91f-f5cc7fd64bdc None admin] RBAC: Authorizing `identity:get_user(user_id=f476c97be5114ced9af89dd7f92630df)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:59.561654 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef0ce4-44c3-42a0-a91f-f5cc7fd64bdc None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:59.563385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 588/1182] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:11:59 2022] GET /identity/v3/users/f476c97be5114ced9af89dd7f92630df => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:11:59.572287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f2c59-1ed9-4b5f-b3ec-03e9fc297b69 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:11:59.653060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:59.676855 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f2c59-1ed9-4b5f-b3ec-03e9fc297b69 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:11:59.718317 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c26fd2-a800-4cd9-8bbd-787aea1a41c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:11:59.719342 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c26fd2-a800-4cd9-8bbd-787aea1a41c9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:11:59.719842 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c26fd2-a800-4cd9-8bbd-787aea1a41c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:11:59.720327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c26fd2-a800-4cd9-8bbd-787aea1a41c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:11:59.842090 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c26fd2-a800-4cd9-8bbd-787aea1a41c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:11:59.844502 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c26fd2-a800-4cd9-8bbd-787aea1a41c9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:11:59.928138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:11:59.951825 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 595/1183] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:11:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:11:59.958202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef0ce4-44c3-42a0-a91f-f5cc7fd64bdc None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:00.018300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:00.058870 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef0ce4-44c3-42a0-a91f-f5cc7fd64bdc None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:00.095842 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf1be4-257c-4a6d-b8e9-8973ff394249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:00.096408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf1be4-257c-4a6d-b8e9-8973ff394249 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:00.096686 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf1be4-257c-4a6d-b8e9-8973ff394249 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:00.096957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf1be4-257c-4a6d-b8e9-8973ff394249 None admin] PATH_INFO: `/v3/projects/3836f888f99b4d67840be8321a100eca` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:00.098233 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf1be4-257c-4a6d-b8e9-8973ff394249 None admin] RBAC: Authorizing `identity:get_project(project_id=3836f888f99b4d67840be8321a100eca)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:00.099753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf1be4-257c-4a6d-b8e9-8973ff394249 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:00.101513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 589/1184] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:11:59 2022] GET /identity/v3/projects/3836f888f99b4d67840be8321a100eca => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:12:00.108188 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c26fd2-a800-4cd9-8bbd-787aea1a41c9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:00.212426 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c26fd2-a800-4cd9-8bbd-787aea1a41c9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:00.247597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd5f37-8ec5-4192-815b-dce6c347976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:00.248276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd5f37-8ec5-4192-815b-dce6c347976f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:00.248596 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd5f37-8ec5-4192-815b-dce6c347976f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:00.248912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd5f37-8ec5-4192-815b-dce6c347976f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:00.249696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd5f37-8ec5-4192-815b-dce6c347976f None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=3836f888f99b4d67840be8321a100eca, user.id=f476c97be5114ced9af89dd7f92630df) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:12:00.250083 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd5f37-8ec5-4192-815b-dce6c347976f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:00.251622 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd5f37-8ec5-4192-815b-dce6c347976f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:00.258640 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 596/1185] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:12:00 2022] GET /identity/v3/role_assignments?user.id=f476c97be5114ced9af89dd7f92630df&scope.project.id=3836f888f99b4d67840be8321a100eca&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:12:02.458423 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15475d-243d-44e4-bc8c-db8bf85b8a0f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:02.459751 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15475d-243d-44e4-bc8c-db8bf85b8a0f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:02.459997 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15475d-243d-44e4-bc8c-db8bf85b8a0f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:02.461523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 590/1186] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:12:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:12:02.467352 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb1248-f651-41de-9e48-a34f20e6fa22 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:02.467901 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb1248-f651-41de-9e48-a34f20e6fa22 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:02.467901 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb1248-f651-41de-9e48-a34f20e6fa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:02.486898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7cbb1248-f651-41de-9e48-a34f20e6fa22 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:12:02.488253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7cbb1248-f651-41de-9e48-a34f20e6fa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:12:02.528692 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:02.566108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 597/1187] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:12:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:12:02.841582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15475d-243d-44e4-bc8c-db8bf85b8a0f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:02.961062 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15475d-243d-44e4-bc8c-db8bf85b8a0f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:02.990571 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:02.998762 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e4648-fc20-4b24-b144-cd13ce02dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:02.999481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4648-fc20-4b24-b144-cd13ce02dd3d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:02.999843 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4648-fc20-4b24-b144-cd13ce02dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:03.000220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4648-fc20-4b24-b144-cd13ce02dd3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:03.010915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e4648-fc20-4b24-b144-cd13ce02dd3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:12:03.015613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-850e4648-fc20-4b24-b144-cd13ce02dd3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:12:03.015613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:12:03.015613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:12:03.015613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:12:03.015613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:12:03.015613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:12:03.015613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:12:03.015613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:12:03.015613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:12:03.015613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:12:03.015613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:12:03.015613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:12:03.015613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:12:03.015613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:12:03.015613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:12:03.015613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:12:03.018778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:12:03.018778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:12:03.018778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:12:03.018778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:12:03.018778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:12:03.018778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:12:03.018778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:12:03.018778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:12:03.018778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:12:03.018778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:12:03.018778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:12:03.018778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:12:03.018778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:12:03.018778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:12:03.018778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:12:03.018778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:12:03.020415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:12:03.020415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:12:03.020415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:12:03.020415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:12:03.020415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:12:03.020415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:12:03.020415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:12:03.020415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:12:03.020415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:12:03.020415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:12:03.020415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:12:03.020415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:12:03.020415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 591/1188] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:12:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:12:03.024850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb1248-f651-41de-9e48-a34f20e6fa22 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:03.127699 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb1248-f651-41de-9e48-a34f20e6fa22 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:03.165015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b36a0-da59-49e7-b2a9-0d9987a69154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:03.166082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b36a0-da59-49e7-b2a9-0d9987a69154 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:03.166455 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b36a0-da59-49e7-b2a9-0d9987a69154 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:03.166840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b36a0-da59-49e7-b2a9-0d9987a69154 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:03.167629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b36a0-da59-49e7-b2a9-0d9987a69154 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:12:03.168030 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b36a0-da59-49e7-b2a9-0d9987a69154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:03.169522 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b36a0-da59-49e7-b2a9-0d9987a69154 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:03.179394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 598/1189] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:12:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:12:03.189171 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e4648-fc20-4b24-b144-cd13ce02dd3d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:03.353791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e4648-fc20-4b24-b144-cd13ce02dd3d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:03.389902 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c60a8-71c0-4f06-a0da-7114c51fc648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:03.390463 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c60a8-71c0-4f06-a0da-7114c51fc648 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:03.390745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c60a8-71c0-4f06-a0da-7114c51fc648 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:03.391013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c60a8-71c0-4f06-a0da-7114c51fc648 None admin] PATH_INFO: `/v3/users/f476c97be5114ced9af89dd7f92630df` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:03.392154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c60a8-71c0-4f06-a0da-7114c51fc648 None admin] RBAC: Authorizing `identity:get_user(user_id=f476c97be5114ced9af89dd7f92630df)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:03.393580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c60a8-71c0-4f06-a0da-7114c51fc648 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:03.395266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 592/1190] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:12:03 2022] GET /identity/v3/users/f476c97be5114ced9af89dd7f92630df => generated 311 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:12:03.401606 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b36a0-da59-49e7-b2a9-0d9987a69154 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:03.435205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:03.506820 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b36a0-da59-49e7-b2a9-0d9987a69154 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:03.541404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd3a14-968e-4fbe-a8d4-458595c0632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:03.542129 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd3a14-968e-4fbe-a8d4-458595c0632f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:03.542455 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd3a14-968e-4fbe-a8d4-458595c0632f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:03.542762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd3a14-968e-4fbe-a8d4-458595c0632f None admin] PATH_INFO: `/v3/projects/3836f888f99b4d67840be8321a100eca` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:03.548075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd3a14-968e-4fbe-a8d4-458595c0632f None admin] RBAC: Authorizing `identity:get_project(project_id=3836f888f99b4d67840be8321a100eca)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:03.549724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd3a14-968e-4fbe-a8d4-458595c0632f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:03.551573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 599/1191] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:12:03 2022] GET /identity/v3/projects/3836f888f99b4d67840be8321a100eca => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:12:03.558399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c60a8-71c0-4f06-a0da-7114c51fc648 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:03.624512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:03.674908 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c60a8-71c0-4f06-a0da-7114c51fc648 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:03.713852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03b782-e8b9-45eb-a15e-68ff91b36be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:03.714620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03b782-e8b9-45eb-a15e-68ff91b36be9 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:03.714945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03b782-e8b9-45eb-a15e-68ff91b36be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:03.715262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03b782-e8b9-45eb-a15e-68ff91b36be9 None admin] PATH_INFO: `/v3/projects/3836f888f99b4d67840be8321a100eca/users/f476c97be5114ced9af89dd7f92630df/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:03.717458 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03b782-e8b9-45eb-a15e-68ff91b36be9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3836f888f99b4d67840be8321a100eca, user_id=f476c97be5114ced9af89dd7f92630df, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:03.719027 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03b782-e8b9-45eb-a15e-68ff91b36be9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:03.806080 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 593/1192] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:12:03 2022] PUT /identity/v3/projects/3836f888f99b4d67840be8321a100eca/users/f476c97be5114ced9af89dd7f92630df/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:12:06.013407 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583bcc0-d119-4e25-835f-4f3a071f1611 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:06.014009 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583bcc0-d119-4e25-835f-4f3a071f1611 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:06.014104 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583bcc0-d119-4e25-835f-4f3a071f1611 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:06.015462 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 600/1193] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:12:06.021653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb0a66-d0df-4406-b9a1-650f2c12bb33 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:06.022265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb0a66-d0df-4406-b9a1-650f2c12bb33 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:06.022265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb0a66-d0df-4406-b9a1-650f2c12bb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:06.041945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c3bb0a66-d0df-4406-b9a1-650f2c12bb33 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:12:06.043231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c3bb0a66-d0df-4406-b9a1-650f2c12bb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:12:06.117912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 594/1194] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:12:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:12:06.399458 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583bcc0-d119-4e25-835f-4f3a071f1611 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:06.519111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:06.523831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583bcc0-d119-4e25-835f-4f3a071f1611 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:06.559333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08013e1-96bb-4141-87c5-e3cbeee61fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:06.559973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08013e1-96bb-4141-87c5-e3cbeee61fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:06.560246 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08013e1-96bb-4141-87c5-e3cbeee61fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:06.560518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08013e1-96bb-4141-87c5-e3cbeee61fa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:06.571828 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08013e1-96bb-4141-87c5-e3cbeee61fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:12:06.576612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e08013e1-96bb-4141-87c5-e3cbeee61fa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:12:06.576612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:12:06.576612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:12:06.576612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:12:06.576612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:12:06.576612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:12:06.576612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:12:06.576612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:12:06.576612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:12:06.576612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:12:06.576612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:12:06.576612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:12:06.576612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:12:06.576612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:12:06.576612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:12:06.576612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:12:06.577977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:12:06.577977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:12:06.577977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:12:06.577977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:12:06.577977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:12:06.577977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:12:06.577977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:12:06.577977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:12:06.577977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:12:06.577977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:12:06.577977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:12:06.577977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:12:06.577977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:12:06.577977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:12:06.577977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:12:06.577977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:12:06.579088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:12:06.579088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:12:06.579088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:12:06.579088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:12:06.579088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:12:06.579088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:12:06.579088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:12:06.579088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:12:06.579088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:12:06.579088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:12:06.579088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:12:06.579088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:12:06.579088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 601/1195] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:12:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:12:06.584613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb0a66-d0df-4406-b9a1-650f2c12bb33 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:06.631264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:06.690949 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb0a66-d0df-4406-b9a1-650f2c12bb33 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:06.726074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa654ff-8ebe-4437-93e8-e53278c15d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:06.726679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa654ff-8ebe-4437-93e8-e53278c15d40 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:06.726958 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa654ff-8ebe-4437-93e8-e53278c15d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:06.727228 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa654ff-8ebe-4437-93e8-e53278c15d40 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:06.727900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa654ff-8ebe-4437-93e8-e53278c15d40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:12:06.728206 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa654ff-8ebe-4437-93e8-e53278c15d40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:06.729595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa654ff-8ebe-4437-93e8-e53278c15d40 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:06.738843 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 595/1196] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:12:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:12:06.745332 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08013e1-96bb-4141-87c5-e3cbeee61fa2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:06.850686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08013e1-96bb-4141-87c5-e3cbeee61fa2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:06.884717 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c4104-4f1a-465a-9eba-94d39c31e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:06.885342 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c4104-4f1a-465a-9eba-94d39c31e91b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:06.885621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c4104-4f1a-465a-9eba-94d39c31e91b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:06.885924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c4104-4f1a-465a-9eba-94d39c31e91b None admin] PATH_INFO: `/v3/users/f476c97be5114ced9af89dd7f92630df` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:06.887042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c4104-4f1a-465a-9eba-94d39c31e91b None admin] RBAC: Authorizing `identity:get_user(user_id=f476c97be5114ced9af89dd7f92630df)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:06.888485 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c4104-4f1a-465a-9eba-94d39c31e91b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:06.890097 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 602/1197] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Sep 23 15:12:06 2022] GET /identity/v3/users/f476c97be5114ced9af89dd7f92630df => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:12:06.896199 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa654ff-8ebe-4437-93e8-e53278c15d40 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:06.996491 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa654ff-8ebe-4437-93e8-e53278c15d40 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:07.005542 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:07.030467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6132af-e2d6-4ddd-8138-72a0cf0dce66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:07.031136 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6132af-e2d6-4ddd-8138-72a0cf0dce66 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:07.031342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6132af-e2d6-4ddd-8138-72a0cf0dce66 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:07.031610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6132af-e2d6-4ddd-8138-72a0cf0dce66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:07.100125 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6132af-e2d6-4ddd-8138-72a0cf0dce66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:07.101688 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6132af-e2d6-4ddd-8138-72a0cf0dce66 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:07.202611 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 596/1198] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:12:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:12:07.208723 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c4104-4f1a-465a-9eba-94d39c31e91b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:07.235777 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:07.308562 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c4104-4f1a-465a-9eba-94d39c31e91b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:07.341568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c64d3b-a142-4306-a3c8-d2f3c9345ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:07.342214 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c64d3b-a142-4306-a3c8-d2f3c9345ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:07.342493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c64d3b-a142-4306-a3c8-d2f3c9345ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:07.342767 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c64d3b-a142-4306-a3c8-d2f3c9345ad3 None admin] PATH_INFO: `/v3/projects/3836f888f99b4d67840be8321a100eca` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:07.343869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c64d3b-a142-4306-a3c8-d2f3c9345ad3 None admin] RBAC: Authorizing `identity:get_project(project_id=3836f888f99b4d67840be8321a100eca)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:07.345303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c64d3b-a142-4306-a3c8-d2f3c9345ad3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:07.346973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 603/1199] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Sep 23 15:12:07 2022] GET /identity/v3/projects/3836f888f99b4d67840be8321a100eca => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:12:07.353876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6132af-e2d6-4ddd-8138-72a0cf0dce66 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:12:07.363847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:07.460067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6132af-e2d6-4ddd-8138-72a0cf0dce66 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:12:07.496257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596eaf20-5500-4cec-b8cd-acf94297ad61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:12:07.496798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eaf20-5500-4cec-b8cd-acf94297ad61 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:12:07.497077 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eaf20-5500-4cec-b8cd-acf94297ad61 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:12:07.497348 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eaf20-5500-4cec-b8cd-acf94297ad61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:12:07.498135 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596eaf20-5500-4cec-b8cd-acf94297ad61 None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=3836f888f99b4d67840be8321a100eca, user.id=f476c97be5114ced9af89dd7f92630df) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:12:07.498444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596eaf20-5500-4cec-b8cd-acf94297ad61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:12:07.499920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596eaf20-5500-4cec-b8cd-acf94297ad61 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:12:07.506573 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 597/1200] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:12:07 2022] GET /identity/v3/role_assignments?user.id=f476c97be5114ced9af89dd7f92630df&scope.project.id=3836f888f99b4d67840be8321a100eca&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:12:17.337495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=52 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:12:17.503572 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=64 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:27.547089 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba15a9a-8515-4c5d-98c0-1d3e4f9a25ee None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:27.547689 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba15a9a-8515-4c5d-98c0-1d3e4f9a25ee None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:27.547689 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba15a9a-8515-4c5d-98c0-1d3e4f9a25ee None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:27.549005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 604/1201] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:13:27.554514 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690727f-ba9c-45e6-9066-f708a1918cfd None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:27.555485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690727f-ba9c-45e6-9066-f708a1918cfd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:27.555625 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690727f-ba9c-45e6-9066-f708a1918cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:27.579253 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3690727f-ba9c-45e6-9066-f708a1918cfd None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:13:27.580429 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3690727f-ba9c-45e6-9066-f708a1918cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:13:27.647095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 598/1202] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:13:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:13:27.916076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba15a9a-8515-4c5d-98c0-1d3e4f9a25ee None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:28.029957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba15a9a-8515-4c5d-98c0-1d3e4f9a25ee None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:28.083809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec4bde-070a-4504-9e8c-7e41706cc13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:28.084445 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec4bde-070a-4504-9e8c-7e41706cc13f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:28.084724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec4bde-070a-4504-9e8c-7e41706cc13f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:28.085490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec4bde-070a-4504-9e8c-7e41706cc13f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:28.096069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec4bde-070a-4504-9e8c-7e41706cc13f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:28.097557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec4bde-070a-4504-9e8c-7e41706cc13f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:28.114620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-3eec4bde-070a-4504-9e8c-7e41706cc13f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:28.114620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:28.114620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:28.114620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:28.114620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:28.114620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:28.114620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:28.114620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:28.114620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:28.114620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:28.114620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:28.114620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:28.114620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:13:28.114620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:13:28.114620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:13:28.114620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:28.116005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:13:28.117360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:13:28.117360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:28.117360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:13:28.117360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 605/1203] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:28.122482 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690727f-ba9c-45e6-9066-f708a1918cfd None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:28.225431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690727f-ba9c-45e6-9066-f708a1918cfd None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:28.255645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:28.262054 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc46c6-4fbc-4a96-b3e9-5fc860d8bfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:28.262667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc46c6-4fbc-4a96-b3e9-5fc860d8bfa2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:28.262942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc46c6-4fbc-4a96-b3e9-5fc860d8bfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:28.263208 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc46c6-4fbc-4a96-b3e9-5fc860d8bfa2 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:28.263846 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc46c6-4fbc-4a96-b3e9-5fc860d8bfa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:28.264145 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc46c6-4fbc-4a96-b3e9-5fc860d8bfa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:28.265507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc46c6-4fbc-4a96-b3e9-5fc860d8bfa2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:28.276669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 599/1204] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:28.282782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec4bde-070a-4504-9e8c-7e41706cc13f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:28.337871 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:28.385763 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec4bde-070a-4504-9e8c-7e41706cc13f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:28.419674 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fdfe4-9cf4-4a37-81cc-e9fd99dc9ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:28.420526 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fdfe4-9cf4-4a37-81cc-e9fd99dc9ae5 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:28.420800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fdfe4-9cf4-4a37-81cc-e9fd99dc9ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:28.421065 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fdfe4-9cf4-4a37-81cc-e9fd99dc9ae5 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:28.421698 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fdfe4-9cf4-4a37-81cc-e9fd99dc9ae5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:28.423204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fdfe4-9cf4-4a37-81cc-e9fd99dc9ae5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:28.705874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 606/1205] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Sep 23 15:13:28 2022] POST /identity/v3/users => generated 251 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:13:30.983263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db857a-728e-44e5-9735-7a58238155aa None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:30.983879 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db857a-728e-44e5-9735-7a58238155aa None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:30.983879 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db857a-728e-44e5-9735-7a58238155aa None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:30.985262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 600/1206] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:13:30.991878 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e13b-b34e-43ff-9b47-d1b5613c13bb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:30.997560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e13b-b34e-43ff-9b47-d1b5613c13bb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:30.997560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e13b-b34e-43ff-9b47-d1b5613c13bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:31.013948 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b7f9e13b-b34e-43ff-9b47-d1b5613c13bb None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:13:31.015213 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b7f9e13b-b34e-43ff-9b47-d1b5613c13bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:13:31.117679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 607/1207] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:13:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:13:31.416406 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db857a-728e-44e5-9735-7a58238155aa None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:31.529268 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db857a-728e-44e5-9735-7a58238155aa None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:31.564640 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce8205-94c0-4fe5-9965-0367047bfb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:31.565279 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce8205-94c0-4fe5-9965-0367047bfb6f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:31.565555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce8205-94c0-4fe5-9965-0367047bfb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:31.565882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce8205-94c0-4fe5-9965-0367047bfb6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:31.578643 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce8205-94c0-4fe5-9965-0367047bfb6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:13:31.583485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-b1ce8205-94c0-4fe5-9965-0367047bfb6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:13:31.583485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:31.583485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:31.583485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:31.583485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:31.583485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:31.583485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:31.583485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:31.583485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:31.583485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:31.583485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:31.583485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:31.583485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:13:31.583485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:13:31.583485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:13:31.583485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:13:31.584716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:13:31.584716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:13:31.584716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:13:31.584716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:13:31.584716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:31.584716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:31.584716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:31.584716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:31.584716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:31.584716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:31.584716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:31.584716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:31.584716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:31.584716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:31.584716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:31.584716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:31.586452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:31.586452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:31.586452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:31.586452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:31.586452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:13:31.586452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:13:31.586452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:13:31.586452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:13:31.586452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:13:31.586452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:13:31.586452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:13:31.586452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:13:31.586452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 601/1208] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:13:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:31.593695 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9e13b-b34e-43ff-9b47-d1b5613c13bb None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:31.633885 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:31.695641 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9e13b-b34e-43ff-9b47-d1b5613c13bb None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:31.729786 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b190d7-5c87-497e-a8a4-77de6ac9cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:31.730396 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b190d7-5c87-497e-a8a4-77de6ac9cb45 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:31.730674 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b190d7-5c87-497e-a8a4-77de6ac9cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:31.730946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b190d7-5c87-497e-a8a4-77de6ac9cb45 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:31.731610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b190d7-5c87-497e-a8a4-77de6ac9cb45 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:31.731910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b190d7-5c87-497e-a8a4-77de6ac9cb45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:31.733294 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b190d7-5c87-497e-a8a4-77de6ac9cb45 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:31.742326 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 608/1209] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:13:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:31.748329 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce8205-94c0-4fe5-9965-0367047bfb6f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:31.801896 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:31.853935 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce8205-94c0-4fe5-9965-0367047bfb6f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:31.891186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d098a-e3fd-40e3-8d6d-d816e19ffc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:31.891865 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d098a-e3fd-40e3-8d6d-d816e19ffc7d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:31.892145 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d098a-e3fd-40e3-8d6d-d816e19ffc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:31.892436 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d098a-e3fd-40e3-8d6d-d816e19ffc7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:31.903166 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d098a-e3fd-40e3-8d6d-d816e19ffc7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:31.904617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d098a-e3fd-40e3-8d6d-d816e19ffc7d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:31.920183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c86d098a-e3fd-40e3-8d6d-d816e19ffc7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:31.920183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:31.920183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:31.920183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:31.920183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:31.920183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:31.920183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:31.920183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:31.920183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:31.920183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:31.920183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:31.920183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:31.920183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:13:31.920183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:13:31.920183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:13:31.920183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:31.921488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:13:31.922679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:13:31.922679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:31.922679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:13:31.922679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 602/1210] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:31.927394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b190d7-5c87-497e-a8a4-77de6ac9cb45 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:32.043499 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:32.043499 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b190d7-5c87-497e-a8a4-77de6ac9cb45 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:32.069129 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacb92c-e285-421d-9c7c-1d269b2de24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:32.070308 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacb92c-e285-421d-9c7c-1d269b2de24d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:32.077792 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacb92c-e285-421d-9c7c-1d269b2de24d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:32.077792 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacb92c-e285-421d-9c7c-1d269b2de24d None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:32.077792 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacb92c-e285-421d-9c7c-1d269b2de24d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:32.077792 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacb92c-e285-421d-9c7c-1d269b2de24d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:32.077792 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacb92c-e285-421d-9c7c-1d269b2de24d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:32.084923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 609/1211] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:32.090924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d098a-e3fd-40e3-8d6d-d816e19ffc7d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:32.199998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d098a-e3fd-40e3-8d6d-d816e19ffc7d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:32.201668 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:32.243746 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49a06c-b50c-4f88-ad19-0be654312ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:32.244310 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49a06c-b50c-4f88-ad19-0be654312ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:32.244634 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49a06c-b50c-4f88-ad19-0be654312ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:32.244903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49a06c-b50c-4f88-ad19-0be654312ec6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:32.252528 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49a06c-b50c-4f88-ad19-0be654312ec6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:32.253999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49a06c-b50c-4f88-ad19-0be654312ec6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:32.266365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ed49a06c-b50c-4f88-ad19-0be654312ec6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:13:32.266365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:32.266365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:32.266365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:32.266365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:32.266365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:32.266365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:32.266365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:32.266365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:32.266365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:32.266365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:32.266365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:32.266365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:13:32.266365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:13:32.266365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:13:32.266365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:32.267681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:32.269817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:32.269817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:32.269817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:13:32.269817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:13:32.269817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:13:32.269817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:13:32.269817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:13:32.269817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:13:32.269817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:13:32.269817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:13:32.269817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 603/1212] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:32.274289 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacb92c-e285-421d-9c7c-1d269b2de24d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:32.388506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacb92c-e285-421d-9c7c-1d269b2de24d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:32.435859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2460c-2144-46a6-89f3-ec29b64245d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:32.438820 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2460c-2144-46a6-89f3-ec29b64245d2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:32.438820 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2460c-2144-46a6-89f3-ec29b64245d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:32.438820 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2460c-2144-46a6-89f3-ec29b64245d2 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:32.438820 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2460c-2144-46a6-89f3-ec29b64245d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:32.438820 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2460c-2144-46a6-89f3-ec29b64245d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:32.439690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2460c-2144-46a6-89f3-ec29b64245d2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:32.459609 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 610/1213] 10.222.0.82 () {56 vars in 1143 bytes} [Fri Sep 23 15:13:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:13:32.466205 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49a06c-b50c-4f88-ad19-0be654312ec6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:32.572347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49a06c-b50c-4f88-ad19-0be654312ec6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:32.607198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d922033-18d6-4b24-adb3-7e3f3f77e7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:32.607802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d922033-18d6-4b24-adb3-7e3f3f77e7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:32.608076 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d922033-18d6-4b24-adb3-7e3f3f77e7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:32.608343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d922033-18d6-4b24-adb3-7e3f3f77e7a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:32.638991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:32.678487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d922033-18d6-4b24-adb3-7e3f3f77e7a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:32.680186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d922033-18d6-4b24-adb3-7e3f3f77e7a9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:32.780325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 604/1214] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:13:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:13:32.786444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2460c-2144-46a6-89f3-ec29b64245d2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:32.806538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:32.887498 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2460c-2144-46a6-89f3-ec29b64245d2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:32.923427 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822bf0a-76de-4db7-a6d6-bf5866c25e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:32.924063 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822bf0a-76de-4db7-a6d6-bf5866c25e6f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:32.924340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822bf0a-76de-4db7-a6d6-bf5866c25e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:32.924612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822bf0a-76de-4db7-a6d6-bf5866c25e6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:32.935320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822bf0a-76de-4db7-a6d6-bf5866c25e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:32.936785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822bf0a-76de-4db7-a6d6-bf5866c25e6f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:32.952358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-5822bf0a-76de-4db7-a6d6-bf5866c25e6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:32.952358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:32.952358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:32.952358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:32.952358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:32.952358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:32.952358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:32.952358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:32.952358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:32.952358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:32.952358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:32.952358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:32.952358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:13:32.952358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:13:32.952358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:13:32.952358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:32.953610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:13:32.954552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:13:32.954552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:32.954552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:13:32.954552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 611/1215] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:32.959281 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d922033-18d6-4b24-adb3-7e3f3f77e7a9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:33.024366 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:33.067541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d922033-18d6-4b24-adb3-7e3f3f77e7a9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:33.104085 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49b716-0432-4155-b3b4-523a0e7413a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:33.104875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b716-0432-4155-b3b4-523a0e7413a3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:33.104983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b716-0432-4155-b3b4-523a0e7413a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:33.105213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b716-0432-4155-b3b4-523a0e7413a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:33.105897 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49b716-0432-4155-b3b4-523a0e7413a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:33.106205 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49b716-0432-4155-b3b4-523a0e7413a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:33.107573 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49b716-0432-4155-b3b4-523a0e7413a3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:33.120580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 605/1216] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:33.125835 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822bf0a-76de-4db7-a6d6-bf5866c25e6f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:33.205046 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:33.237989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822bf0a-76de-4db7-a6d6-bf5866c25e6f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:33.272078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8dd4c-f324-44f4-8870-efc6856a5c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:33.273204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8dd4c-f324-44f4-8870-efc6856a5c90 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:33.273486 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8dd4c-f324-44f4-8870-efc6856a5c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:33.273782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8dd4c-f324-44f4-8870-efc6856a5c90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:33.280800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8dd4c-f324-44f4-8870-efc6856a5c90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:33.282303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8dd4c-f324-44f4-8870-efc6856a5c90 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:33.294320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-74e8dd4c-f324-44f4-8870-efc6856a5c90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:13:33.294320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:33.294320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:33.294320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:33.294320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:33.294320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:33.294320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:33.294320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:33.294320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:33.294320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:33.294320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:33.294320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:33.294320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:13:33.294320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:13:33.294320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:33.295716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:33.296831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:13:33.296831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:13:33.296831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:13:33.296831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:13:33.296831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:13:33.296831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:13:33.296831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:13:33.296831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:13:33.298074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 612/1217] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:13:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:33.301674 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49b716-0432-4155-b3b4-523a0e7413a3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:33.405542 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49b716-0432-4155-b3b4-523a0e7413a3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:33.428447 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:33.439972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83579f1-51aa-4e97-9d29-9fca4eef83af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:33.443364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83579f1-51aa-4e97-9d29-9fca4eef83af None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:33.443364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83579f1-51aa-4e97-9d29-9fca4eef83af None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:33.443364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83579f1-51aa-4e97-9d29-9fca4eef83af None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:33.443364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83579f1-51aa-4e97-9d29-9fca4eef83af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:33.443364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83579f1-51aa-4e97-9d29-9fca4eef83af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:33.443809 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83579f1-51aa-4e97-9d29-9fca4eef83af None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:33.454900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 606/1218] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:13:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:33.461535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8dd4c-f324-44f4-8870-efc6856a5c90 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:33.568360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8dd4c-f324-44f4-8870-efc6856a5c90 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:33.596945 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:33.602490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d89613-8c64-448e-a889-f1204afd3e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:33.603154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d89613-8c64-448e-a889-f1204afd3e66 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:33.603432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d89613-8c64-448e-a889-f1204afd3e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:33.603702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d89613-8c64-448e-a889-f1204afd3e66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:33.604434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d89613-8c64-448e-a889-f1204afd3e66 None admin] RBAC: Adding query filter params (role.id=118b4b27bab54b429c3a70924d659c72, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=a25109eeb1b34b3689b10e3f7c44a6b9) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:33.604740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d89613-8c64-448e-a889-f1204afd3e66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:33.606205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d89613-8c64-448e-a889-f1204afd3e66 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:33.611785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 613/1219] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:13:33 2022] GET /identity/v3/role_assignments?user.id=a25109eeb1b34b3689b10e3f7c44a6b9&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=118b4b27bab54b429c3a70924d659c72 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:35.803244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3041442-5800-4e73-a752-9ff080a280bb None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:35.803832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3041442-5800-4e73-a752-9ff080a280bb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:35.803832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3041442-5800-4e73-a752-9ff080a280bb None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:35.805781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 607/1220] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:13:35.811429 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f04383-44d4-41c5-844b-e53cd70b3962 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:35.811898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f04383-44d4-41c5-844b-e53cd70b3962 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:35.811994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f04383-44d4-41c5-844b-e53cd70b3962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:35.830559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-39f04383-44d4-41c5-844b-e53cd70b3962 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:13:35.831753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-39f04383-44d4-41c5-844b-e53cd70b3962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:13:35.902963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 614/1221] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:13:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:13:36.173929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3041442-5800-4e73-a752-9ff080a280bb None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:36.302205 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3041442-5800-4e73-a752-9ff080a280bb None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:36.341045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfa1bc-22c1-44a3-8f41-86906c72af71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:36.341709 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa1bc-22c1-44a3-8f41-86906c72af71 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:36.342028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa1bc-22c1-44a3-8f41-86906c72af71 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:36.342303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa1bc-22c1-44a3-8f41-86906c72af71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:36.355201 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfa1bc-22c1-44a3-8f41-86906c72af71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:13:36.360285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-6abfa1bc-22c1-44a3-8f41-86906c72af71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:13:36.360285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:36.360285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:36.360285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:36.360285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:36.360285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:36.360285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:36.360285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:36.360285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:36.360285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:36.360285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:36.360285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:36.360285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:13:36.360285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:13:36.360285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:13:36.360285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:13:36.361424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:13:36.361424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:13:36.361424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:13:36.361424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:13:36.361424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:36.361424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:36.361424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:36.361424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:36.361424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:36.361424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:36.361424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:36.361424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:36.361424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:36.361424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:36.361424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:36.361424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:36.362331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:36.362331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:36.362331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:36.362331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:36.362331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:13:36.362331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:13:36.362331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:13:36.362331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:13:36.362331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:13:36.362331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:13:36.362331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:13:36.362331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:13:36.362331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 608/1222] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:13:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:36.368209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f04383-44d4-41c5-844b-e53cd70b3962 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:36.468188 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f04383-44d4-41c5-844b-e53cd70b3962 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:36.495646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:36.506772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661e043-07e3-4357-952f-912ee11c3462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:36.507422 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661e043-07e3-4357-952f-912ee11c3462 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:36.507694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661e043-07e3-4357-952f-912ee11c3462 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:36.507971 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661e043-07e3-4357-952f-912ee11c3462 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:36.508635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661e043-07e3-4357-952f-912ee11c3462 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:36.508933 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661e043-07e3-4357-952f-912ee11c3462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:36.510359 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661e043-07e3-4357-952f-912ee11c3462 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:36.519002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 615/1223] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:13:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:36.525571 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfa1bc-22c1-44a3-8f41-86906c72af71 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:36.571259 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:36.638715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfa1bc-22c1-44a3-8f41-86906c72af71 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:36.674225 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6677282-6f92-4e40-9a73-eb862c3594c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:36.674858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6677282-6f92-4e40-9a73-eb862c3594c3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:36.675133 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6677282-6f92-4e40-9a73-eb862c3594c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:36.675402 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6677282-6f92-4e40-9a73-eb862c3594c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:36.686077 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6677282-6f92-4e40-9a73-eb862c3594c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:36.687580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6677282-6f92-4e40-9a73-eb862c3594c3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:36.704566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a6677282-6f92-4e40-9a73-eb862c3594c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:36.704566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:36.704566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:36.704566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:36.704566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:36.704566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:36.704566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:36.704566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:36.704566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:36.704566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:36.704566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:36.704566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:36.704566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:13:36.704566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:13:36.704566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:13:36.704566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:36.705924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:13:36.707153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:13:36.707153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:36.707153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:13:36.707153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 609/1224] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:36.712224 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661e043-07e3-4357-952f-912ee11c3462 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:36.814233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661e043-07e3-4357-952f-912ee11c3462 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:36.850322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3751a1e-ef33-4f61-b469-1990f71e9d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:36.850937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3751a1e-ef33-4f61-b469-1990f71e9d87 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:36.851212 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3751a1e-ef33-4f61-b469-1990f71e9d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:36.851481 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3751a1e-ef33-4f61-b469-1990f71e9d87 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:36.852112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3751a1e-ef33-4f61-b469-1990f71e9d87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:36.852409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3751a1e-ef33-4f61-b469-1990f71e9d87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:36.853803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3751a1e-ef33-4f61-b469-1990f71e9d87 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:36.865975 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 616/1225] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:13:36.873107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6677282-6f92-4e40-9a73-eb862c3594c3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:36.972710 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:36.982511 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6677282-6f92-4e40-9a73-eb862c3594c3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:37.019153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a645fa-3ff8-4337-a73a-73f0b3906a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:37.019791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a645fa-3ff8-4337-a73a-73f0b3906a3c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:37.020066 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a645fa-3ff8-4337-a73a-73f0b3906a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:37.020346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a645fa-3ff8-4337-a73a-73f0b3906a3c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:37.027963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a645fa-3ff8-4337-a73a-73f0b3906a3c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:37.029404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a645fa-3ff8-4337-a73a-73f0b3906a3c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:37.041488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-78a645fa-3ff8-4337-a73a-73f0b3906a3c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:13:37.041488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:37.041488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:37.041488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:37.041488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:37.041488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:37.041488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:37.041488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:37.041488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:37.041488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:37.041488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:37.041488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:37.041488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:13:37.041488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:13:37.041488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:13:37.041488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:37.043265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:37.045105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:37.045105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:37.045105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:13:37.045105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:13:37.045105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:13:37.045105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:13:37.045105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:13:37.045105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:13:37.045105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:13:37.045105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:13:37.049604 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 610/1226] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:37.049782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3751a1e-ef33-4f61-b469-1990f71e9d87 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:37.100592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:37.155974 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3751a1e-ef33-4f61-b469-1990f71e9d87 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:37.193489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fb247-233a-4ca3-9e27-be3f2ad661fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:37.194128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fb247-233a-4ca3-9e27-be3f2ad661fe None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:37.194404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fb247-233a-4ca3-9e27-be3f2ad661fe None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:37.195276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fb247-233a-4ca3-9e27-be3f2ad661fe None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:37.196001 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fb247-233a-4ca3-9e27-be3f2ad661fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:37.196302 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fb247-233a-4ca3-9e27-be3f2ad661fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:37.197853 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fb247-233a-4ca3-9e27-be3f2ad661fe None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:37.216189 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 617/1227] 10.222.0.82 () {56 vars in 1143 bytes} [Fri Sep 23 15:13:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:37.223587 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a645fa-3ff8-4337-a73a-73f0b3906a3c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:37.334499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a645fa-3ff8-4337-a73a-73f0b3906a3c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:37.368999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096a9fb-dcc8-4dd4-9546-2b6fc2197f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:37.369561 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096a9fb-dcc8-4dd4-9546-2b6fc2197f9d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:37.369940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096a9fb-dcc8-4dd4-9546-2b6fc2197f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:37.370214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096a9fb-dcc8-4dd4-9546-2b6fc2197f9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:37.380870 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096a9fb-dcc8-4dd4-9546-2b6fc2197f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:37.382372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096a9fb-dcc8-4dd4-9546-2b6fc2197f9d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:37.396496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c096a9fb-dcc8-4dd4-9546-2b6fc2197f9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:37.396496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:37.396496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:37.396496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:37.396496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:37.396496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:37.396496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:37.396496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:37.396496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:37.396496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:37.396496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:37.396496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:37.396496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:13:37.396496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:13:37.396496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:13:37.396496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:37.397785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:13:37.398874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:13:37.398874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:37.398874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:13:37.398874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 611/1228] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:37.403706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fb247-233a-4ca3-9e27-be3f2ad661fe None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:37.505867 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fb247-233a-4ca3-9e27-be3f2ad661fe None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:37.508210 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:37.539557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ff684-7738-451b-9d53-0e6b340615ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:37.540165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ff684-7738-451b-9d53-0e6b340615ac None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:37.540453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ff684-7738-451b-9d53-0e6b340615ac None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:37.540712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ff684-7738-451b-9d53-0e6b340615ac None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:37.541402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ff684-7738-451b-9d53-0e6b340615ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:37.541707 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ff684-7738-451b-9d53-0e6b340615ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:37.550168 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ff684-7738-451b-9d53-0e6b340615ac None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:37.555000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 618/1229] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:37.560799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096a9fb-dcc8-4dd4-9546-2b6fc2197f9d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:37.571761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:37.677345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096a9fb-dcc8-4dd4-9546-2b6fc2197f9d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:37.715028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216bdfb-38b5-4510-8d2c-965a33a65095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:37.715796 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216bdfb-38b5-4510-8d2c-965a33a65095 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:37.716113 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216bdfb-38b5-4510-8d2c-965a33a65095 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:37.716416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216bdfb-38b5-4510-8d2c-965a33a65095 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:37.725088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216bdfb-38b5-4510-8d2c-965a33a65095 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:37.727436 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216bdfb-38b5-4510-8d2c-965a33a65095 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:37.740304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3216bdfb-38b5-4510-8d2c-965a33a65095 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:13:37.740304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:37.740304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:37.740304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:37.740304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:37.740304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:37.740304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:37.740304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:37.740304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:37.740304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:37.740304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:37.740304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:37.740304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:13:37.740304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:13:37.740304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:37.741484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:37.746936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:13:37.746936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:13:37.746936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:13:37.746936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:13:37.746936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:13:37.746936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:13:37.746936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:13:37.746936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:13:37.746936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 612/1230] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:13:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:37.747674 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ff684-7738-451b-9d53-0e6b340615ac None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:37.865247 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ff684-7738-451b-9d53-0e6b340615ac None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:37.902595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950424a-580b-4937-b022-50cfd73f59fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:37.903209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950424a-580b-4937-b022-50cfd73f59fc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:37.903483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950424a-580b-4937-b022-50cfd73f59fc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:37.903753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950424a-580b-4937-b022-50cfd73f59fc None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:37.904452 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950424a-580b-4937-b022-50cfd73f59fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:37.904785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950424a-580b-4937-b022-50cfd73f59fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:37.906274 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950424a-580b-4937-b022-50cfd73f59fc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:37.919351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 619/1231] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:13:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:37.925817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216bdfb-38b5-4510-8d2c-965a33a65095 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:38.004576 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:38.043624 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216bdfb-38b5-4510-8d2c-965a33a65095 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:38.077615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e609b-d008-46eb-95fc-ab3f2241b738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:38.078341 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e609b-d008-46eb-95fc-ab3f2241b738 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:38.078614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e609b-d008-46eb-95fc-ab3f2241b738 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:38.078880 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e609b-d008-46eb-95fc-ab3f2241b738 None admin] PATH_INFO: `/v3/projects/718a472b7d564c429849b127a44aaaad/users/a25109eeb1b34b3689b10e3f7c44a6b9/roles/118b4b27bab54b429c3a70924d659c72` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:38.099092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e609b-d008-46eb-95fc-ab3f2241b738 None admin] RBAC: Authorizing `identity:create_grant(project_id=718a472b7d564c429849b127a44aaaad, user_id=a25109eeb1b34b3689b10e3f7c44a6b9, role_id=118b4b27bab54b429c3a70924d659c72)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:38.101654 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e609b-d008-46eb-95fc-ab3f2241b738 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:38.496482 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 613/1232] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:13:37 2022] PUT /identity/v3/projects/718a472b7d564c429849b127a44aaaad/users/a25109eeb1b34b3689b10e3f7c44a6b9/roles/118b4b27bab54b429c3a70924d659c72 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:13:40.680725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42829c8-867e-443c-a463-a92672ef23d8 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:40.681330 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42829c8-867e-443c-a463-a92672ef23d8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:40.681330 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42829c8-867e-443c-a463-a92672ef23d8 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:40.682623 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 620/1233] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:13:40.688416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b10c7-7f9c-4491-bbaa-6df71f81d8c0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:40.688902 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b10c7-7f9c-4491-bbaa-6df71f81d8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:40.689024 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b10c7-7f9c-4491-bbaa-6df71f81d8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:40.715044 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bf3b10c7-7f9c-4491-bbaa-6df71f81d8c0 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:13:40.716306 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bf3b10c7-7f9c-4491-bbaa-6df71f81d8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:13:40.812890 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 614/1234] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:13:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:13:41.093986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42829c8-867e-443c-a463-a92672ef23d8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:41.134081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:41.263626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42829c8-867e-443c-a463-a92672ef23d8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:41.309467 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1ce30-ca97-4ec2-a1f4-3f7e7fc039e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:41.310535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1ce30-ca97-4ec2-a1f4-3f7e7fc039e9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:41.310919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1ce30-ca97-4ec2-a1f4-3f7e7fc039e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:41.311199 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1ce30-ca97-4ec2-a1f4-3f7e7fc039e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:41.325653 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1ce30-ca97-4ec2-a1f4-3f7e7fc039e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:13:41.330976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8bf1ce30-ca97-4ec2-a1f4-3f7e7fc039e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:13:41.330976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:41.330976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:41.330976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:41.330976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:41.330976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:41.330976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:41.330976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:41.330976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:41.330976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:41.330976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:41.330976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:41.330976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:13:41.330976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:13:41.330976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:13:41.330976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:13:41.332791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:13:41.332791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:13:41.332791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:13:41.332791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:13:41.332791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:41.332791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:41.332791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:41.332791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:41.332791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:41.332791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:41.332791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:41.332791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:41.332791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:41.332791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:41.332791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:41.332791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:41.334511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:41.334511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:41.334511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:41.334511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:41.334511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:13:41.334511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:13:41.334511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:13:41.334511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:13:41.334511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:13:41.334511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:13:41.334511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 15:13:41.334511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:13:41.334511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 621/1235] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Sep 23 15:13:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:41.342878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b10c7-7f9c-4491-bbaa-6df71f81d8c0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:41.405461 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:41.468618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b10c7-7f9c-4491-bbaa-6df71f81d8c0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:41.512129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325d9ae-91ac-4a4e-8fe2-f4d9d8547767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:41.512746 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325d9ae-91ac-4a4e-8fe2-f4d9d8547767 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:41.513019 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325d9ae-91ac-4a4e-8fe2-f4d9d8547767 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:41.513293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325d9ae-91ac-4a4e-8fe2-f4d9d8547767 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:41.514094 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325d9ae-91ac-4a4e-8fe2-f4d9d8547767 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:41.514332 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325d9ae-91ac-4a4e-8fe2-f4d9d8547767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:41.515701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325d9ae-91ac-4a4e-8fe2-f4d9d8547767 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:41.524406 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 615/1236] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Sep 23 15:13:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:41.530575 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1ce30-ca97-4ec2-a1f4-3f7e7fc039e9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:41.630277 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:41.652870 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1ce30-ca97-4ec2-a1f4-3f7e7fc039e9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:41.693845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55223207-69cf-4d64-8678-3311e355eb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:41.695584 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55223207-69cf-4d64-8678-3311e355eb9c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:41.696140 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55223207-69cf-4d64-8678-3311e355eb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:41.696740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55223207-69cf-4d64-8678-3311e355eb9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:41.709650 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55223207-69cf-4d64-8678-3311e355eb9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:41.711451 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55223207-69cf-4d64-8678-3311e355eb9c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:41.727223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-55223207-69cf-4d64-8678-3311e355eb9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:41.727223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:41.727223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:41.727223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:41.727223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:41.727223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:41.727223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:41.727223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:41.727223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:41.727223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:41.727223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:41.727223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:41.727223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:13:41.727223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:13:41.727223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:13:41.727223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:41.729278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:13:41.731438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:13:41.731438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:41.731438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:13:41.731438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 622/1237] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:41.735163 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325d9ae-91ac-4a4e-8fe2-f4d9d8547767 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:41.855851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325d9ae-91ac-4a4e-8fe2-f4d9d8547767 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:41.865055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:41.907874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc00ee-b9a5-4a8b-9808-e37310d9336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:41.909203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc00ee-b9a5-4a8b-9808-e37310d9336b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:41.910027 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc00ee-b9a5-4a8b-9808-e37310d9336b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:41.910766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc00ee-b9a5-4a8b-9808-e37310d9336b None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:41.914798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc00ee-b9a5-4a8b-9808-e37310d9336b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:41.914798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc00ee-b9a5-4a8b-9808-e37310d9336b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:41.914798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc00ee-b9a5-4a8b-9808-e37310d9336b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:41.927764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 616/1238] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:41.934472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55223207-69cf-4d64-8678-3311e355eb9c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:42.076921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55223207-69cf-4d64-8678-3311e355eb9c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:42.114355 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8e84f-ca79-4408-bf86-f04dd75f9266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:42.114926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8e84f-ca79-4408-bf86-f04dd75f9266 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:42.115193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8e84f-ca79-4408-bf86-f04dd75f9266 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:42.115462 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8e84f-ca79-4408-bf86-f04dd75f9266 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:42.119838 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:42.127285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8e84f-ca79-4408-bf86-f04dd75f9266 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:42.128920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8e84f-ca79-4408-bf86-f04dd75f9266 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:42.141393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8cc8e84f-ca79-4408-bf86-f04dd75f9266 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:13:42.141393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:42.141393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:42.141393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:42.141393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:42.141393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:42.141393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:42.141393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:42.141393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:42.141393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:42.141393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:42.141393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:42.141393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:13:42.141393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:13:42.141393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:13:42.141393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:42.143019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:42.144724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:42.144724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:42.144724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:13:42.144724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:13:42.144724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:13:42.144724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:13:42.144724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:13:42.144724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:13:42.144724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:13:42.144724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:13:42.144724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 623/1239] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:42.151094 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc00ee-b9a5-4a8b-9808-e37310d9336b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:42.271463 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc00ee-b9a5-4a8b-9808-e37310d9336b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:42.326676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafa97b-b9be-4578-9252-c76c0cf6579b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:42.327718 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafa97b-b9be-4578-9252-c76c0cf6579b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:42.328221 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafa97b-b9be-4578-9252-c76c0cf6579b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:42.328692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafa97b-b9be-4578-9252-c76c0cf6579b None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:42.330358 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafa97b-b9be-4578-9252-c76c0cf6579b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:42.330923 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafa97b-b9be-4578-9252-c76c0cf6579b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:42.333825 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafa97b-b9be-4578-9252-c76c0cf6579b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:42.354151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 617/1240] 10.222.0.82 () {56 vars in 1143 bytes} [Fri Sep 23 15:13:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:42.360420 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8e84f-ca79-4408-bf86-f04dd75f9266 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:42.501449 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8e84f-ca79-4408-bf86-f04dd75f9266 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:42.542588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedca868-cc30-413e-914d-834bb195ef45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:42.551852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedca868-cc30-413e-914d-834bb195ef45 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:42.551852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedca868-cc30-413e-914d-834bb195ef45 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:42.551852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedca868-cc30-413e-914d-834bb195ef45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:42.611412 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:42.618826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedca868-cc30-413e-914d-834bb195ef45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:42.620367 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedca868-cc30-413e-914d-834bb195ef45 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:42.726896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 624/1241] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:13:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:13:42.733913 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafa97b-b9be-4578-9252-c76c0cf6579b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:42.770615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:42.860731 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafa97b-b9be-4578-9252-c76c0cf6579b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:42.907826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf58ba3-b53b-4f8a-b960-0b2c37d5662b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:42.908618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf58ba3-b53b-4f8a-b960-0b2c37d5662b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:42.909000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf58ba3-b53b-4f8a-b960-0b2c37d5662b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:42.909408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf58ba3-b53b-4f8a-b960-0b2c37d5662b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:42.925311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf58ba3-b53b-4f8a-b960-0b2c37d5662b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:42.926826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf58ba3-b53b-4f8a-b960-0b2c37d5662b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:42.943364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0bf58ba3-b53b-4f8a-b960-0b2c37d5662b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:42.943364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:42.943364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:42.943364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:42.943364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:42.943364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:42.943364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:42.943364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:42.943364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:42.943364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:42.943364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:42.943364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:42.943364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:13:42.943364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:13:42.943364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:13:42.943364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:13:42.947121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:13:42.947121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:42.947121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:13:42.947121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 618/1242] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:42.951044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedca868-cc30-413e-914d-834bb195ef45 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:43.084808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:43.093136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedca868-cc30-413e-914d-834bb195ef45 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:43.142578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301ba1d-6867-46c8-af7f-c6308de7be72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:43.143449 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ba1d-6867-46c8-af7f-c6308de7be72 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:43.143854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ba1d-6867-46c8-af7f-c6308de7be72 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:43.144251 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ba1d-6867-46c8-af7f-c6308de7be72 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:43.145212 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301ba1d-6867-46c8-af7f-c6308de7be72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:43.145656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301ba1d-6867-46c8-af7f-c6308de7be72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:43.147804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301ba1d-6867-46c8-af7f-c6308de7be72 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:43.168817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 625/1243] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:13:43.177546 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf58ba3-b53b-4f8a-b960-0b2c37d5662b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:43.285566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:43.309889 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf58ba3-b53b-4f8a-b960-0b2c37d5662b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:43.344978 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce61267-0531-4e96-a8a5-94b24da7cd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:43.345582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce61267-0531-4e96-a8a5-94b24da7cd3e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:43.345938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce61267-0531-4e96-a8a5-94b24da7cd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:43.346256 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce61267-0531-4e96-a8a5-94b24da7cd3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:43.354085 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce61267-0531-4e96-a8a5-94b24da7cd3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:43.355525 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce61267-0531-4e96-a8a5-94b24da7cd3e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:43.382719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-2ce61267-0531-4e96-a8a5-94b24da7cd3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:13:43.382719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:43.382719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:43.382719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:43.382719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:43.382719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:43.382719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:43.382719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:43.382719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:43.382719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:43.382719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:43.382719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:43.382719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:13:43.382719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:13:43.382719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:43.384063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:43.385677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:13:43.385677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:13:43.385677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:13:43.385677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:13:43.385677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:13:43.385677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:13:43.385677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:13:43.385677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:13:43.385677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 619/1244] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:43.397783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301ba1d-6867-46c8-af7f-c6308de7be72 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:43.530626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301ba1d-6867-46c8-af7f-c6308de7be72 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:43.567476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023eed3-e157-4158-a15b-4af0fca58123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:43.568083 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023eed3-e157-4158-a15b-4af0fca58123 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:43.568358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023eed3-e157-4158-a15b-4af0fca58123 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:43.568630 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023eed3-e157-4158-a15b-4af0fca58123 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:43.569334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023eed3-e157-4158-a15b-4af0fca58123 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:43.569617 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023eed3-e157-4158-a15b-4af0fca58123 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:43.571137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023eed3-e157-4158-a15b-4af0fca58123 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:43.585433 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 626/1245] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:43.596032 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce61267-0531-4e96-a8a5-94b24da7cd3e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:43.722322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce61267-0531-4e96-a8a5-94b24da7cd3e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:43.758961 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0076998-bc3c-470e-a63b-141923987c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:43.759592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0076998-bc3c-470e-a63b-141923987c89 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:43.759859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0076998-bc3c-470e-a63b-141923987c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:43.760126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0076998-bc3c-470e-a63b-141923987c89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:43.760855 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0076998-bc3c-470e-a63b-141923987c89 None admin] RBAC: Adding query filter params (role.id=118b4b27bab54b429c3a70924d659c72, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=a25109eeb1b34b3689b10e3f7c44a6b9) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:43.761154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0076998-bc3c-470e-a63b-141923987c89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:43.762622 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0076998-bc3c-470e-a63b-141923987c89 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:43.769428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 620/1246] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:13:43 2022] GET /identity/v3/role_assignments?user.id=a25109eeb1b34b3689b10e3f7c44a6b9&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=118b4b27bab54b429c3a70924d659c72 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:46.201101 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf885efb-66bf-4525-bef8-28ac3382e9b0 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:46.202090 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf885efb-66bf-4525-bef8-28ac3382e9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:46.202090 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf885efb-66bf-4525-bef8-28ac3382e9b0 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:46.203652 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 627/1247] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:13:46.212842 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566c4b1-670b-44f5-b2b2-0a2aad47b687 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:46.213381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566c4b1-670b-44f5-b2b2-0a2aad47b687 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:46.213546 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566c4b1-670b-44f5-b2b2-0a2aad47b687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:46.223199 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:46.241540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f566c4b1-670b-44f5-b2b2-0a2aad47b687 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:13:46.243698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f566c4b1-670b-44f5-b2b2-0a2aad47b687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:13:46.317975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 621/1248] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:13:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:13:46.592242 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf885efb-66bf-4525-bef8-28ac3382e9b0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:46.611291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:46.697725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf885efb-66bf-4525-bef8-28ac3382e9b0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:46.738232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d34df5-4e23-49a8-9b96-05cab17dcfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:46.738880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d34df5-4e23-49a8-9b96-05cab17dcfa2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:46.739182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d34df5-4e23-49a8-9b96-05cab17dcfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:46.739420 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d34df5-4e23-49a8-9b96-05cab17dcfa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:46.751167 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d34df5-4e23-49a8-9b96-05cab17dcfa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:13:46.755958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e3d34df5-4e23-49a8-9b96-05cab17dcfa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:13:46.755958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:46.755958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:46.755958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:46.755958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:46.755958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:46.755958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:46.755958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:46.755958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:46.755958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:46.755958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:46.755958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:46.755958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:13:46.755958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:13:46.755958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:13:46.755958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:13:46.757675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:13:46.757675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:13:46.757675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:13:46.757675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:13:46.757675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:46.757675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:46.757675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:46.757675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:46.757675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:46.757675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:46.757675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:46.757675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:46.757675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:46.757675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:46.757675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:46.757675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:46.759394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:46.759394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:46.759394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:46.759394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:46.759394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:13:46.759394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:13:46.759394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:13:46.759394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:13:46.759394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:13:46.759394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:13:46.759394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:13:46.759394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:13:46.759394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 628/1249] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:13:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:46.766741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566c4b1-670b-44f5-b2b2-0a2aad47b687 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:46.882247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566c4b1-670b-44f5-b2b2-0a2aad47b687 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:46.912505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:46.918142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca603fc8-9e09-417b-9535-9a90bf5dc630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:46.918747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca603fc8-9e09-417b-9535-9a90bf5dc630 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:46.919024 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca603fc8-9e09-417b-9535-9a90bf5dc630 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:46.919294 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca603fc8-9e09-417b-9535-9a90bf5dc630 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:46.919961 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca603fc8-9e09-417b-9535-9a90bf5dc630 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:46.920262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca603fc8-9e09-417b-9535-9a90bf5dc630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:46.921905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca603fc8-9e09-417b-9535-9a90bf5dc630 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:46.930381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 622/1250] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:13:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:46.936660 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d34df5-4e23-49a8-9b96-05cab17dcfa2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:47.032555 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:47.057271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d34df5-4e23-49a8-9b96-05cab17dcfa2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:47.092273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4ead8-be5f-4157-85a4-7ee47a088246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:47.092922 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4ead8-be5f-4157-85a4-7ee47a088246 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:47.093212 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4ead8-be5f-4157-85a4-7ee47a088246 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:47.093478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4ead8-be5f-4157-85a4-7ee47a088246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:47.104935 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4ead8-be5f-4157-85a4-7ee47a088246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:47.106563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4ead8-be5f-4157-85a4-7ee47a088246 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:47.120936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-66e4ead8-be5f-4157-85a4-7ee47a088246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:47.120936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:47.120936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:47.120936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:47.120936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:47.120936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:47.120936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:47.120936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:47.120936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:47.120936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:47.120936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:47.120936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:47.120936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:13:47.120936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:13:47.120936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:13:47.120936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:47.122184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:13:47.123324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:13:47.123324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:47.123324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:13:47.123324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 629/1251] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:13:47.128124 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca603fc8-9e09-417b-9535-9a90bf5dc630 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:47.239687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca603fc8-9e09-417b-9535-9a90bf5dc630 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:47.281223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a54dd9-f250-4854-b3c4-d6eb6e1e702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:47.281932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a54dd9-f250-4854-b3c4-d6eb6e1e702d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:47.282215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a54dd9-f250-4854-b3c4-d6eb6e1e702d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:47.282489 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a54dd9-f250-4854-b3c4-d6eb6e1e702d None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:47.283256 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a54dd9-f250-4854-b3c4-d6eb6e1e702d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:47.283592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a54dd9-f250-4854-b3c4-d6eb6e1e702d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:47.284971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a54dd9-f250-4854-b3c4-d6eb6e1e702d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:47.298702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 623/1252] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:47.307756 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4ead8-be5f-4157-85a4-7ee47a088246 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:47.419560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4ead8-be5f-4157-85a4-7ee47a088246 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:47.447567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:47.455614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3e6dc-bf27-4ad3-8a8b-6647b6e0aca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:47.456249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3e6dc-bf27-4ad3-8a8b-6647b6e0aca1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:47.456543 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3e6dc-bf27-4ad3-8a8b-6647b6e0aca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:47.456801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3e6dc-bf27-4ad3-8a8b-6647b6e0aca1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:47.465370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3e6dc-bf27-4ad3-8a8b-6647b6e0aca1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:47.466894 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3e6dc-bf27-4ad3-8a8b-6647b6e0aca1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:47.479230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c8c3e6dc-bf27-4ad3-8a8b-6647b6e0aca1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:13:47.479230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:47.479230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:47.479230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:47.479230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:47.479230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:47.479230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:47.479230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:47.479230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:47.479230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:47.479230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:47.479230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:47.479230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:13:47.479230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:13:47.479230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:13:47.479230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:47.480848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:47.490781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:47.490781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:47.490781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:13:47.490781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:13:47.490781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:13:47.490781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:13:47.490781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:13:47.490781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:13:47.490781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:13:47.490781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:13:47.490781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 630/1253] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:47.491982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a54dd9-f250-4854-b3c4-d6eb6e1e702d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:47.548338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:47.603299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a54dd9-f250-4854-b3c4-d6eb6e1e702d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:47.642142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d97a1-724f-4df9-aeb0-db3dd914c008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:47.642770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d97a1-724f-4df9-aeb0-db3dd914c008 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:47.643054 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d97a1-724f-4df9-aeb0-db3dd914c008 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:47.643330 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d97a1-724f-4df9-aeb0-db3dd914c008 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:47.644156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d97a1-724f-4df9-aeb0-db3dd914c008 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:47.644490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d97a1-724f-4df9-aeb0-db3dd914c008 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:47.645993 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d97a1-724f-4df9-aeb0-db3dd914c008 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:47.667807 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 624/1254] 10.222.0.82 () {56 vars in 1143 bytes} [Fri Sep 23 15:13:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:47.677670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3e6dc-bf27-4ad3-8a8b-6647b6e0aca1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:47.793826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3e6dc-bf27-4ad3-8a8b-6647b6e0aca1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:47.832655 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1006e-34ba-4c05-978e-c5e5630f0f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:47.833266 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1006e-34ba-4c05-978e-c5e5630f0f3f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:47.833543 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1006e-34ba-4c05-978e-c5e5630f0f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:47.833840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1006e-34ba-4c05-978e-c5e5630f0f3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:47.892749 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:47.905285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1006e-34ba-4c05-978e-c5e5630f0f3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:47.906865 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1006e-34ba-4c05-978e-c5e5630f0f3f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:48.015630 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 631/1255] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:13:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:13:48.022090 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d97a1-724f-4df9-aeb0-db3dd914c008 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:48.126797 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d97a1-724f-4df9-aeb0-db3dd914c008 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:48.141250 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:48.166914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c1c66-1dd1-4d79-9093-090266cd3373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:48.167549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c1c66-1dd1-4d79-9093-090266cd3373 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:48.167829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c1c66-1dd1-4d79-9093-090266cd3373 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:48.168098 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c1c66-1dd1-4d79-9093-090266cd3373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:48.178769 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c1c66-1dd1-4d79-9093-090266cd3373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:48.180732 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c1c66-1dd1-4d79-9093-090266cd3373 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:48.196270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-b90c1c66-1dd1-4d79-9093-090266cd3373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:48.196270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:48.196270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:48.196270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:48.196270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:48.196270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:48.196270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:48.196270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:48.196270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:48.196270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:48.196270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:48.196270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:48.196270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:13:48.196270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:13:48.196270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:13:48.196270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:48.197376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:13:48.198484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:13:48.198484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:48.198484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:13:48.198484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 625/1256] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 15:13:48.203937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1006e-34ba-4c05-978e-c5e5630f0f3f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:48.328588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:48.342090 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1006e-34ba-4c05-978e-c5e5630f0f3f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:48.378912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59810762-6dba-4799-b170-8d65e76e5b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:48.379441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59810762-6dba-4799-b170-8d65e76e5b95 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:48.379705 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59810762-6dba-4799-b170-8d65e76e5b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:48.380036 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59810762-6dba-4799-b170-8d65e76e5b95 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:48.380743 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59810762-6dba-4799-b170-8d65e76e5b95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:48.381055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59810762-6dba-4799-b170-8d65e76e5b95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:48.382518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59810762-6dba-4799-b170-8d65e76e5b95 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:48.398849 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 632/1257] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:48.404903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c1c66-1dd1-4d79-9093-090266cd3373 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:48.509358 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c1c66-1dd1-4d79-9093-090266cd3373 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:48.545356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dda02-ff1e-449f-a6bb-8d792cf60606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:48.546021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dda02-ff1e-449f-a6bb-8d792cf60606 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:48.546566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dda02-ff1e-449f-a6bb-8d792cf60606 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:48.546839 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dda02-ff1e-449f-a6bb-8d792cf60606 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:48.553581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dda02-ff1e-449f-a6bb-8d792cf60606 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:48.555710 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dda02-ff1e-449f-a6bb-8d792cf60606 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:48.566947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-9f1dda02-ff1e-449f-a6bb-8d792cf60606 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:13:48.566947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:48.566947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:48.566947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:48.566947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:48.566947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:48.566947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:48.566947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:48.566947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:48.566947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:48.566947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:48.566947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:48.566947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:13:48.566947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:13:48.566947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:48.568006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:48.575154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:13:48.575154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:13:48.575154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:13:48.575154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:13:48.575154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:13:48.575154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:13:48.575154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:13:48.575154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:13:48.575154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 626/1258] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:48.575675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59810762-6dba-4799-b170-8d65e76e5b95 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:48.695591 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59810762-6dba-4799-b170-8d65e76e5b95 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:48.765542 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570f1f6-cdfa-4edf-b639-8b46dc3f6ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:48.766679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570f1f6-cdfa-4edf-b639-8b46dc3f6ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:48.767182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570f1f6-cdfa-4edf-b639-8b46dc3f6ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:48.767577 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570f1f6-cdfa-4edf-b639-8b46dc3f6ed8 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:48.768911 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570f1f6-cdfa-4edf-b639-8b46dc3f6ed8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:48.769470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570f1f6-cdfa-4edf-b639-8b46dc3f6ed8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:48.772371 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570f1f6-cdfa-4edf-b639-8b46dc3f6ed8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:48.794927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 633/1259] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:48.805685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dda02-ff1e-449f-a6bb-8d792cf60606 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:48.842515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:48.931607 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dda02-ff1e-449f-a6bb-8d792cf60606 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:48.975166 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc518d52-b3e5-47bb-9eed-9755a3b45fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:48.975866 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc518d52-b3e5-47bb-9eed-9755a3b45fca None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:48.976145 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc518d52-b3e5-47bb-9eed-9755a3b45fca None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:48.976467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc518d52-b3e5-47bb-9eed-9755a3b45fca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:48.977212 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc518d52-b3e5-47bb-9eed-9755a3b45fca None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=a25109eeb1b34b3689b10e3f7c44a6b9) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:48.977519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc518d52-b3e5-47bb-9eed-9755a3b45fca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:48.979118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc518d52-b3e5-47bb-9eed-9755a3b45fca None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:48.985932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 627/1260] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:13:48 2022] GET /identity/v3/role_assignments?user.id=a25109eeb1b34b3689b10e3f7c44a6b9&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:51.166693 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761c106-c288-4a26-b980-1cc85e2279a9 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:51.167549 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761c106-c288-4a26-b980-1cc85e2279a9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:51.167706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761c106-c288-4a26-b980-1cc85e2279a9 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:51.169061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 634/1261] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:13:51.174778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b212c4-38dd-43ce-a503-bc8852ad9293 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:51.175194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b212c4-38dd-43ce-a503-bc8852ad9293 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:51.175304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b212c4-38dd-43ce-a503-bc8852ad9293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:51.193108 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-34b212c4-38dd-43ce-a503-bc8852ad9293 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:13:51.194310 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-34b212c4-38dd-43ce-a503-bc8852ad9293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:13:51.262942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 628/1262] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:13:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 15:13:51.534093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761c106-c288-4a26-b980-1cc85e2279a9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:51.545563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:51.638750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761c106-c288-4a26-b980-1cc85e2279a9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:51.675558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a445b-b502-427c-89a5-ce7ecbcb9b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:51.676224 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a445b-b502-427c-89a5-ce7ecbcb9b1d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:51.676507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a445b-b502-427c-89a5-ce7ecbcb9b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:51.676776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a445b-b502-427c-89a5-ce7ecbcb9b1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:51.688831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a445b-b502-427c-89a5-ce7ecbcb9b1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:13:51.697183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c66a445b-b502-427c-89a5-ce7ecbcb9b1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:13:51.697183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:51.697183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:51.697183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:51.697183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:51.697183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:51.697183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:51.697183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:51.697183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:51.697183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:51.697183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:51.697183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:51.697183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:13:51.697183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:13:51.697183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:13:51.697183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:13:51.698384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:13:51.698384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:13:51.698384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:13:51.698384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:13:51.698384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:51.698384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:51.698384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:51.698384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:51.698384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:51.698384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:51.698384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:51.698384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:51.698384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:51.698384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:51.698384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:51.698384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:51.699430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:51.699430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:51.699430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:51.699430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:51.699430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:13:51.699430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:13:51.699430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:13:51.699430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:13:51.699430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:13:51.699430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:13:51.699430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:13:51.699430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:13:51.699430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 635/1263] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:13:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:51.701378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b212c4-38dd-43ce-a503-bc8852ad9293 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:51.721086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:51.811385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b212c4-38dd-43ce-a503-bc8852ad9293 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:51.852573 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbcf4c-69e4-42b0-be8b-a5dc548ddf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:51.853372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbcf4c-69e4-42b0-be8b-a5dc548ddf12 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:51.853651 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbcf4c-69e4-42b0-be8b-a5dc548ddf12 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:51.853952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbcf4c-69e4-42b0-be8b-a5dc548ddf12 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:51.854626 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbcf4c-69e4-42b0-be8b-a5dc548ddf12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:51.854948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbcf4c-69e4-42b0-be8b-a5dc548ddf12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:51.856338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbcf4c-69e4-42b0-be8b-a5dc548ddf12 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:51.865840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 629/1264] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:13:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:51.872710 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a445b-b502-427c-89a5-ce7ecbcb9b1d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:51.954705 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:51.993323 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a445b-b502-427c-89a5-ce7ecbcb9b1d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:52.028093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978b965-5dbd-4cce-9b01-93ba810a214e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:52.028739 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978b965-5dbd-4cce-9b01-93ba810a214e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:52.029019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978b965-5dbd-4cce-9b01-93ba810a214e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:52.029288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978b965-5dbd-4cce-9b01-93ba810a214e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:52.040122 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978b965-5dbd-4cce-9b01-93ba810a214e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:52.041556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978b965-5dbd-4cce-9b01-93ba810a214e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:52.055970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c978b965-5dbd-4cce-9b01-93ba810a214e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:52.055970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:52.055970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:52.055970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:52.055970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:52.055970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:52.055970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:52.055970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:52.055970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:52.055970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:52.055970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:52.055970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:52.055970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:13:52.055970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:13:52.055970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:13:52.055970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:52.056995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:13:52.057965 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:13:52.057965 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:52.057965 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:13:52.057965 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 636/1265] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:52.064054 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbcf4c-69e4-42b0-be8b-a5dc548ddf12 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:52.147329 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:52.168160 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbcf4c-69e4-42b0-be8b-a5dc548ddf12 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:52.201103 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d8664-f45c-4358-8eab-453c42efafd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:52.201803 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8664-f45c-4358-8eab-453c42efafd3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:52.202085 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8664-f45c-4358-8eab-453c42efafd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:52.202357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8664-f45c-4358-8eab-453c42efafd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:52.202995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d8664-f45c-4358-8eab-453c42efafd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:52.203296 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d8664-f45c-4358-8eab-453c42efafd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:52.204650 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d8664-f45c-4358-8eab-453c42efafd3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:52.216049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 630/1266] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:52.221961 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978b965-5dbd-4cce-9b01-93ba810a214e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:52.323069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978b965-5dbd-4cce-9b01-93ba810a214e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:52.361943 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f0a95-8131-4745-ab32-b8d71cd2adb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:52.362574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f0a95-8131-4745-ab32-b8d71cd2adb1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:52.362851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f0a95-8131-4745-ab32-b8d71cd2adb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:52.363122 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f0a95-8131-4745-ab32-b8d71cd2adb1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:52.370551 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f0a95-8131-4745-ab32-b8d71cd2adb1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:52.371982 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f0a95-8131-4745-ab32-b8d71cd2adb1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:52.383240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8f6f0a95-8131-4745-ab32-b8d71cd2adb1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:13:52.383240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:52.383240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:52.383240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:52.383240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:52.383240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:52.383240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:52.383240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:52.383240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:52.383240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:52.383240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:52.383240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:52.383240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:13:52.383240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:13:52.383240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:13:52.383240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:52.384343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:52.385761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:52.385761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:52.385761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:13:52.385761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:13:52.385761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:13:52.385761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:13:52.385761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:13:52.385761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:13:52.385761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:13:52.385761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:13:52.385761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 637/1267] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:52.390526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d8664-f45c-4358-8eab-453c42efafd3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:52.400915 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:52.487758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d8664-f45c-4358-8eab-453c42efafd3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:52.520284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930300f-6746-4996-9338-68b105d7b1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:52.520885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930300f-6746-4996-9338-68b105d7b1ae None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:52.521161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930300f-6746-4996-9338-68b105d7b1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:52.521436 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930300f-6746-4996-9338-68b105d7b1ae None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:52.522177 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930300f-6746-4996-9338-68b105d7b1ae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:52.522482 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930300f-6746-4996-9338-68b105d7b1ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:52.524540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930300f-6746-4996-9338-68b105d7b1ae None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:52.541004 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 631/1268] 10.222.0.82 () {56 vars in 1143 bytes} [Fri Sep 23 15:13:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:52.547215 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f0a95-8131-4745-ab32-b8d71cd2adb1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:52.646482 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:52.649355 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f0a95-8131-4745-ab32-b8d71cd2adb1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:52.684033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98408-d3e9-49b5-b9d1-43abbdeb7e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:52.684652 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98408-d3e9-49b5-b9d1-43abbdeb7e1d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:52.684927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98408-d3e9-49b5-b9d1-43abbdeb7e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:52.685193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98408-d3e9-49b5-b9d1-43abbdeb7e1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:52.696981 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a98408-d3e9-49b5-b9d1-43abbdeb7e1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:52.698447 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a98408-d3e9-49b5-b9d1-43abbdeb7e1d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:52.711946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-22a98408-d3e9-49b5-b9d1-43abbdeb7e1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:52.711946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:52.711946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:52.711946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:52.711946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:52.711946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:52.711946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:52.711946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:52.711946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:52.711946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:52.711946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:52.711946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:52.711946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:13:52.711946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:13:52.711946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:13:52.711946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:52.712924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:13:52.716791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:13:52.716791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:52.716791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:13:52.716791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 638/1269] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:52.718833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930300f-6746-4996-9338-68b105d7b1ae None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:52.818519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930300f-6746-4996-9338-68b105d7b1ae None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:52.852156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af6efe-5ee0-4ccd-93b2-c992444d7cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:52.852762 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af6efe-5ee0-4ccd-93b2-c992444d7cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:52.853055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af6efe-5ee0-4ccd-93b2-c992444d7cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:52.853296 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af6efe-5ee0-4ccd-93b2-c992444d7cd6 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:52.853969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af6efe-5ee0-4ccd-93b2-c992444d7cd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:52.854266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af6efe-5ee0-4ccd-93b2-c992444d7cd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:52.855634 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af6efe-5ee0-4ccd-93b2-c992444d7cd6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:52.868430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 632/1270] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:52.874552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98408-d3e9-49b5-b9d1-43abbdeb7e1d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:52.909233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:52.983368 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98408-d3e9-49b5-b9d1-43abbdeb7e1d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:53.025716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7a873-340c-44df-b355-b6823fccf739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:53.027027 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7a873-340c-44df-b355-b6823fccf739 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:53.027540 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7a873-340c-44df-b355-b6823fccf739 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:53.028066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7a873-340c-44df-b355-b6823fccf739 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:53.043355 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7a873-340c-44df-b355-b6823fccf739 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:53.049056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7a873-340c-44df-b355-b6823fccf739 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:53.077595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-72a7a873-340c-44df-b355-b6823fccf739 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:13:53.077595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:53.077595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:53.077595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:53.077595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:53.077595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:53.077595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:53.077595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:53.077595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:53.077595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:53.077595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:53.077595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:53.077595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:13:53.077595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:13:53.077595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:53.078840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:53.080154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:13:53.080154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:13:53.080154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:13:53.080154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:13:53.080154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:13:53.080154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:13:53.080154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:13:53.080154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:13:53.080712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 639/1271] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:53.086932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af6efe-5ee0-4ccd-93b2-c992444d7cd6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:53.146399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:53.187869 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af6efe-5ee0-4ccd-93b2-c992444d7cd6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:53.225326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808de14-659a-4889-8f42-5a662344553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:53.226096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808de14-659a-4889-8f42-5a662344553d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:53.226229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808de14-659a-4889-8f42-5a662344553d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:53.227005 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808de14-659a-4889-8f42-5a662344553d None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:53.227741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808de14-659a-4889-8f42-5a662344553d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:53.228036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808de14-659a-4889-8f42-5a662344553d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:53.229453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808de14-659a-4889-8f42-5a662344553d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:53.243288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 633/1272] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:13:53.249602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7a873-340c-44df-b355-b6823fccf739 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:53.361579 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:53.370733 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7a873-340c-44df-b355-b6823fccf739 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:53.407246 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f65664-07f1-4e10-921a-5348d860e19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:53.407918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f65664-07f1-4e10-921a-5348d860e19d None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:53.408195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f65664-07f1-4e10-921a-5348d860e19d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:53.408475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f65664-07f1-4e10-921a-5348d860e19d None admin] PATH_INFO: `/v3/projects/718a472b7d564c429849b127a44aaaad/users/a25109eeb1b34b3689b10e3f7c44a6b9/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:53.410496 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f65664-07f1-4e10-921a-5348d860e19d None admin] RBAC: Authorizing `identity:create_grant(project_id=718a472b7d564c429849b127a44aaaad, user_id=a25109eeb1b34b3689b10e3f7c44a6b9, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:53.411859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f65664-07f1-4e10-921a-5348d860e19d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:53.577148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 640/1273] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Sep 23 15:13:53 2022] PUT /identity/v3/projects/718a472b7d564c429849b127a44aaaad/users/a25109eeb1b34b3689b10e3f7c44a6b9/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:13:55.760201 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50834-144a-4c66-854d-a2584fbe00b1 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:55.760742 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50834-144a-4c66-854d-a2584fbe00b1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:55.760834 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50834-144a-4c66-854d-a2584fbe00b1 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:55.762221 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 634/1274] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:13:55.768049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ae33c-9ded-486b-b1f2-8727a6ecb95c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:55.768662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ae33c-9ded-486b-b1f2-8727a6ecb95c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:55.768662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ae33c-9ded-486b-b1f2-8727a6ecb95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:55.787907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fa3ae33c-9ded-486b-b1f2-8727a6ecb95c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:13:55.789143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fa3ae33c-9ded-486b-b1f2-8727a6ecb95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:13:55.863612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 641/1275] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:13:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:13:56.134716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a50834-144a-4c66-854d-a2584fbe00b1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:56.245966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a50834-144a-4c66-854d-a2584fbe00b1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:56.264129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:56.282052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d297eb-8eea-4c96-9ab2-0109fe0484f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:56.282718 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d297eb-8eea-4c96-9ab2-0109fe0484f9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:56.282998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d297eb-8eea-4c96-9ab2-0109fe0484f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:56.283275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d297eb-8eea-4c96-9ab2-0109fe0484f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:56.294118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d297eb-8eea-4c96-9ab2-0109fe0484f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 15:13:56.299237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-97d297eb-8eea-4c96-9ab2-0109fe0484f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:13:56.299237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:56.299237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:56.299237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:56.299237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:56.299237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:56.299237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:56.299237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:56.299237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:56.299237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:56.299237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:56.299237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:56.299237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 15:13:56.299237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 15:13:56.299237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 15:13:56.299237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 15:13:56.300457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 15:13:56.300457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 15:13:56.300457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 15:13:56.300457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 15:13:56.300457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:56.300457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:56.300457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:56.300457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:56.300457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:56.300457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:56.300457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:56.300457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:56.300457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:56.300457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:56.300457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:56.300457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:56.301788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:56.301788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:56.301788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:56.301788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:56.301788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 15:13:56.301788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 15:13:56.301788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 15:13:56.301788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 15:13:56.301788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 15:13:56.301788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 15:13:56.301788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 15:13:56.301788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:13:56.301788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 635/1276] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Sep 23 15:13:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:56.307104 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ae33c-9ded-486b-b1f2-8727a6ecb95c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:56.388246 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:56.406461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ae33c-9ded-486b-b1f2-8727a6ecb95c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:56.439627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228917f0-b5e2-4cfd-a731-330967ea88c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:56.440232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228917f0-b5e2-4cfd-a731-330967ea88c0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:56.440507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228917f0-b5e2-4cfd-a731-330967ea88c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:56.440776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228917f0-b5e2-4cfd-a731-330967ea88c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:56.441430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228917f0-b5e2-4cfd-a731-330967ea88c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:56.441751 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228917f0-b5e2-4cfd-a731-330967ea88c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:56.443125 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228917f0-b5e2-4cfd-a731-330967ea88c0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:56.451403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 642/1277] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Sep 23 15:13:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:56.457346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d297eb-8eea-4c96-9ab2-0109fe0484f9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:56.561485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d297eb-8eea-4c96-9ab2-0109fe0484f9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:56.598325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf0b01-b464-4db2-bed5-bdc9e96280fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:56.598993 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf0b01-b464-4db2-bed5-bdc9e96280fb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:56.599303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf0b01-b464-4db2-bed5-bdc9e96280fb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:56.599541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf0b01-b464-4db2-bed5-bdc9e96280fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:56.610329 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf0b01-b464-4db2-bed5-bdc9e96280fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:56.611773 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf0b01-b464-4db2-bed5-bdc9e96280fb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:56.626289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ccdf0b01-b464-4db2-bed5-bdc9e96280fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:56.626289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:56.626289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:56.626289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:56.626289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:56.626289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:56.626289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:56.626289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:56.626289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:56.626289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:56.626289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:56.626289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:56.626289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:13:56.626289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:13:56.626289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:13:56.626289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:56.627334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:13:56.628341 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:13:56.628341 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:56.628341 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:13:56.628341 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 636/1278] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:56.633476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228917f0-b5e2-4cfd-a731-330967ea88c0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:56.734669 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228917f0-b5e2-4cfd-a731-330967ea88c0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:56.768510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fef9c-6bb7-40e1-8f6c-aef0503bd61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:56.769204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fef9c-6bb7-40e1-8f6c-aef0503bd61d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:56.769392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fef9c-6bb7-40e1-8f6c-aef0503bd61d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:56.769662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fef9c-6bb7-40e1-8f6c-aef0503bd61d None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:56.770331 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fef9c-6bb7-40e1-8f6c-aef0503bd61d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:56.770633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fef9c-6bb7-40e1-8f6c-aef0503bd61d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:56.772008 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fef9c-6bb7-40e1-8f6c-aef0503bd61d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:56.785184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 643/1279] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:13:56.791638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf0b01-b464-4db2-bed5-bdc9e96280fb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:56.822170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:56.891506 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf0b01-b464-4db2-bed5-bdc9e96280fb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:56.926225 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd6172-ff8b-4105-9d87-d167e5d75a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:56.926877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd6172-ff8b-4105-9d87-d167e5d75a94 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:56.927156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd6172-ff8b-4105-9d87-d167e5d75a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:56.927432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd6172-ff8b-4105-9d87-d167e5d75a94 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:56.936263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd6172-ff8b-4105-9d87-d167e5d75a94 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:56.937790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd6172-ff8b-4105-9d87-d167e5d75a94 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:56.950915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4cfd6172-ff8b-4105-9d87-d167e5d75a94 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:13:56.950915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:56.950915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:56.950915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:56.950915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:56.950915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:56.950915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:56.950915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:56.950915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:56.950915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:56.950915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:56.950915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:56.950915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 15:13:56.950915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 15:13:56.950915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 15:13:56.950915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:56.952087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:56.953058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:56.953058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:56.953058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 15:13:56.953058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 15:13:56.953058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 15:13:56.953058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 15:13:56.953058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 15:13:56.953058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 15:13:56.953058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 15:13:56.953058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:13:56.953058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 637/1280] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:56.958061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fef9c-6bb7-40e1-8f6c-aef0503bd61d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:56.963442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:57.055937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fef9c-6bb7-40e1-8f6c-aef0503bd61d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:57.091624 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299df77-9e98-4758-84a4-2c9965e69da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:57.092233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299df77-9e98-4758-84a4-2c9965e69da5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:57.092509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299df77-9e98-4758-84a4-2c9965e69da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:57.092780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299df77-9e98-4758-84a4-2c9965e69da5 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:57.093639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299df77-9e98-4758-84a4-2c9965e69da5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:57.093971 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299df77-9e98-4758-84a4-2c9965e69da5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:57.095417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299df77-9e98-4758-84a4-2c9965e69da5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:57.113112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 644/1281] 10.222.0.82 () {56 vars in 1143 bytes} [Fri Sep 23 15:13:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:57.119414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd6172-ff8b-4105-9d87-d167e5d75a94 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:57.213559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:57.222707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd6172-ff8b-4105-9d87-d167e5d75a94 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:57.256578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1be8b7-a8ca-41e1-a694-6b5d9c11aa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:57.257183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1be8b7-a8ca-41e1-a694-6b5d9c11aa83 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:57.257457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1be8b7-a8ca-41e1-a694-6b5d9c11aa83 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:57.257725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1be8b7-a8ca-41e1-a694-6b5d9c11aa83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:57.326540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1be8b7-a8ca-41e1-a694-6b5d9c11aa83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:57.327912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1be8b7-a8ca-41e1-a694-6b5d9c11aa83 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:57.414497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:57.424782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 638/1282] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Sep 23 15:13:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 15:13:57.431177 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299df77-9e98-4758-84a4-2c9965e69da5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:57.493616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:57.532645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299df77-9e98-4758-84a4-2c9965e69da5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:57.566257 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888296b-27a1-41f9-85b6-b496d9a696a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:57.566872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888296b-27a1-41f9-85b6-b496d9a696a7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:57.567145 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888296b-27a1-41f9-85b6-b496d9a696a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:57.567411 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888296b-27a1-41f9-85b6-b496d9a696a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:57.580916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888296b-27a1-41f9-85b6-b496d9a696a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:57.580916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888296b-27a1-41f9-85b6-b496d9a696a7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:57.592434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-9888296b-27a1-41f9-85b6-b496d9a696a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:57.592434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:57.592434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:57.592434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:57.592434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:57.592434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:57.592434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:57.592434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:57.592434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:57.592434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:57.592434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:57.592434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:57.592434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 15:13:57.592434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 15:13:57.592434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 15:13:57.592434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:57.593616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 15:13:57.594771 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 15:13:57.594771 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 15:13:57.594771 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:13:57.594771 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 645/1283] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:57.599326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1be8b7-a8ca-41e1-a694-6b5d9c11aa83 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:57.698221 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1be8b7-a8ca-41e1-a694-6b5d9c11aa83 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:57.732581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187c28f-f7ed-41bd-93f5-41c8b1193df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:57.733193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187c28f-f7ed-41bd-93f5-41c8b1193df2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:57.733484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187c28f-f7ed-41bd-93f5-41c8b1193df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:57.733775 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187c28f-f7ed-41bd-93f5-41c8b1193df2 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:57.734428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187c28f-f7ed-41bd-93f5-41c8b1193df2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:57.734730 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187c28f-f7ed-41bd-93f5-41c8b1193df2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:57.736088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187c28f-f7ed-41bd-93f5-41c8b1193df2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:57.748085 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 639/1284] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Sep 23 15:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:57.753778 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888296b-27a1-41f9-85b6-b496d9a696a7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:57.856969 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888296b-27a1-41f9-85b6-b496d9a696a7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:57.871750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:57.891237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28af73-2a44-4a4b-b38d-b90fe7abdcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:57.891860 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28af73-2a44-4a4b-b38d-b90fe7abdcb5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:57.892166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28af73-2a44-4a4b-b38d-b90fe7abdcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:57.892386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28af73-2a44-4a4b-b38d-b90fe7abdcb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:57.899347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28af73-2a44-4a4b-b38d-b90fe7abdcb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:57.900785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28af73-2a44-4a4b-b38d-b90fe7abdcb5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:57.911656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-4c28af73-2a44-4a4b-b38d-b90fe7abdcb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:13:57.911656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:13:57.911656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:13:57.911656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:13:57.911656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:13:57.911656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:13:57.911656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:13:57.911656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:13:57.911656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:13:57.911656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:13:57.911656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:13:57.911656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:13:57.911656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 15:13:57.911656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 15:13:57.911656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:13:57.912768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:13:57.913918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 15:13:57.913918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 15:13:57.913918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 15:13:57.913918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 15:13:57.913918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 15:13:57.913918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 15:13:57.913918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 15:13:57.913918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 23 15:13:57.913918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 646/1285] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Sep 23 15:13:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:13:57.919321 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187c28f-f7ed-41bd-93f5-41c8b1193df2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:57.972129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:13:58.021831 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187c28f-f7ed-41bd-93f5-41c8b1193df2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:58.055301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471b4bc-74a5-4aa6-91e5-2c8058fe219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:58.055903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471b4bc-74a5-4aa6-91e5-2c8058fe219c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:58.056176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471b4bc-74a5-4aa6-91e5-2c8058fe219c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:58.056444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471b4bc-74a5-4aa6-91e5-2c8058fe219c None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:58.057130 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471b4bc-74a5-4aa6-91e5-2c8058fe219c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:58.057432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471b4bc-74a5-4aa6-91e5-2c8058fe219c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:58.058903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471b4bc-74a5-4aa6-91e5-2c8058fe219c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:58.070781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 640/1286] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Sep 23 15:13:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:13:58.077128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28af73-2a44-4a4b-b38d-b90fe7abdcb5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:13:58.189794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28af73-2a44-4a4b-b38d-b90fe7abdcb5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:13:58.224155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218080a-62b2-4169-ad37-5cfa224547fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:13:58.224760 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218080a-62b2-4169-ad37-5cfa224547fb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:13:58.225044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218080a-62b2-4169-ad37-5cfa224547fb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:13:58.225308 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218080a-62b2-4169-ad37-5cfa224547fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:13:58.226063 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218080a-62b2-4169-ad37-5cfa224547fb None admin] RBAC: Adding query filter params (role.id=8d0092d5ad4d467fa020a2b9fbf55ceb, scope.project.id=718a472b7d564c429849b127a44aaaad, user.id=a25109eeb1b34b3689b10e3f7c44a6b9) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:13:58.226368 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218080a-62b2-4169-ad37-5cfa224547fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:13:58.228379 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218080a-62b2-4169-ad37-5cfa224547fb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:13:58.234438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 647/1287] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Sep 23 15:13:58 2022] GET /identity/v3/role_assignments?user.id=a25109eeb1b34b3689b10e3f7c44a6b9&scope.project.id=718a472b7d564c429849b127a44aaaad&role.id=8d0092d5ad4d467fa020a2b9fbf55ceb => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:14:00.485103 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009964f7-79bb-4e29-bc5e-fc8ed8d7d797 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:00.485783 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009964f7-79bb-4e29-bc5e-fc8ed8d7d797 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:00.485783 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009964f7-79bb-4e29-bc5e-fc8ed8d7d797 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:00.487171 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 641/1288] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:14:00.492499 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b36577-b20b-42d5-b9b1-fd2db36e6e56 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:00.493081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b36577-b20b-42d5-b9b1-fd2db36e6e56 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:00.493081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b36577-b20b-42d5-b9b1-fd2db36e6e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:00.512546 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-19b36577-b20b-42d5-b9b1-fd2db36e6e56 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:14:00.513756 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-19b36577-b20b-42d5-b9b1-fd2db36e6e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:14:00.551596 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:14:00.589160 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 648/1289] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:14:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:14:00.860554 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009964f7-79bb-4e29-bc5e-fc8ed8d7d797 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:14:00.967637 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009964f7-79bb-4e29-bc5e-fc8ed8d7d797 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:14:00.979309 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:14:01.003275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207fa0d-737e-4355-8b50-221720cc345d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:14:01.003926 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207fa0d-737e-4355-8b50-221720cc345d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:01.004208 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207fa0d-737e-4355-8b50-221720cc345d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:01.004503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207fa0d-737e-4355-8b50-221720cc345d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:01.005085 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207fa0d-737e-4355-8b50-221720cc345d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:14:01.006501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207fa0d-737e-4355-8b50-221720cc345d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4207fa0d-737e-4355-8b50-221720cc345d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:14:01.015925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:14:01.019924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:14:01.019924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:14:01.019924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:14:01.019924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:14:01.019924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:14:01.019924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:14:01.019924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:14:01.019924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:14:01.019924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:14:01.019924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:14:01.019924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:14:01.019924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:14:01.019924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:14:01.019924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:14:01.019924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:14:01.019924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:14:01.020924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:14:01.020924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:14:01.020924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:14:01.020924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:14:01.020924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:14:01.020924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:14:01.020924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:14:01.020924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:14:01.020924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:14:01.020924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:14:01.020924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:14:01.020924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:14:01.020924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:14:01.020924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:14:01.020924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 642/1290] 10.222.0.82 () {56 vars in 1117 bytes} [Fri Sep 23 15:14:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:14:01.023421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b36577-b20b-42d5-b9b1-fd2db36e6e56 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:14:01.127611 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b36577-b20b-42d5-b9b1-fd2db36e6e56 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:14:01.163006 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fae00b-59cf-470e-9955-74133caaea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:14:01.166830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fae00b-59cf-470e-9955-74133caaea96 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:01.166830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fae00b-59cf-470e-9955-74133caaea96 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:01.166830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fae00b-59cf-470e-9955-74133caaea96 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:01.166830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fae00b-59cf-470e-9955-74133caaea96 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:14:01.166830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fae00b-59cf-470e-9955-74133caaea96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:14:01.166830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fae00b-59cf-470e-9955-74133caaea96 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:14:01.171962 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 649/1291] 10.222.0.82 () {56 vars in 1116 bytes} [Fri Sep 23 15:14:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:14:01.178089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207fa0d-737e-4355-8b50-221720cc345d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:14:01.279770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207fa0d-737e-4355-8b50-221720cc345d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:14:01.315116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9d8e0-5e38-48eb-bb72-4f6ff537655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:14:01.315728 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d8e0-5e38-48eb-bb72-4f6ff537655a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:01.316009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d8e0-5e38-48eb-bb72-4f6ff537655a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:01.316284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d8e0-5e38-48eb-bb72-4f6ff537655a None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:01.316909 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9d8e0-5e38-48eb-bb72-4f6ff537655a None admin] RBAC: Adding query filter params (type=placement) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:14:01.317214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9d8e0-5e38-48eb-bb72-4f6ff537655a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:14:01.318687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9d8e0-5e38-48eb-bb72-4f6ff537655a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:14:01.323199 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 643/1292] 10.222.0.82 () {56 vars in 1116 bytes} [Fri Sep 23 15:14:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:14:03.485667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30315d54-2cec-4f84-866b-1af58daf83d9 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:03.486269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30315d54-2cec-4f84-866b-1af58daf83d9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:03.486269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30315d54-2cec-4f84-866b-1af58daf83d9 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:03.487636 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 650/1293] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:14:03.493692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c1fbe-1b88-4d96-b0ca-2773040c01f0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:03.494197 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c1fbe-1b88-4d96-b0ca-2773040c01f0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:03.494321 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c1fbe-1b88-4d96-b0ca-2773040c01f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:03.513038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e16c1fbe-1b88-4d96-b0ca-2773040c01f0 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:14:03.514258 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e16c1fbe-1b88-4d96-b0ca-2773040c01f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:14:03.543825 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:14:03.581151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 644/1294] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:14:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:14:03.855243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30315d54-2cec-4f84-866b-1af58daf83d9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:14:03.886792 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:14:03.957664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30315d54-2cec-4f84-866b-1af58daf83d9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:14:04.010795 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556233af-dc4f-4d8a-b511-ac09c8f7b22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:14:04.011843 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556233af-dc4f-4d8a-b511-ac09c8f7b22d None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:04.012347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556233af-dc4f-4d8a-b511-ac09c8f7b22d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:04.012845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556233af-dc4f-4d8a-b511-ac09c8f7b22d None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:04.013950 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556233af-dc4f-4d8a-b511-ac09c8f7b22d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:14:04.020177 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556233af-dc4f-4d8a-b511-ac09c8f7b22d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:14:04.147837 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 651/1295] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Sep 23 15:14:03 2022] POST /identity/v3/services => generated 246 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:14:06.360790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c129b8-c603-49f6-be40-b5baffcf883e None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:06.361358 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c129b8-c603-49f6-be40-b5baffcf883e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:06.361358 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c129b8-c603-49f6-be40-b5baffcf883e None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:06.362670 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 645/1296] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:14:06.369293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f0486-0eae-46bd-8cc6-f8e93d70f909 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:06.369888 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f0486-0eae-46bd-8cc6-f8e93d70f909 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:06.369888 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f0486-0eae-46bd-8cc6-f8e93d70f909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:06.389902 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-795f0486-0eae-46bd-8cc6-f8e93d70f909 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:14:06.394115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-795f0486-0eae-46bd-8cc6-f8e93d70f909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:14:06.471426 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 652/1297] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:14:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:14:06.744545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c129b8-c603-49f6-be40-b5baffcf883e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:14:06.850047 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c129b8-c603-49f6-be40-b5baffcf883e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:14:06.884695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f92d2-b3b6-4cb5-8388-434e9ba5a55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:14:06.885329 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f92d2-b3b6-4cb5-8388-434e9ba5a55f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:06.885611 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f92d2-b3b6-4cb5-8388-434e9ba5a55f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:06.885911 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f92d2-b3b6-4cb5-8388-434e9ba5a55f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:06.886498 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f92d2-b3b6-4cb5-8388-434e9ba5a55f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:14:06.887871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f92d2-b3b6-4cb5-8388-434e9ba5a55f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e22f92d2-b3b6-4cb5-8388-434e9ba5a55f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:14:06.896932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:14:06.898288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:14:06.898288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:14:06.898288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:14:06.898288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:14:06.898288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:14:06.898288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:14:06.898288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:14:06.898288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:14:06.898288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:14:06.898288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:14:06.898288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:14:06.898288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:14:06.898288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:14:06.898288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:14:06.898288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:14:06.898288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:14:06.900028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:14:06.900028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:14:06.900028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:14:06.900028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:14:06.900028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:14:06.900028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:14:06.900028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:14:06.900028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:14:06.900028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:14:06.900028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:14:06.900028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:14:06.900028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:14:06.900028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:14:06.900028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:14:06.900028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 646/1298] 10.222.0.82 () {56 vars in 1117 bytes} [Fri Sep 23 15:14:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:14:06.904839 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f0486-0eae-46bd-8cc6-f8e93d70f909 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:14:06.924173 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:14:07.005935 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f0486-0eae-46bd-8cc6-f8e93d70f909 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:14:07.040411 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70128293-8272-4330-9a8d-b50488e12ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:14:07.041007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70128293-8272-4330-9a8d-b50488e12ade None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:07.041281 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70128293-8272-4330-9a8d-b50488e12ade None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:07.041547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70128293-8272-4330-9a8d-b50488e12ade None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:07.042196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70128293-8272-4330-9a8d-b50488e12ade None admin] RBAC: Adding query filter params (name=placement) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:14:07.042493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70128293-8272-4330-9a8d-b50488e12ade None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:14:07.043876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70128293-8272-4330-9a8d-b50488e12ade None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:14:07.050006 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 653/1299] 10.222.0.82 () {56 vars in 1116 bytes} [Fri Sep 23 15:14:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:14:07.056104 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f92d2-b3b6-4cb5-8388-434e9ba5a55f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:14:07.087989 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:14:07.155383 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f92d2-b3b6-4cb5-8388-434e9ba5a55f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:14:07.191711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e442d7-f204-47ce-9af3-907cbd3b2bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:14:07.192317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e442d7-f204-47ce-9af3-907cbd3b2bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:07.192594 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e442d7-f204-47ce-9af3-907cbd3b2bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:07.192883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e442d7-f204-47ce-9af3-907cbd3b2bb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:07.193560 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e442d7-f204-47ce-9af3-907cbd3b2bb5 None admin] RBAC: Adding query filter params (interface=public, service_id=626336809df24a6c98ecb7f409cdffd6, region_id=RegionOne) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:14:07.193895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e442d7-f204-47ce-9af3-907cbd3b2bb5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:14:07.195245 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e442d7-f204-47ce-9af3-907cbd3b2bb5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:14:07.200255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 647/1300] 10.222.0.82 () {56 vars in 1251 bytes} [Fri Sep 23 15:14:07 2022] GET /identity/v3/endpoints?service_id=626336809df24a6c98ecb7f409cdffd6&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:14:07.206123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70128293-8272-4330-9a8d-b50488e12ade None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:14:07.287554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:14:07.306341 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70128293-8272-4330-9a8d-b50488e12ade None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:14:07.341833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8846f-4bc0-4ab1-a236-54ba50e7cc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:14:07.342463 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8846f-4bc0-4ab1-a236-54ba50e7cc80 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:07.342747 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8846f-4bc0-4ab1-a236-54ba50e7cc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:07.343024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8846f-4bc0-4ab1-a236-54ba50e7cc80 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:07.343633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8846f-4bc0-4ab1-a236-54ba50e7cc80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:14:07.345010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8846f-4bc0-4ab1-a236-54ba50e7cc80 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:14:07.351870 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 654/1301] 10.222.0.82 () {56 vars in 1087 bytes} [Fri Sep 23 15:14:07 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:14:09.531127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61928d-a516-405e-8f36-a2675a6c3945 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:09.531692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61928d-a516-405e-8f36-a2675a6c3945 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:09.531692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61928d-a516-405e-8f36-a2675a6c3945 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:09.533023 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 648/1302] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:14:09.538629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a819c8-8a83-4f3b-a157-cb59182a2933 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:09.539106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a819c8-8a83-4f3b-a157-cb59182a2933 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:09.539261 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a819c8-8a83-4f3b-a157-cb59182a2933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:09.559541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-31a819c8-8a83-4f3b-a157-cb59182a2933 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:14:09.560772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-31a819c8-8a83-4f3b-a157-cb59182a2933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:14:09.628721 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 655/1303] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:14:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 15:14:09.900466 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61928d-a516-405e-8f36-a2675a6c3945 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:14:09.995664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:14:10.002424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61928d-a516-405e-8f36-a2675a6c3945 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:14:10.035520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af988433-a7b9-424e-bb41-0f0619907ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:14:10.036146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af988433-a7b9-424e-bb41-0f0619907ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:10.036416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af988433-a7b9-424e-bb41-0f0619907ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:10.036684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af988433-a7b9-424e-bb41-0f0619907ce5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:10.037256 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af988433-a7b9-424e-bb41-0f0619907ce5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:14:10.038640 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af988433-a7b9-424e-bb41-0f0619907ce5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-af988433-a7b9-424e-bb41-0f0619907ce5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 15:14:10.048011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 15:14:10.049063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 15:14:10.049063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 15:14:10.049063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 15:14:10.049063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 15:14:10.049063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 15:14:10.049063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 15:14:10.049063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 15:14:10.049063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 15:14:10.049063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 15:14:10.049063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 15:14:10.049063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 15:14:10.049063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 15:14:10.049063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 15:14:10.049063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 15:14:10.049063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 15:14:10.049063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 15:14:10.050034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 15:14:10.050034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 23 15:14:10.050034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 15:14:10.050034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 23 15:14:10.050034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 15:14:10.050034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 15:14:10.050034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 15:14:10.050034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 23 15:14:10.050034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 15:14:10.050034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 23 15:14:10.050034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 15:14:10.050034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 15:14:10.050034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 15:14:10.050034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 23 15:14:10.050034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 649/1304] 10.222.0.82 () {56 vars in 1117 bytes} [Fri Sep 23 15:14:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 15:14:10.055220 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a819c8-8a83-4f3b-a157-cb59182a2933 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:14:10.129686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:14:10.152095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a819c8-8a83-4f3b-a157-cb59182a2933 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:14:10.186513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1c49c-4f93-4f11-885b-f4cc888be7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:14:10.187121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1c49c-4f93-4f11-885b-f4cc888be7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:10.187399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1c49c-4f93-4f11-885b-f4cc888be7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:10.187712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1c49c-4f93-4f11-885b-f4cc888be7a2 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:10.188294 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1c49c-4f93-4f11-885b-f4cc888be7a2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:14:10.188595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1c49c-4f93-4f11-885b-f4cc888be7a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:14:10.189997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1c49c-4f93-4f11-885b-f4cc888be7a2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:14:10.195169 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 656/1305] 10.222.0.82 () {56 vars in 1116 bytes} [Fri Sep 23 15:14:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:14:10.201250 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af988433-a7b9-424e-bb41-0f0619907ce5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:14:10.301897 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af988433-a7b9-424e-bb41-0f0619907ce5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:14:10.335353 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89ec03-88b1-45cd-9aa8-43fccbf76e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:14:10.335966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89ec03-88b1-45cd-9aa8-43fccbf76e4c None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:14:10.336250 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89ec03-88b1-45cd-9aa8-43fccbf76e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:14:10.336519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89ec03-88b1-45cd-9aa8-43fccbf76e4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:14:10.337782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89ec03-88b1-45cd-9aa8-43fccbf76e4c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:14:10.339153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89ec03-88b1-45cd-9aa8-43fccbf76e4c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:14:10.433540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 650/1306] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:14:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:14:20.234958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=30 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:14:20.428699 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:55.624031 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e76d1d-2dfc-42ec-b3ae-e402adfa7524 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:22:55.625185 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e76d1d-2dfc-42ec-b3ae-e402adfa7524 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:22:55.625927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e76d1d-2dfc-42ec-b3ae-e402adfa7524 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:22:55.628828 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 657/1307] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:22:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:22:55.634948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6a6ff-2391-46ef-b9bf-7d48eb5055ba None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:22:55.635622 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6a6ff-2391-46ef-b9bf-7d48eb5055ba None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:22:55.635622 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6a6ff-2391-46ef-b9bf-7d48eb5055ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:22:55.759524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ecc6a6ff-2391-46ef-b9bf-7d48eb5055ba None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:22:55.761614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ecc6a6ff-2391-46ef-b9bf-7d48eb5055ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:22:55.908632 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 651/1308] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:22:56.216370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9355a24-4bf2-4fba-aa4a-e241a0e9a5e7 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:22:56.216648 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9355a24-4bf2-4fba-aa4a-e241a0e9a5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:22:56.216979 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9355a24-4bf2-4fba-aa4a-e241a0e9a5e7 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:22:56.218564 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 658/1309] 10.222.0.82 () {54 vars in 964 bytes} [Fri Sep 23 15:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:22:56.225285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547f30d-78ad-44d3-a86e-daf2f35807f8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:22:56.226104 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547f30d-78ad-44d3-a86e-daf2f35807f8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:22:56.226269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547f30d-78ad-44d3-a86e-daf2f35807f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:22:56.343263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a547f30d-78ad-44d3-a86e-daf2f35807f8 None None] MFA Rules not processed for user `defbff3e8f934dab9c800c7207c1d539`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:22:56.345811 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a547f30d-78ad-44d3-a86e-daf2f35807f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:22:56.388143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:56.501050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 652/1310] 10.222.0.82 () {58 vars in 1061 bytes} [Fri Sep 23 15:22:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:22:56.514817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9355a24-4bf2-4fba-aa4a-e241a0e9a5e7 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:22:56.516917 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d9355a24-4bf2-4fba-aa4a-e241a0e9a5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:22:56.661324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9355a24-4bf2-4fba-aa4a-e241a0e9a5e7 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:22:56.772781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47269e6e-3458-40b7-819a-ee103f804fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:22:56.774105 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47269e6e-3458-40b7-819a-ee103f804fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:22:56.774795 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47269e6e-3458-40b7-819a-ee103f804fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:22:56.775274 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47269e6e-3458-40b7-819a-ee103f804fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:22:56.778159 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-47269e6e-3458-40b7-819a-ee103f804fa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:22:56.883763 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:22:56.962821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47269e6e-3458-40b7-819a-ee103f804fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:22:56.965035 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47269e6e-3458-40b7-819a-ee103f804fa8 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:22:56.991964 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 659/1311] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:22:59.585304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54465d6-4265-4c24-9c86-20a2810e35b0 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:22:59.586002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54465d6-4265-4c24-9c86-20a2810e35b0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:22:59.587088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54465d6-4265-4c24-9c86-20a2810e35b0 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:22:59.589609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 653/1312] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:22:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:22:59.595595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29a00d-cf10-4608-8d10-7c81a66b018a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:22:59.596137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29a00d-cf10-4608-8d10-7c81a66b018a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:22:59.596137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29a00d-cf10-4608-8d10-7c81a66b018a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:22:59.683360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6a29a00d-cf10-4608-8d10-7c81a66b018a None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:22:59.685642 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6a29a00d-cf10-4608-8d10-7c81a66b018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:22:59.828452 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 660/1313] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:23:00.129579 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcdd55-8d86-4189-a7ef-02b447659172 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:00.129885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcdd55-8d86-4189-a7ef-02b447659172 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:00.130178 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcdd55-8d86-4189-a7ef-02b447659172 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:00.131530 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 654/1314] 10.222.0.82 () {54 vars in 964 bytes} [Fri Sep 23 15:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:23:00.138490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ca35c-0c53-4963-a776-9a532b5584a2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:00.138775 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ca35c-0c53-4963-a776-9a532b5584a2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:00.139044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ca35c-0c53-4963-a776-9a532b5584a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:00.150831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:00.217074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ff2ca35c-0c53-4963-a776-9a532b5584a2 None None] MFA Rules not processed for user `defbff3e8f934dab9c800c7207c1d539`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:00.218241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ff2ca35c-0c53-4963-a776-9a532b5584a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:00.296438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 661/1315] 10.222.0.82 () {58 vars in 1061 bytes} [Fri Sep 23 15:23:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:23:00.306531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcdd55-8d86-4189-a7ef-02b447659172 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:23:00.308090 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d9dcdd55-8d86-4189-a7ef-02b447659172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:00.423919 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcdd55-8d86-4189-a7ef-02b447659172 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:23:00.506252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:00.508447 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a7946-d3db-4fef-a295-af6248b3dfb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:23:00.509051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a7946-d3db-4fef-a295-af6248b3dfb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:00.509325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a7946-d3db-4fef-a295-af6248b3dfb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:00.509594 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a7946-d3db-4fef-a295-af6248b3dfb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:00.511224 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ee0a7946-d3db-4fef-a295-af6248b3dfb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:00.625314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a7946-d3db-4fef-a295-af6248b3dfb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:23:00.626843 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a7946-d3db-4fef-a295-af6248b3dfb3 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:23:00.649195 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 655/1316] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:23:03.801851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237678a-6963-4a3f-96fc-405a2e8c1be9 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:03.802441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237678a-6963-4a3f-96fc-405a2e8c1be9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:03.802573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237678a-6963-4a3f-96fc-405a2e8c1be9 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:03.804094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 662/1317] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:23:03.809791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47a686-bbe7-4ca9-b2ff-2651ac07ee2d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:03.810244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47a686-bbe7-4ca9-b2ff-2651ac07ee2d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:03.810338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47a686-bbe7-4ca9-b2ff-2651ac07ee2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:03.879829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0f47a686-bbe7-4ca9-b2ff-2651ac07ee2d None None] MFA Rules not processed for user `782f736ae93442a9aea63bfca5ef7549`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:03.881086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0f47a686-bbe7-4ca9-b2ff-2651ac07ee2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:03.936358 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:03.983053 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 656/1318] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:23:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:23:04.271075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237678a-6963-4a3f-96fc-405a2e8c1be9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:23:04.272631 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c237678a-6963-4a3f-96fc-405a2e8c1be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:04.385681 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237678a-6963-4a3f-96fc-405a2e8c1be9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:23:04.388527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:04.464034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992951e-3794-4079-84e1-2a3b027a6586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:23:04.464684 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992951e-3794-4079-84e1-2a3b027a6586 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:04.464960 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992951e-3794-4079-84e1-2a3b027a6586 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:04.465229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992951e-3794-4079-84e1-2a3b027a6586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:04.466858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b992951e-3794-4079-84e1-2a3b027a6586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:04.580226 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992951e-3794-4079-84e1-2a3b027a6586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:23:04.581609 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992951e-3794-4079-84e1-2a3b027a6586 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:23:04.600624 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 663/1319] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:23:04 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:23:08.037041 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b423522-3a86-41a0-b6d4-80f32bb253ac None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:08.037697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b423522-3a86-41a0-b6d4-80f32bb253ac None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:08.037697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b423522-3a86-41a0-b6d4-80f32bb253ac None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:08.039022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 657/1320] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:23:08.045133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8194034-10f5-41ca-8f72-12187a669357 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:08.045690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8194034-10f5-41ca-8f72-12187a669357 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:08.045690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8194034-10f5-41ca-8f72-12187a669357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:08.103717 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:08.137427 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a8194034-10f5-41ca-8f72-12187a669357 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:08.138781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a8194034-10f5-41ca-8f72-12187a669357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:08.254549 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 664/1321] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:23:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:23:08.547563 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b423522-3a86-41a0-b6d4-80f32bb253ac None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:23:08.549138 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9b423522-3a86-41a0-b6d4-80f32bb253ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:08.664604 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b423522-3a86-41a0-b6d4-80f32bb253ac None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:23:08.751756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741a5b0-f6a5-4147-8d03-3366d6b8324d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:23:08.752365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741a5b0-f6a5-4147-8d03-3366d6b8324d service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:08.752645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741a5b0-f6a5-4147-8d03-3366d6b8324d service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:08.752915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741a5b0-f6a5-4147-8d03-3366d6b8324d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:08.754684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7741a5b0-f6a5-4147-8d03-3366d6b8324d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:08.763337 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:08.888627 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741a5b0-f6a5-4147-8d03-3366d6b8324d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:23:08.893904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741a5b0-f6a5-4147-8d03-3366d6b8324d service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:23:08.917224 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 658/1322] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:23:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:23:12.734867 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc39e6-8326-4b2b-b4c1-79ddeed4ae2b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:12.735690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc39e6-8326-4b2b-b4c1-79ddeed4ae2b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:12.736073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc39e6-8326-4b2b-b4c1-79ddeed4ae2b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:12.738784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 665/1323] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:23:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:23:12.748207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728062ad-afd6-404c-b844-3f0070073e8d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:12.749055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728062ad-afd6-404c-b844-3f0070073e8d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:12.749213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728062ad-afd6-404c-b844-3f0070073e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:12.831212 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-728062ad-afd6-404c-b844-3f0070073e8d None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:12.832495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-728062ad-afd6-404c-b844-3f0070073e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:12.904527 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:12.950629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 659/1324] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:23:13.244720 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc39e6-8326-4b2b-b4c1-79ddeed4ae2b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:23:13.246799 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5ccc39e6-8326-4b2b-b4c1-79ddeed4ae2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:13.390415 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc39e6-8326-4b2b-b4c1-79ddeed4ae2b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:23:13.406253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:13.504612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf41da-c826-49cc-af95-9123d4522a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:23:13.505852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf41da-c826-49cc-af95-9123d4522a81 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:13.506230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf41da-c826-49cc-af95-9123d4522a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:13.506639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf41da-c826-49cc-af95-9123d4522a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:13.508605 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c8bf41da-c826-49cc-af95-9123d4522a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:13.653265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf41da-c826-49cc-af95-9123d4522a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:23:13.654989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf41da-c826-49cc-af95-9123d4522a81 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:23:13.680286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 666/1325] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:23:16.060074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e5e31-bf97-4b93-9ae5-991d82487a06 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:16.060691 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e5e31-bf97-4b93-9ae5-991d82487a06 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:16.060691 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e5e31-bf97-4b93-9ae5-991d82487a06 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:16.062050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 660/1326] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:23:16.068669 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a27068-2363-4817-ad25-f3557536e863 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:16.069490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a27068-2363-4817-ad25-f3557536e863 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:16.069490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a27068-2363-4817-ad25-f3557536e863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:16.130749 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:16.154763 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e8a27068-2363-4817-ad25-f3557536e863 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:16.156274 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e8a27068-2363-4817-ad25-f3557536e863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:16.331563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 667/1327] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:23:16.627472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e5e31-bf97-4b93-9ae5-991d82487a06 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:23:16.632578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9a6e5e31-bf97-4b93-9ae5-991d82487a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:16.754065 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e5e31-bf97-4b93-9ae5-991d82487a06 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:23:16.847425 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1d1fe-2dd4-4abc-966f-dde1f1ab7248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:23:16.848042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1d1fe-2dd4-4abc-966f-dde1f1ab7248 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:16.848318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1d1fe-2dd4-4abc-966f-dde1f1ab7248 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:16.848586 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1d1fe-2dd4-4abc-966f-dde1f1ab7248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:16.850354 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2bf1d1fe-2dd4-4abc-966f-dde1f1ab7248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:16.871060 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:16.984877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1d1fe-2dd4-4abc-966f-dde1f1ab7248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:23:16.986492 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1d1fe-2dd4-4abc-966f-dde1f1ab7248 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:23:17.011318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 661/1328] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:23:19.373187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4405d8-126e-48d9-a53e-84bebfa8fbde None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:19.373776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4405d8-126e-48d9-a53e-84bebfa8fbde None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:19.373776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4405d8-126e-48d9-a53e-84bebfa8fbde None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:19.375106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 668/1329] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:23:19.384800 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a1b63-4c21-4203-950f-ef55907d0021 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:19.385342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a1b63-4c21-4203-950f-ef55907d0021 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:19.385808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a1b63-4c21-4203-950f-ef55907d0021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:19.474954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d86a1b63-4c21-4203-950f-ef55907d0021 None None] MFA Rules not processed for user `782f736ae93442a9aea63bfca5ef7549`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:19.476045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d86a1b63-4c21-4203-950f-ef55907d0021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:19.551726 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:19.595439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 662/1330] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:23:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:23:19.884450 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4405d8-126e-48d9-a53e-84bebfa8fbde None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:23:19.886132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ae4405d8-126e-48d9-a53e-84bebfa8fbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:20.009265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4405d8-126e-48d9-a53e-84bebfa8fbde None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:23:20.031460 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:20.087403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bb38c-d852-4b84-a129-6862a32042b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:23:20.092052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bb38c-d852-4b84-a129-6862a32042b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:20.092052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bb38c-d852-4b84-a129-6862a32042b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:20.092052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bb38c-d852-4b84-a129-6862a32042b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:20.092052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-664bb38c-d852-4b84-a129-6862a32042b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:20.215736 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664bb38c-d852-4b84-a129-6862a32042b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:23:20.217179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664bb38c-d852-4b84-a129-6862a32042b4 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:23:20.236172 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 669/1331] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:23:19 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:23:22.978944 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b750d-1584-4563-871a-ea796e564e8b None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:22.979539 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b750d-1584-4563-871a-ea796e564e8b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:22.979539 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b750d-1584-4563-871a-ea796e564e8b None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:22.980893 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 663/1332] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:23:22.986689 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a334148-1604-449f-a961-8a4c6a83fefb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:22.987163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a334148-1604-449f-a961-8a4c6a83fefb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:22.987277 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a334148-1604-449f-a961-8a4c6a83fefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:23.060063 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:23.063293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7a334148-1604-449f-a961-8a4c6a83fefb None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:23.064534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7a334148-1604-449f-a961-8a4c6a83fefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:23.182750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 670/1333] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:23:23.472579 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b750d-1584-4563-871a-ea796e564e8b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:23:23.474710 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b00b750d-1584-4563-871a-ea796e564e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:23.589314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b750d-1584-4563-871a-ea796e564e8b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:23:23.674791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeb4cd-5951-40e7-9821-6d5a155039f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:23:23.675414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeb4cd-5951-40e7-9821-6d5a155039f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:23.675714 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeb4cd-5951-40e7-9821-6d5a155039f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:23.675994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeb4cd-5951-40e7-9821-6d5a155039f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:23.677757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ecaeb4cd-5951-40e7-9821-6d5a155039f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:23.710770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:23.802343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaeb4cd-5951-40e7-9821-6d5a155039f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:23:23.803711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaeb4cd-5951-40e7-9821-6d5a155039f2 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:23:23.826368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 664/1334] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:23:26.078301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016faf0-bbe7-408a-9981-b0341f0ea7da None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:26.078864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016faf0-bbe7-408a-9981-b0341f0ea7da None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:26.078864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016faf0-bbe7-408a-9981-b0341f0ea7da None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:26.080186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 671/1335] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:23:26.085427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06f02c-fda9-46ff-87b6-aa40ac09c36e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:26.085848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06f02c-fda9-46ff-87b6-aa40ac09c36e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:26.086000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06f02c-fda9-46ff-87b6-aa40ac09c36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:26.153850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1b06f02c-fda9-46ff-87b6-aa40ac09c36e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:26.155063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1b06f02c-fda9-46ff-87b6-aa40ac09c36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:26.228908 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:26.251867 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 665/1336] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:23:26.536106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016faf0-bbe7-408a-9981-b0341f0ea7da None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:23:26.537648 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b016faf0-bbe7-408a-9981-b0341f0ea7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:26.646535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016faf0-bbe7-408a-9981-b0341f0ea7da None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:23:26.678470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:26.726483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd710bf-c1ef-41b2-88f6-590dc993e68f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:23:26.727933 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd710bf-c1ef-41b2-88f6-590dc993e68f service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:26.728391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd710bf-c1ef-41b2-88f6-590dc993e68f service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:26.729008 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd710bf-c1ef-41b2-88f6-590dc993e68f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:26.730721 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6fd710bf-c1ef-41b2-88f6-590dc993e68f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:26.845721 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd710bf-c1ef-41b2-88f6-590dc993e68f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:23:26.847061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd710bf-c1ef-41b2-88f6-590dc993e68f service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:23:26.866930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 672/1337] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:23:29.922498 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11222b41-8b06-4613-b799-4a04cd7fdeac None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:29.923113 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11222b41-8b06-4613-b799-4a04cd7fdeac None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:29.923113 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11222b41-8b06-4613-b799-4a04cd7fdeac None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:29.924935 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 666/1338] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:23:29.930927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eec55b-93c9-48ef-a2d8-7098eb9cf22f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:29.931547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eec55b-93c9-48ef-a2d8-7098eb9cf22f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:29.931547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eec55b-93c9-48ef-a2d8-7098eb9cf22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:30.009466 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-47eec55b-93c9-48ef-a2d8-7098eb9cf22f None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:30.010777 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-47eec55b-93c9-48ef-a2d8-7098eb9cf22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:30.020880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:30.186499 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 673/1339] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:23:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:23:30.472560 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11222b41-8b06-4613-b799-4a04cd7fdeac None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:23:30.474157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-11222b41-8b06-4613-b799-4a04cd7fdeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:30.587478 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11222b41-8b06-4613-b799-4a04cd7fdeac None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:23:30.666791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a8321-a076-424b-8500-ece8fe48d7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:23:30.667653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a8321-a076-424b-8500-ece8fe48d7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:30.667926 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a8321-a076-424b-8500-ece8fe48d7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:30.668189 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a8321-a076-424b-8500-ece8fe48d7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:30.669930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1f6a8321-a076-424b-8500-ece8fe48d7d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:30.709182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:30.789843 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a8321-a076-424b-8500-ece8fe48d7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:23:30.791234 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a8321-a076-424b-8500-ece8fe48d7d7 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:23:30.812694 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 667/1340] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:23:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:23:35.809050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53bb3c-8f1a-477b-b6d9-447bafbd7adf None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:35.809659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53bb3c-8f1a-477b-b6d9-447bafbd7adf None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:35.809659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53bb3c-8f1a-477b-b6d9-447bafbd7adf None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:35.811220 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 674/1341] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:23:35.817932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee856946-70ba-4792-b0ff-236c038be10e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:35.818507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee856946-70ba-4792-b0ff-236c038be10e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:35.818658 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee856946-70ba-4792-b0ff-236c038be10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:35.897372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ee856946-70ba-4792-b0ff-236c038be10e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:35.898659 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ee856946-70ba-4792-b0ff-236c038be10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:36.034461 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:36.059168 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 668/1342] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:23:36.379121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53bb3c-8f1a-477b-b6d9-447bafbd7adf None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:23:36.386578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bf53bb3c-8f1a-477b-b6d9-447bafbd7adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:36.520380 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53bb3c-8f1a-477b-b6d9-447bafbd7adf None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:23:36.594203 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:36.649982 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0caa28-ca9b-4ed8-9e50-e43da8d62b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:23:36.650978 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0caa28-ca9b-4ed8-9e50-e43da8d62b78 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:36.651468 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0caa28-ca9b-4ed8-9e50-e43da8d62b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:36.651995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0caa28-ca9b-4ed8-9e50-e43da8d62b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:36.655521 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2b0caa28-ca9b-4ed8-9e50-e43da8d62b78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:36.846318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0caa28-ca9b-4ed8-9e50-e43da8d62b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:23:36.849091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0caa28-ca9b-4ed8-9e50-e43da8d62b78 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:23:36.879240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 675/1343] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:23:40.526525 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98d551-1237-4b28-9f35-b59681251582 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:40.527056 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98d551-1237-4b28-9f35-b59681251582 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:40.527056 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98d551-1237-4b28-9f35-b59681251582 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:40.528469 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 669/1344] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:23:40.534316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e8be3-5465-4f33-aa7c-be3e84aded2d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:40.534951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e8be3-5465-4f33-aa7c-be3e84aded2d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:40.534951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e8be3-5465-4f33-aa7c-be3e84aded2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:40.615219 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-907e8be3-5465-4f33-aa7c-be3e84aded2d None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:40.616495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-907e8be3-5465-4f33-aa7c-be3e84aded2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:40.635505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:40.725128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 676/1345] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:23:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:23:41.016873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98d551-1237-4b28-9f35-b59681251582 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:23:41.018516 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bb98d551-1237-4b28-9f35-b59681251582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:41.145062 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98d551-1237-4b28-9f35-b59681251582 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:23:41.231978 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4c264-062f-45e2-b5a2-ed06d9a0fbd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:23:41.232523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4c264-062f-45e2-b5a2-ed06d9a0fbd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:41.232798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4c264-062f-45e2-b5a2-ed06d9a0fbd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:41.233063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4c264-062f-45e2-b5a2-ed06d9a0fbd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:41.234913 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1ca4c264-062f-45e2-b5a2-ed06d9a0fbd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:41.285871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:41.366106 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4c264-062f-45e2-b5a2-ed06d9a0fbd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:23:41.367694 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4c264-062f-45e2-b5a2-ed06d9a0fbd0 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:23:41.389813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 670/1346] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:23:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:23:46.097661 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614b5bc-6ae9-4a47-96e9-7872789839d4 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:46.098392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614b5bc-6ae9-4a47-96e9-7872789839d4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:46.098392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614b5bc-6ae9-4a47-96e9-7872789839d4 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:46.099603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 677/1347] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:23:46.106009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300b1c7-0b7d-4170-8e2e-810097d8370c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:46.106564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300b1c7-0b7d-4170-8e2e-810097d8370c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:46.106767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300b1c7-0b7d-4170-8e2e-810097d8370c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:46.182684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2300b1c7-0b7d-4170-8e2e-810097d8370c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:46.183904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2300b1c7-0b7d-4170-8e2e-810097d8370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:46.296693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:46.300069 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 671/1348] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:23:46.591317 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614b5bc-6ae9-4a47-96e9-7872789839d4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:23:46.592849 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f614b5bc-6ae9-4a47-96e9-7872789839d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:46.701895 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614b5bc-6ae9-4a47-96e9-7872789839d4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:23:46.755442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:46.784283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4669853-adf6-467d-98b0-27cddb502ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:23:46.785260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4669853-adf6-467d-98b0-27cddb502ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:46.785260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4669853-adf6-467d-98b0-27cddb502ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:46.785810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4669853-adf6-467d-98b0-27cddb502ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:46.787447 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d4669853-adf6-467d-98b0-27cddb502ab7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:46.903030 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4669853-adf6-467d-98b0-27cddb502ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:23:46.904509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4669853-adf6-467d-98b0-27cddb502ab7 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:23:46.928515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 678/1349] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:23:52.176022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862e1a0-1ece-42a3-a96b-c3f5a85e12bd None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:52.176483 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862e1a0-1ece-42a3-a96b-c3f5a85e12bd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:52.176593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862e1a0-1ece-42a3-a96b-c3f5a85e12bd None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:52.178286 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 672/1350] 10.222.0.82 () {54 vars in 921 bytes} [Fri Sep 23 15:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:23:52.185443 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e7476-49ea-40eb-9bd3-581ec56eb9bd None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:52.186020 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e7476-49ea-40eb-9bd3-581ec56eb9bd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:52.186020 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e7476-49ea-40eb-9bd3-581ec56eb9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:52.293482 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7d6e7476-49ea-40eb-9bd3-581ec56eb9bd None None] MFA Rules not processed for user `a25109eeb1b34b3689b10e3f7c44a6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:52.294890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7d6e7476-49ea-40eb-9bd3-581ec56eb9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:52.316837 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:52.435812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 679/1351] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Sep 23 15:23:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:23:57.108213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0eadc-b37f-4af9-bdbc-f68e50f8452a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:57.109174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0eadc-b37f-4af9-bdbc-f68e50f8452a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:57.110086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0eadc-b37f-4af9-bdbc-f68e50f8452a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:57.111131 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 673/1352] 10.222.0.82 () {54 vars in 921 bytes} [Fri Sep 23 15:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:23:57.117058 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0acc12-84cf-4d4e-b5e8-2a84becea7cb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:57.118162 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0acc12-84cf-4d4e-b5e8-2a84becea7cb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:57.118513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0acc12-84cf-4d4e-b5e8-2a84becea7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:57.200990 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4d0acc12-84cf-4d4e-b5e8-2a84becea7cb None None] MFA Rules not processed for user `a25109eeb1b34b3689b10e3f7c44a6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:57.202245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4d0acc12-84cf-4d4e-b5e8-2a84becea7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:57.283134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:23:57.325254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 680/1353] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Sep 23 15:23:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:23:58.689883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1260f-bc2d-440f-888f-04e7f6492d22 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:58.690535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1260f-bc2d-440f-888f-04e7f6492d22 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:58.690535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1260f-bc2d-440f-888f-04e7f6492d22 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:58.691803 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 674/1354] 10.222.0.82 () {54 vars in 921 bytes} [Fri Sep 23 15:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:23:58.697925 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea37a0c-ccc2-44ec-8ab6-e9b856454a1c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:23:58.698427 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea37a0c-ccc2-44ec-8ab6-e9b856454a1c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:23:58.698671 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea37a0c-ccc2-44ec-8ab6-e9b856454a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:23:58.785187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6ea37a0c-ccc2-44ec-8ab6-e9b856454a1c None None] MFA Rules not processed for user `a25109eeb1b34b3689b10e3f7c44a6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:23:58.786439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6ea37a0c-ccc2-44ec-8ab6-e9b856454a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:23:58.927713 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 681/1355] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Sep 23 15:23:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:02.452473 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870dfd-0f9c-45d3-9c0e-12d954266129 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:02.453125 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870dfd-0f9c-45d3-9c0e-12d954266129 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:02.453125 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870dfd-0f9c-45d3-9c0e-12d954266129 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:02.454401 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 675/1356] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:24:02.461175 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e61964-036a-4c51-98ed-958ce1157b40 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:02.461930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e61964-036a-4c51-98ed-958ce1157b40 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:02.462078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e61964-036a-4c51-98ed-958ce1157b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:02.538388 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:02.592734 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d0e61964-036a-4c51-98ed-958ce1157b40 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:02.594296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d0e61964-036a-4c51-98ed-958ce1157b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:02.737936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 682/1357] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:03.056538 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef7127-4d2a-434d-abd2-27853afeabc8 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:03.056859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef7127-4d2a-434d-abd2-27853afeabc8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:03.057110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef7127-4d2a-434d-abd2-27853afeabc8 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:03.060424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 676/1358] 10.222.0.82 () {54 vars in 961 bytes} [Fri Sep 23 15:24:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:24:03.068545 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f8515-0ccd-4ac4-a20b-9474f413c9ff None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:03.068849 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f8515-0ccd-4ac4-a20b-9474f413c9ff None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:03.069172 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f8515-0ccd-4ac4-a20b-9474f413c9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:03.162628 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ff2f8515-0ccd-4ac4-a20b-9474f413c9ff None None] MFA Rules not processed for user `6dbf682960cc447099c11862afa3206b`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:03.164009 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ff2f8515-0ccd-4ac4-a20b-9474f413c9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:03.225120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:03.309278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 683/1359] 10.222.0.82 () {58 vars in 1058 bytes} [Fri Sep 23 15:24:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:03.318030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef7127-4d2a-434d-abd2-27853afeabc8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:03.319541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a0ef7127-4d2a-434d-abd2-27853afeabc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:03.523541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef7127-4d2a-434d-abd2-27853afeabc8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:03.609392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:03.661213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d0878-8333-4f64-bada-97e6248f5dd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:03.661869 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0878-8333-4f64-bada-97e6248f5dd2 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:03.662148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0878-8333-4f64-bada-97e6248f5dd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:03.662420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0878-8333-4f64-bada-97e6248f5dd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:03.664134 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d26d0878-8333-4f64-bada-97e6248f5dd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:03.780543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d0878-8333-4f64-bada-97e6248f5dd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:03.782101 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d0878-8333-4f64-bada-97e6248f5dd2 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:03.805720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 677/1360] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:24:06.242022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315179f-a185-483f-b5e1-3edcb881d26d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:06.242466 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315179f-a185-483f-b5e1-3edcb881d26d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:06.242806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315179f-a185-483f-b5e1-3edcb881d26d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:06.254027 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 684/1361] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:24:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:24:06.254249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc60149-ea4c-4879-bb3f-b10a07aac6fb None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:06.254249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc60149-ea4c-4879-bb3f-b10a07aac6fb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:06.254249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc60149-ea4c-4879-bb3f-b10a07aac6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:06.345108 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fbc60149-ea4c-4879-bb3f-b10a07aac6fb None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:06.346258 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fbc60149-ea4c-4879-bb3f-b10a07aac6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:06.395643 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:06.460303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 678/1362] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:06.761095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315179f-a185-483f-b5e1-3edcb881d26d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:06.761095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a315179f-a185-483f-b5e1-3edcb881d26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:06.961466 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315179f-a185-483f-b5e1-3edcb881d26d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:06.972329 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:07.106031 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c2784-edf3-4d0f-96be-94a767fdc7b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:07.106566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c2784-edf3-4d0f-96be-94a767fdc7b0 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:07.106839 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c2784-edf3-4d0f-96be-94a767fdc7b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:07.107115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c2784-edf3-4d0f-96be-94a767fdc7b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:07.108689 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-392c2784-edf3-4d0f-96be-94a767fdc7b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:07.206961 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c2784-edf3-4d0f-96be-94a767fdc7b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:07.208859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c2784-edf3-4d0f-96be-94a767fdc7b0 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:07.227799 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 685/1363] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:24:10.084979 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f326040-1332-46bf-8364-987de1424387 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:10.085541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f326040-1332-46bf-8364-987de1424387 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:10.085541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f326040-1332-46bf-8364-987de1424387 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:10.087070 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 679/1364] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:24:10.092437 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cb3a4-9883-4a58-a13b-dbe2616afa8a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:10.093061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cb3a4-9883-4a58-a13b-dbe2616afa8a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:10.093061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cb3a4-9883-4a58-a13b-dbe2616afa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:10.113677 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:10.173792 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-341cb3a4-9883-4a58-a13b-dbe2616afa8a None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:10.175170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-341cb3a4-9883-4a58-a13b-dbe2616afa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:10.337483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 686/1365] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:10.631475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09955e58-d9c5-49ac-8986-46eaf2b01d6a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:10.632016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09955e58-d9c5-49ac-8986-46eaf2b01d6a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:10.632295 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09955e58-d9c5-49ac-8986-46eaf2b01d6a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:10.634031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 680/1366] 10.222.0.82 () {54 vars in 961 bytes} [Fri Sep 23 15:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:24:10.639170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ccbf2-09c0-438c-97da-54828382e090 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:10.639541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ccbf2-09c0-438c-97da-54828382e090 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:10.639757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ccbf2-09c0-438c-97da-54828382e090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:10.738963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1a5ccbf2-09c0-438c-97da-54828382e090 None None] MFA Rules not processed for user `6dbf682960cc447099c11862afa3206b`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:10.743590 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1a5ccbf2-09c0-438c-97da-54828382e090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:10.784322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:10.877229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 687/1367] 10.222.0.82 () {58 vars in 1058 bytes} [Fri Sep 23 15:24:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:10.886873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09955e58-d9c5-49ac-8986-46eaf2b01d6a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:10.888417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-09955e58-d9c5-49ac-8986-46eaf2b01d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:11.061322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09955e58-d9c5-49ac-8986-46eaf2b01d6a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:11.083675 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:11.116771 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bde170-d01c-4c6e-83eb-76616d218033 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:11.117305 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bde170-d01c-4c6e-83eb-76616d218033 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:11.117305 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bde170-d01c-4c6e-83eb-76616d218033 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:11.119354 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 688/1368] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:24:11.124087 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba1259-c6ed-4705-97d6-02332d8b42e0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:11.124376 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba1259-c6ed-4705-97d6-02332d8b42e0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:11.124636 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba1259-c6ed-4705-97d6-02332d8b42e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:11.197944 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192f75f-8c65-49da-9e6d-6d3b27670283 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:11.198526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f75f-8c65-49da-9e6d-6d3b27670283 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:11.198767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f75f-8c65-49da-9e6d-6d3b27670283 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:11.199008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f75f-8c65-49da-9e6d-6d3b27670283 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:11.200758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9192f75f-8c65-49da-9e6d-6d3b27670283 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:11.217615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-eeba1259-c6ed-4705-97d6-02332d8b42e0 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:11.218912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-eeba1259-c6ed-4705-97d6-02332d8b42e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:11.308101 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192f75f-8c65-49da-9e6d-6d3b27670283 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:11.310010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192f75f-8c65-49da-9e6d-6d3b27670283 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:11.323617 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:11.332927 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 681/1369] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:24:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:24:11.337696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 689/1370] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:24:11.681806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c943-1d1e-424c-a52e-61b060135290 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:11.682231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c943-1d1e-424c-a52e-61b060135290 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:11.682603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c943-1d1e-424c-a52e-61b060135290 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:11.684063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 682/1371] 10.222.0.82 () {54 vars in 963 bytes} [Fri Sep 23 15:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:24:11.690567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440be9e-c512-4ff0-810f-fb9bd9cd096b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:11.691001 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440be9e-c512-4ff0-810f-fb9bd9cd096b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:11.691370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440be9e-c512-4ff0-810f-fb9bd9cd096b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:11.799471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8440be9e-c512-4ff0-810f-fb9bd9cd096b None None] MFA Rules not processed for user `47bd08ee89014df281d0c0d5f8f6cabc`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:11.800914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8440be9e-c512-4ff0-810f-fb9bd9cd096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:11.891767 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 690/1372] 10.222.0.82 () {58 vars in 1060 bytes} [Fri Sep 23 15:24:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:11.901556 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966c943-1d1e-424c-a52e-61b060135290 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:11.903357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8966c943-1d1e-424c-a52e-61b060135290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:11.934269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:12.025991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966c943-1d1e-424c-a52e-61b060135290 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:12.107599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0e2de-c68c-4cf6-96d5-2510ef99e028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:12.108209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0e2de-c68c-4cf6-96d5-2510ef99e028 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:12.108488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0e2de-c68c-4cf6-96d5-2510ef99e028 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:12.108786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0e2de-c68c-4cf6-96d5-2510ef99e028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:12.111178 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-16d0e2de-c68c-4cf6-96d5-2510ef99e028 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:12.236266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:12.312547 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0e2de-c68c-4cf6-96d5-2510ef99e028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:12.315638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0e2de-c68c-4cf6-96d5-2510ef99e028 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:12.361276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 683/1373] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:24:13.824609 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d174d-5a22-4470-a0cb-052f14e8c340 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:13.825212 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d174d-5a22-4470-a0cb-052f14e8c340 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:13.825212 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d174d-5a22-4470-a0cb-052f14e8c340 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:13.826561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 691/1374] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:24:13.833825 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c4759-8b42-4b6e-9776-45121198cd95 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:13.834473 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c4759-8b42-4b6e-9776-45121198cd95 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:13.834971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c4759-8b42-4b6e-9776-45121198cd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:13.916399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0a0c4759-8b42-4b6e-9776-45121198cd95 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:13.917622 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0a0c4759-8b42-4b6e-9776-45121198cd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:14.041856 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 684/1375] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:14.335020 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d174d-5a22-4470-a0cb-052f14e8c340 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:14.336551 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-270d174d-5a22-4470-a0cb-052f14e8c340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:14.434418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:14.508588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d174d-5a22-4470-a0cb-052f14e8c340 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:14.646194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666922fc-5044-41c6-8e80-e77a58c54056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:14.646843 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666922fc-5044-41c6-8e80-e77a58c54056 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:14.647119 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666922fc-5044-41c6-8e80-e77a58c54056 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:14.647392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666922fc-5044-41c6-8e80-e77a58c54056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:14.649169 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-666922fc-5044-41c6-8e80-e77a58c54056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:14.709491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:14.788267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666922fc-5044-41c6-8e80-e77a58c54056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:14.789964 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666922fc-5044-41c6-8e80-e77a58c54056 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:14.812563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 692/1376] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:24:17.564464 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fddd0-9ca0-4d1d-b18c-662ee4e0631b None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:17.565170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fddd0-9ca0-4d1d-b18c-662ee4e0631b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:17.565170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fddd0-9ca0-4d1d-b18c-662ee4e0631b None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:17.567209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 685/1377] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:24:17.571597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2e1fa-b1b3-42e7-8d8a-c610dac3cbb1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:17.572032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2e1fa-b1b3-42e7-8d8a-c610dac3cbb1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:17.572123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2e1fa-b1b3-42e7-8d8a-c610dac3cbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:17.640855 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-21d2e1fa-b1b3-42e7-8d8a-c610dac3cbb1 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:17.642100 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-21d2e1fa-b1b3-42e7-8d8a-c610dac3cbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:17.753822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 693/1378] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:18.090876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fddd0-9ca0-4d1d-b18c-662ee4e0631b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:18.094601 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-790fddd0-9ca0-4d1d-b18c-662ee4e0631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:18.146930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:18.272714 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fddd0-9ca0-4d1d-b18c-662ee4e0631b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:18.397620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:18.403495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e990449-d60d-476d-864b-3060a9a53c2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:18.404076 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e990449-d60d-476d-864b-3060a9a53c2e service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:18.404359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e990449-d60d-476d-864b-3060a9a53c2e service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:18.404638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e990449-d60d-476d-864b-3060a9a53c2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:18.406984 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8e990449-d60d-476d-864b-3060a9a53c2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:18.523909 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e990449-d60d-476d-864b-3060a9a53c2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:18.526532 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e990449-d60d-476d-864b-3060a9a53c2e service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:18.549332 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 686/1379] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:24:21.074819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fc98b-e471-4cc3-ab14-b20c8d1baaf5 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:21.075447 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fc98b-e471-4cc3-ab14-b20c8d1baaf5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:21.075447 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fc98b-e471-4cc3-ab14-b20c8d1baaf5 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:21.076806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 694/1380] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:24:21.083709 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e761e-87fc-4443-9f25-5e23a5e7ccdf None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:21.084393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e761e-87fc-4443-9f25-5e23a5e7ccdf None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:21.084663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e761e-87fc-4443-9f25-5e23a5e7ccdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:21.175780 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-cc4e761e-87fc-4443-9f25-5e23a5e7ccdf None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:21.177053 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cc4e761e-87fc-4443-9f25-5e23a5e7ccdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:21.269914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:21.307114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 687/1381] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:21.619188 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fc98b-e471-4cc3-ab14-b20c8d1baaf5 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:21.621204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b55fc98b-e471-4cc3-ab14-b20c8d1baaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:21.673431 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:21.823286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fc98b-e471-4cc3-ab14-b20c8d1baaf5 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:21.939294 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:21.957525 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233888dd-3fcb-407d-8c4a-2b8e99f15c61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:21.958187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233888dd-3fcb-407d-8c4a-2b8e99f15c61 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:21.958472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233888dd-3fcb-407d-8c4a-2b8e99f15c61 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:21.958748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233888dd-3fcb-407d-8c4a-2b8e99f15c61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:21.960438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-233888dd-3fcb-407d-8c4a-2b8e99f15c61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:22.084062 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233888dd-3fcb-407d-8c4a-2b8e99f15c61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:22.086134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233888dd-3fcb-407d-8c4a-2b8e99f15c61 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:22.117082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 695/1382] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:24:24.661268 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212c02c-e358-4119-9936-20c4b1a614dc None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:24.661935 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212c02c-e358-4119-9936-20c4b1a614dc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:24.662410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212c02c-e358-4119-9936-20c4b1a614dc None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:24.664118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 688/1383] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:24:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:24:24.672554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e57c0-da4e-4882-9ff6-38fdfa2fac4d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:24.673292 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e57c0-da4e-4882-9ff6-38fdfa2fac4d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:24.673292 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e57c0-da4e-4882-9ff6-38fdfa2fac4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:24.770862 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5a2e57c0-da4e-4882-9ff6-38fdfa2fac4d None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:24.772132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5a2e57c0-da4e-4882-9ff6-38fdfa2fac4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:24.840675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:24.889009 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 696/1384] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:25.288866 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212c02c-e358-4119-9936-20c4b1a614dc None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:25.290449 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a212c02c-e358-4119-9936-20c4b1a614dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:25.477574 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212c02c-e358-4119-9936-20c4b1a614dc None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:25.552820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:25.644115 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997c58d-abf6-44fe-9238-1f6193670181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:25.644760 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997c58d-abf6-44fe-9238-1f6193670181 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:25.645048 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997c58d-abf6-44fe-9238-1f6193670181 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:25.645328 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997c58d-abf6-44fe-9238-1f6193670181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:25.647126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8997c58d-abf6-44fe-9238-1f6193670181 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:25.773173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997c58d-abf6-44fe-9238-1f6193670181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:25.775384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997c58d-abf6-44fe-9238-1f6193670181 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:25.799574 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 689/1385] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:24:28.081978 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112bbdb-031a-4d4c-9b54-da3310f03614 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:28.082913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112bbdb-031a-4d4c-9b54-da3310f03614 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:28.082913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112bbdb-031a-4d4c-9b54-da3310f03614 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:28.084208 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 697/1386] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:24:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:24:28.092637 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95baf36-bfa0-4fa9-be4a-f8ed105f83de None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:28.093448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95baf36-bfa0-4fa9-be4a-f8ed105f83de None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:28.093594 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95baf36-bfa0-4fa9-be4a-f8ed105f83de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:28.211778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f95baf36-bfa0-4fa9-be4a-f8ed105f83de None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:28.213356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f95baf36-bfa0-4fa9-be4a-f8ed105f83de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:28.224201 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:28.339777 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 690/1387] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:28.436422 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa60869-f96c-4d1e-b3ff-84f286e4be4a None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:28.436850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa60869-f96c-4d1e-b3ff-84f286e4be4a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:28.437255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa60869-f96c-4d1e-b3ff-84f286e4be4a None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:28.442118 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 698/1388] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:24:28.445722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa4bf0-6c58-487b-a4f0-fe85b8f08aa4 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:28.446015 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa4bf0-6c58-487b-a4f0-fe85b8f08aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:28.446285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa4bf0-6c58-487b-a4f0-fe85b8f08aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:28.529648 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-72aa4bf0-6c58-487b-a4f0-fe85b8f08aa4 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:28.531044 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-72aa4bf0-6c58-487b-a4f0-fe85b8f08aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:28.637060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa60869-f96c-4d1e-b3ff-84f286e4be4a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:28.640276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7fa60869-f96c-4d1e-b3ff-84f286e4be4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:28.658285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:28.671910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 691/1389] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:28.843686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa60869-f96c-4d1e-b3ff-84f286e4be4a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:28.899008 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:28.993560 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147179d-4a39-4247-88ac-fb7b3a4f94db None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:28.994024 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147179d-4a39-4247-88ac-fb7b3a4f94db None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:28.994413 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147179d-4a39-4247-88ac-fb7b3a4f94db None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:28.996072 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 692/1390] 10.222.0.82 () {54 vars in 962 bytes} [Fri Sep 23 15:24:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:24:29.003130 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca674ef-ef5c-40a6-8eef-054066351b2d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:29.003640 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca674ef-ef5c-40a6-8eef-054066351b2d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:29.004142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca674ef-ef5c-40a6-8eef-054066351b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:29.010824 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf60bd0-9ac4-4808-a5a6-888be94c4a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:29.011438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf60bd0-9ac4-4808-a5a6-888be94c4a85 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:29.011709 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf60bd0-9ac4-4808-a5a6-888be94c4a85 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:29.012002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf60bd0-9ac4-4808-a5a6-888be94c4a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:29.013915 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ebf60bd0-9ac4-4808-a5a6-888be94c4a85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:29.110901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fca674ef-ef5c-40a6-8eef-054066351b2d None None] MFA Rules not processed for user `1879a3ad7be74303b9feceff75f62979`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:29.112776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fca674ef-ef5c-40a6-8eef-054066351b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:29.131588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf60bd0-9ac4-4808-a5a6-888be94c4a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:29.135285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf60bd0-9ac4-4808-a5a6-888be94c4a85 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:29.155441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 699/1391] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:24:29.209356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 693/1392] 10.222.0.82 () {58 vars in 1059 bytes} [Fri Sep 23 15:24:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:24:29.219511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf60bd0-9ac4-4808-a5a6-888be94c4a85 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:29.220750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ebf60bd0-9ac4-4808-a5a6-888be94c4a85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:29.279302 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:29.317520 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf60bd0-9ac4-4808-a5a6-888be94c4a85 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:29.404469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11442e01-60f4-4f17-9a25-27a62ef36861 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1879a3ad7be74303b9feceff75f62979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:29.405060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11442e01-60f4-4f17-9a25-27a62ef36861 service glance] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:29.405345 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11442e01-60f4-4f17-9a25-27a62ef36861 service glance] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:29.405918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11442e01-60f4-4f17-9a25-27a62ef36861 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:29.407736 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-11442e01-60f4-4f17-9a25-27a62ef36861 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:29.573559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11442e01-60f4-4f17-9a25-27a62ef36861 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:29.575688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11442e01-60f4-4f17-9a25-27a62ef36861 service glance] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:29.605108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 700/1393] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:24:30.751833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84a80d-2149-430e-afcb-b729acc5de20 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:30.752977 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84a80d-2149-430e-afcb-b729acc5de20 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:30.757963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84a80d-2149-430e-afcb-b729acc5de20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:30.869972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2f84a80d-2149-430e-afcb-b729acc5de20 None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:30.877912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2f84a80d-2149-430e-afcb-b729acc5de20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:30.940339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:31.035052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 694/1394] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Sep 23 15:24:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:31.107040 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cfcbe-2e7c-4ad2-bb18-30ecf06482b2 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:31.107998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cfcbe-2e7c-4ad2-bb18-30ecf06482b2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:31.108219 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cfcbe-2e7c-4ad2-bb18-30ecf06482b2 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:31.110646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 701/1395] 10.222.0.82 () {54 vars in 943 bytes} [Fri Sep 23 15:24:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:24:31.121141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef990c6-0a1e-41fa-98f0-a4e10ac19ee3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:31.121675 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef990c6-0a1e-41fa-98f0-a4e10ac19ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:31.122167 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef990c6-0a1e-41fa-98f0-a4e10ac19ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:31.242305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7ef990c6-0a1e-41fa-98f0-a4e10ac19ee3 None None] MFA Rules not processed for user `b22406c522e149d8bc462ff2feeec44c`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:31.244551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7ef990c6-0a1e-41fa-98f0-a4e10ac19ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:31.426842 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 695/1396] 10.222.0.82 () {58 vars in 1040 bytes} [Fri Sep 23 15:24:31 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:31.437368 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cfcbe-2e7c-4ad2-bb18-30ecf06482b2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:31.438951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8b4cfcbe-2e7c-4ad2-bb18-30ecf06482b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:31.451037 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:31.654714 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cfcbe-2e7c-4ad2-bb18-30ecf06482b2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:31.747037 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a01b6-9220-422d-a10f-abeb3a3a3f9f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:31.747370 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a01b6-9220-422d-a10f-abeb3a3a3f9f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:31.747579 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a01b6-9220-422d-a10f-abeb3a3a3f9f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:31.748980 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 696/1397] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:24:31.755385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82185b-e705-43ee-a5a8-6d9965dfe7c9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:31.756078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82185b-e705-43ee-a5a8-6d9965dfe7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:31.756078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82185b-e705-43ee-a5a8-6d9965dfe7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:31.766634 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:31.816058 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:31.823275 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db9bc1-21bf-45f4-9c91-7f7c2b78e106 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:31.824478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db9bc1-21bf-45f4-9c91-7f7c2b78e106 service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:31.824751 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db9bc1-21bf-45f4-9c91-7f7c2b78e106 service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:31.825019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db9bc1-21bf-45f4-9c91-7f7c2b78e106 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:31.826816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-53db9bc1-21bf-45f4-9c91-7f7c2b78e106 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:31.842444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1a82185b-e705-43ee-a5a8-6d9965dfe7c9 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:31.843730 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1a82185b-e705-43ee-a5a8-6d9965dfe7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:31.930406 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db9bc1-21bf-45f4-9c91-7f7c2b78e106 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:31.933505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db9bc1-21bf-45f4-9c91-7f7c2b78e106 service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:31.950088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 702/1398] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:24:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 15:24:31.988907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 697/1399] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:24:32.294963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db9bc1-21bf-45f4-9c91-7f7c2b78e106 service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:32.296404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-53db9bc1-21bf-45f4-9c91-7f7c2b78e106 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:32.406186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db9bc1-21bf-45f4-9c91-7f7c2b78e106 service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:32.507788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:32.646353 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0b2b1-5bb7-4bef-9d74-27dbb2420760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:32.647235 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0b2b1-5bb7-4bef-9d74-27dbb2420760 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:32.647642 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0b2b1-5bb7-4bef-9d74-27dbb2420760 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:32.648314 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0b2b1-5bb7-4bef-9d74-27dbb2420760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:32.650919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f1d0b2b1-5bb7-4bef-9d74-27dbb2420760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:32.855797 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0b2b1-5bb7-4bef-9d74-27dbb2420760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:32.859623 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0b2b1-5bb7-4bef-9d74-27dbb2420760 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:32.898644 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 703/1400] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:24:35.744435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1062e8a-6131-470f-90a5-6c78f47b79f9 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:35.744435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1062e8a-6131-470f-90a5-6c78f47b79f9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:35.744435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1062e8a-6131-470f-90a5-6c78f47b79f9 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:35.749912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 698/1401] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:24:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:24:35.752034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafa521-9fab-4cc2-948a-46b594fc04c4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:35.752576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafa521-9fab-4cc2-948a-46b594fc04c4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:35.752838 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafa521-9fab-4cc2-948a-46b594fc04c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:35.880393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:35.884254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5dafa521-9fab-4cc2-948a-46b594fc04c4 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:35.885608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5dafa521-9fab-4cc2-948a-46b594fc04c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:36.052356 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 704/1402] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:24:36.358955 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1062e8a-6131-470f-90a5-6c78f47b79f9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:36.360511 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a1062e8a-6131-470f-90a5-6c78f47b79f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:36.515319 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:36.624920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1062e8a-6131-470f-90a5-6c78f47b79f9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:36.844042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36edddb-2636-4a2d-8a40-e224c64e8154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:36.847697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36edddb-2636-4a2d-8a40-e224c64e8154 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:36.848632 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36edddb-2636-4a2d-8a40-e224c64e8154 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:36.849551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36edddb-2636-4a2d-8a40-e224c64e8154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:36.855911 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e36edddb-2636-4a2d-8a40-e224c64e8154 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:37.063444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36edddb-2636-4a2d-8a40-e224c64e8154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:37.065435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36edddb-2636-4a2d-8a40-e224c64e8154 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:37.087593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 699/1403] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:24:37.278512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:40.086473 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fb407-15b4-4c58-96ee-18efecdd127f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:40.087019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fb407-15b4-4c58-96ee-18efecdd127f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:40.087019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fb407-15b4-4c58-96ee-18efecdd127f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:40.088471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 705/1404] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:24:40.095250 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a9fe0-d5b9-4aed-ad1f-80d04078355a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:40.095870 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a9fe0-d5b9-4aed-ad1f-80d04078355a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:40.095870 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a9fe0-d5b9-4aed-ad1f-80d04078355a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:40.185987 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f91a9fe0-d5b9-4aed-ad1f-80d04078355a None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:40.187618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f91a9fe0-d5b9-4aed-ad1f-80d04078355a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:40.379431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 700/1405] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:40.694881 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fb407-15b4-4c58-96ee-18efecdd127f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:40.697781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6a5fb407-15b4-4c58-96ee-18efecdd127f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:40.910826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:40.939853 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fb407-15b4-4c58-96ee-18efecdd127f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:41.153896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e977a38-0860-4a55-b052-1b4bb202d323 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:41.154946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e977a38-0860-4a55-b052-1b4bb202d323 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:41.154946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e977a38-0860-4a55-b052-1b4bb202d323 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:41.155269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e977a38-0860-4a55-b052-1b4bb202d323 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:41.159029 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7e977a38-0860-4a55-b052-1b4bb202d323 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:41.360471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e977a38-0860-4a55-b052-1b4bb202d323 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:41.360471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e977a38-0860-4a55-b052-1b4bb202d323 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:41.360471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:41.383495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 706/1406] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:24:43.945568 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe46aa5-d755-4b72-84c1-4efda06a3a32 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:43.946840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe46aa5-d755-4b72-84c1-4efda06a3a32 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:43.946840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe46aa5-d755-4b72-84c1-4efda06a3a32 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:43.948044 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 701/1407] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:24:43.953793 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72ffa8-938d-407b-b00f-f193ad650d47 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:43.954382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72ffa8-938d-407b-b00f-f193ad650d47 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:43.954382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72ffa8-938d-407b-b00f-f193ad650d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:44.038901 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9e72ffa8-938d-407b-b00f-f193ad650d47 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:44.040265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9e72ffa8-938d-407b-b00f-f193ad650d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:44.170446 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 707/1408] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:44.531384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe46aa5-d755-4b72-84c1-4efda06a3a32 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:24:44.532929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4fe46aa5-d755-4b72-84c1-4efda06a3a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:44.569800 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:44.747289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe46aa5-d755-4b72-84c1-4efda06a3a32 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:24:44.919767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:44.956972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731a3ad-bad7-4a1b-b449-45ee332c30bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:24:44.957900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731a3ad-bad7-4a1b-b449-45ee332c30bd service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:44.958297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731a3ad-bad7-4a1b-b449-45ee332c30bd service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:44.958668 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731a3ad-bad7-4a1b-b449-45ee332c30bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:44.960578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8731a3ad-bad7-4a1b-b449-45ee332c30bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:45.118622 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731a3ad-bad7-4a1b-b449-45ee332c30bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:24:45.120232 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731a3ad-bad7-4a1b-b449-45ee332c30bd service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:24:45.145244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 702/1409] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:24:54.168060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=70 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:55.142969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=51 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:58.709368 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fef5d-f1a1-4086-b649-412060111dca None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:58.710290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fef5d-f1a1-4086-b649-412060111dca None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:58.710490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fef5d-f1a1-4086-b649-412060111dca None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:58.712195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 708/1410] 10.222.0.82 () {54 vars in 918 bytes} [Fri Sep 23 15:24:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:24:58.718589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfa1d9-0051-4cc8-a895-9acfd0282c77 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:58.719407 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfa1d9-0051-4cc8-a895-9acfd0282c77 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:58.719634 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfa1d9-0051-4cc8-a895-9acfd0282c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:58.810553 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-82bfa1d9-0051-4cc8-a895-9acfd0282c77 None None] MFA Rules not processed for user `a25109eeb1b34b3689b10e3f7c44a6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:58.811807 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-82bfa1d9-0051-4cc8-a895-9acfd0282c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:58.941518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 703/1411] 10.222.0.82 () {58 vars in 1015 bytes} [Fri Sep 23 15:24:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:24:58.957781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeb7c1-cf81-4c21-a0b1-28493ab31835 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:58.958078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeb7c1-cf81-4c21-a0b1-28493ab31835 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:58.958351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeb7c1-cf81-4c21-a0b1-28493ab31835 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:58.960318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 709/1412] 10.222.0.82 () {54 vars in 918 bytes} [Fri Sep 23 15:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:24:58.967320 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a3aea-a126-4925-8b8e-8cf9258acd1a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:24:58.967806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a3aea-a126-4925-8b8e-8cf9258acd1a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:24:58.968291 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a3aea-a126-4925-8b8e-8cf9258acd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:24:59.057582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:24:59.061894 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d24a3aea-a126-4925-8b8e-8cf9258acd1a None None] MFA Rules not processed for user `6dbf682960cc447099c11862afa3206b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:24:59.063340 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d24a3aea-a126-4925-8b8e-8cf9258acd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:24:59.202924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 704/1413] 10.222.0.82 () {58 vars in 1015 bytes} [Fri Sep 23 15:24:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:25:01.936556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee6f8d-1861-408e-b20a-1468c643e0f5 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:01.937158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee6f8d-1861-408e-b20a-1468c643e0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:01.937492 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee6f8d-1861-408e-b20a-1468c643e0f5 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:01.940084 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:25:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:25:01.948630 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44073668-4919-4f8a-8009-1eca99c31036 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:01.949294 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44073668-4919-4f8a-8009-1eca99c31036 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:01.949294 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44073668-4919-4f8a-8009-1eca99c31036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:02.031563 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-44073668-4919-4f8a-8009-1eca99c31036 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:02.032871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-44073668-4919-4f8a-8009-1eca99c31036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:02.101610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:02.153704 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:25:02.467483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee6f8d-1861-408e-b20a-1468c643e0f5 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:02.472851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6eee6f8d-1861-408e-b20a-1468c643e0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:02.666710 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee6f8d-1861-408e-b20a-1468c643e0f5 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:02.793472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:02.867820 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef32486-d7ef-4491-93be-042c8659bbf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:02.868845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef32486-d7ef-4491-93be-042c8659bbf4 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:02.869332 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef32486-d7ef-4491-93be-042c8659bbf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:02.869856 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef32486-d7ef-4491-93be-042c8659bbf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:02.873025 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-eef32486-d7ef-4491-93be-042c8659bbf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:02.996220 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef32486-d7ef-4491-93be-042c8659bbf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:02.997928 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef32486-d7ef-4491-93be-042c8659bbf4 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:03.021399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 711/1416] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:25:04.253673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257dc30-e410-4b20-a91a-3602543396be None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:04.254320 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257dc30-e410-4b20-a91a-3602543396be None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:04.254320 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257dc30-e410-4b20-a91a-3602543396be None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:04.256095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:25:04.263186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9611f-3bd8-4eb2-b48a-a4a09fceb51d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:04.263798 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9611f-3bd8-4eb2-b48a-a4a09fceb51d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:04.263798 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9611f-3bd8-4eb2-b48a-a4a09fceb51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:04.353124 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-97b9611f-3bd8-4eb2-b48a-a4a09fceb51d None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:04.354442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-97b9611f-3bd8-4eb2-b48a-a4a09fceb51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:04.386042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:04.467918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:25:04.632466 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257dc30-e410-4b20-a91a-3602543396be None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:04.634208 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e257dc30-e410-4b20-a91a-3602543396be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:04.792392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257dc30-e410-4b20-a91a-3602543396be None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:04.837579 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:04.922457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e590392-a97a-4ca8-9f76-f41d7f6079c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:04.923159 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e590392-a97a-4ca8-9f76-f41d7f6079c7 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:04.923492 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e590392-a97a-4ca8-9f76-f41d7f6079c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:04.923870 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e590392-a97a-4ca8-9f76-f41d7f6079c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:04.925675 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0e590392-a97a-4ca8-9f76-f41d7f6079c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:05.030428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e590392-a97a-4ca8-9f76-f41d7f6079c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:05.032065 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e590392-a97a-4ca8-9f76-f41d7f6079c7 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:05.052539 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 707/1419] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:25:06.257306 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffad8d7-b933-4162-b284-308513661dbb None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:06.257901 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffad8d7-b933-4162-b284-308513661dbb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:06.257901 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffad8d7-b933-4162-b284-308513661dbb None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:06.259202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:25:06.266387 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed22e8-20f5-463a-8b7c-72e1ad1c6610 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:06.266918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed22e8-20f5-463a-8b7c-72e1ad1c6610 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:06.266918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed22e8-20f5-463a-8b7c-72e1ad1c6610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:06.326754 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:06.352326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-61ed22e8-20f5-463a-8b7c-72e1ad1c6610 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:06.353581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-61ed22e8-20f5-463a-8b7c-72e1ad1c6610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:06.490663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:25:06.645423 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffad8d7-b933-4162-b284-308513661dbb None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:06.647010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3ffad8d7-b933-4162-b284-308513661dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:06.822167 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffad8d7-b933-4162-b284-308513661dbb None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:06.835998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:06.951876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4224c2-5faa-40c6-9ed2-461df61c29bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:06.952366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4224c2-5faa-40c6-9ed2-461df61c29bb service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:06.952633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4224c2-5faa-40c6-9ed2-461df61c29bb service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:06.952907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4224c2-5faa-40c6-9ed2-461df61c29bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:06.954578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2b4224c2-5faa-40c6-9ed2-461df61c29bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:07.062270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4224c2-5faa-40c6-9ed2-461df61c29bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:07.063909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4224c2-5faa-40c6-9ed2-461df61c29bb service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:07.083645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 714/1422] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:25:08.289546 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478df07-e0cc-4f17-aa25-2f18c13904f6 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:08.290174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478df07-e0cc-4f17-aa25-2f18c13904f6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:08.290481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478df07-e0cc-4f17-aa25-2f18c13904f6 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:08.293321 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:25:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:25:08.301532 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70e4bb-2387-4f0e-bb12-73d5bc507200 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:08.302208 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70e4bb-2387-4f0e-bb12-73d5bc507200 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:08.302208 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70e4bb-2387-4f0e-bb12-73d5bc507200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:08.323910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:08.422096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-db70e4bb-2387-4f0e-bb12-73d5bc507200 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:08.424080 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-db70e4bb-2387-4f0e-bb12-73d5bc507200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:08.611225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:25:08.762712 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478df07-e0cc-4f17-aa25-2f18c13904f6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:08.764932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c478df07-e0cc-4f17-aa25-2f18c13904f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:08.888594 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:08.928570 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478df07-e0cc-4f17-aa25-2f18c13904f6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:09.059605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58eec16-d5b1-47f7-b373-ccf8530b3c0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:09.060210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58eec16-d5b1-47f7-b373-ccf8530b3c0b service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:09.060487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58eec16-d5b1-47f7-b373-ccf8530b3c0b service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:09.060757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58eec16-d5b1-47f7-b373-ccf8530b3c0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:09.062403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b58eec16-d5b1-47f7-b373-ccf8530b3c0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:09.145315 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:09.159325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58eec16-d5b1-47f7-b373-ccf8530b3c0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:09.161581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58eec16-d5b1-47f7-b373-ccf8530b3c0b service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:09.180532 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 710/1425] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:25:10.342343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7f8ec-ea8a-40e9-a431-6972f7456f73 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:10.342954 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7f8ec-ea8a-40e9-a431-6972f7456f73 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:10.342954 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7f8ec-ea8a-40e9-a431-6972f7456f73 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:10.344160 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:25:10.352335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ec1ea-5218-4d38-92c8-c9a50f368906 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:10.352925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ec1ea-5218-4d38-92c8-c9a50f368906 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:10.352925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ec1ea-5218-4d38-92c8-c9a50f368906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:10.436186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3c4ec1ea-5218-4d38-92c8-c9a50f368906 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:10.437427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3c4ec1ea-5218-4d38-92c8-c9a50f368906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:10.546902 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:25:10.705181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7f8ec-ea8a-40e9-a431-6972f7456f73 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:10.707312 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-38e7f8ec-ea8a-40e9-a431-6972f7456f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:10.800900 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:10.866297 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7f8ec-ea8a-40e9-a431-6972f7456f73 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:10.994926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97358e2a-3467-417b-bfa3-6600b06f820a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:10.995537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97358e2a-3467-417b-bfa3-6600b06f820a service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:10.995812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97358e2a-3467-417b-bfa3-6600b06f820a service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:10.996078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97358e2a-3467-417b-bfa3-6600b06f820a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:10.997712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-97358e2a-3467-417b-bfa3-6600b06f820a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:11.054543 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:11.101165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97358e2a-3467-417b-bfa3-6600b06f820a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:11.102886 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97358e2a-3467-417b-bfa3-6600b06f820a service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:11.127140 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 717/1428] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:25:12.353550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93931d2-4623-4f67-8d10-9b285a0e7bbe None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:12.354141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93931d2-4623-4f67-8d10-9b285a0e7bbe None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:12.354141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93931d2-4623-4f67-8d10-9b285a0e7bbe None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:12.355430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:25:12.362143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0a9b0-1268-4c54-b714-dbd3c9086131 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:12.362646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0a9b0-1268-4c54-b714-dbd3c9086131 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:12.362760 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0a9b0-1268-4c54-b714-dbd3c9086131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:12.446737 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a7f0a9b0-1268-4c54-b714-dbd3c9086131 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:12.447957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a7f0a9b0-1268-4c54-b714-dbd3c9086131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:12.551944 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:25:12.706208 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93931d2-4623-4f67-8d10-9b285a0e7bbe None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:12.707745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d93931d2-4623-4f67-8d10-9b285a0e7bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:12.760470 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:12.870341 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93931d2-4623-4f67-8d10-9b285a0e7bbe None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:13.011057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48fe2f-9eaf-4ec3-914e-b829f1396465 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:13.011666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48fe2f-9eaf-4ec3-914e-b829f1396465 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:13.011942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48fe2f-9eaf-4ec3-914e-b829f1396465 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:13.012221 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48fe2f-9eaf-4ec3-914e-b829f1396465 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:13.013859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8c48fe2f-9eaf-4ec3-914e-b829f1396465 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:13.021339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:13.111608 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48fe2f-9eaf-4ec3-914e-b829f1396465 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:13.114138 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48fe2f-9eaf-4ec3-914e-b829f1396465 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:13.136378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 713/1431] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:25:14.350596 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88941c3-e275-4fa6-93a5-1f58bab3a5c4 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:14.351291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88941c3-e275-4fa6-93a5-1f58bab3a5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:14.351291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88941c3-e275-4fa6-93a5-1f58bab3a5c4 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:14.352518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:25:14.360045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed96934-6315-49c9-9e55-d4ee2abbc2a5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:14.360738 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed96934-6315-49c9-9e55-d4ee2abbc2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:14.360738 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed96934-6315-49c9-9e55-d4ee2abbc2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:14.458563 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7ed96934-6315-49c9-9e55-d4ee2abbc2a5 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:14.459815 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7ed96934-6315-49c9-9e55-d4ee2abbc2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:14.543005 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:14.580804 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:25:14.736868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88941c3-e275-4fa6-93a5-1f58bab3a5c4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:14.739107 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a88941c3-e275-4fa6-93a5-1f58bab3a5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:14.759026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:14.907072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88941c3-e275-4fa6-93a5-1f58bab3a5c4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:15.008529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:15.036319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b64f4-ae1a-4f97-8d69-b61fed68fb80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:15.036936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b64f4-ae1a-4f97-8d69-b61fed68fb80 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:15.037207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b64f4-ae1a-4f97-8d69-b61fed68fb80 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:15.037474 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b64f4-ae1a-4f97-8d69-b61fed68fb80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:15.039206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2a7b64f4-ae1a-4f97-8d69-b61fed68fb80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:15.134240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b64f4-ae1a-4f97-8d69-b61fed68fb80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:15.135861 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b64f4-ae1a-4f97-8d69-b61fed68fb80 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:15.154670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 720/1434] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:25:16.331020 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422acc6-93da-4e04-b826-737d26b731cc None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:16.331569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422acc6-93da-4e04-b826-737d26b731cc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:16.331569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422acc6-93da-4e04-b826-737d26b731cc None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:16.332868 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:25:16.340527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760400c9-cf16-4efa-a7e4-2358cda1a25b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:16.341173 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760400c9-cf16-4efa-a7e4-2358cda1a25b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:16.341489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760400c9-cf16-4efa-a7e4-2358cda1a25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:16.435364 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-760400c9-cf16-4efa-a7e4-2358cda1a25b None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:16.436595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-760400c9-cf16-4efa-a7e4-2358cda1a25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:16.481547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:16.540761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:25:16.694026 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422acc6-93da-4e04-b826-737d26b731cc None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:16.695535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3422acc6-93da-4e04-b826-737d26b731cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:16.849635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422acc6-93da-4e04-b826-737d26b731cc None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:16.908457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:16.971253 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b144989-d6c3-4c48-af7e-c93670222a24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:16.971871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b144989-d6c3-4c48-af7e-c93670222a24 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:16.972153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b144989-d6c3-4c48-af7e-c93670222a24 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:16.972426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b144989-d6c3-4c48-af7e-c93670222a24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:16.974112 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7b144989-d6c3-4c48-af7e-c93670222a24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:17.067157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b144989-d6c3-4c48-af7e-c93670222a24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:17.068770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b144989-d6c3-4c48-af7e-c93670222a24 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:17.091811 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 716/1437] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:25:18.279645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdafb2-fe7f-4b3e-9b0e-d21db16a8536 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:18.280206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdafb2-fe7f-4b3e-9b0e-d21db16a8536 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:18.280206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdafb2-fe7f-4b3e-9b0e-d21db16a8536 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:18.281441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:25:18.288777 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec433325-8c57-4cf7-b66f-ff17d35ef730 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:18.289213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec433325-8c57-4cf7-b66f-ff17d35ef730 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:18.289321 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec433325-8c57-4cf7-b66f-ff17d35ef730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:18.367091 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ec433325-8c57-4cf7-b66f-ff17d35ef730 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:18.368324 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ec433325-8c57-4cf7-b66f-ff17d35ef730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:18.370518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:18.475440 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:25:18.627193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdafb2-fe7f-4b3e-9b0e-d21db16a8536 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:18.628797 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-dccdafb2-fe7f-4b3e-9b0e-d21db16a8536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:18.786475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdafb2-fe7f-4b3e-9b0e-d21db16a8536 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:18.817935 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:18.924671 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513566d5-e607-4210-b368-3cfadadb2d51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:18.925196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513566d5-e607-4210-b368-3cfadadb2d51 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:18.925475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513566d5-e607-4210-b368-3cfadadb2d51 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:18.925774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513566d5-e607-4210-b368-3cfadadb2d51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:18.927440 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-513566d5-e607-4210-b368-3cfadadb2d51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:19.034275 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513566d5-e607-4210-b368-3cfadadb2d51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:19.035889 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513566d5-e607-4210-b368-3cfadadb2d51 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:19.054735 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 723/1440] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:25:21.155080 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55ae3c-2b71-4792-bc78-fb15fd7e26a9 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:21.155659 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55ae3c-2b71-4792-bc78-fb15fd7e26a9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:21.155659 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55ae3c-2b71-4792-bc78-fb15fd7e26a9 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:21.156989 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:25:21.163072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8ac01-a2e9-451b-a377-7ae782f6fef2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:21.163524 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8ac01-a2e9-451b-a377-7ae782f6fef2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:21.163633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8ac01-a2e9-451b-a377-7ae782f6fef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:21.206207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:21.231603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-79f8ac01-a2e9-451b-a377-7ae782f6fef2 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:21.232770 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-79f8ac01-a2e9-451b-a377-7ae782f6fef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:21.330950 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:25:21.620089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55ae3c-2b71-4792-bc78-fb15fd7e26a9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:21.621653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-be55ae3c-2b71-4792-bc78-fb15fd7e26a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:21.726392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55ae3c-2b71-4792-bc78-fb15fd7e26a9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:21.878925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:21.922434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99836966-be19-49cc-b225-3203b9ec0456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:21.923064 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99836966-be19-49cc-b225-3203b9ec0456 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:21.923346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99836966-be19-49cc-b225-3203b9ec0456 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:21.924109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99836966-be19-49cc-b225-3203b9ec0456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:21.925706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-99836966-be19-49cc-b225-3203b9ec0456 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:22.037674 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99836966-be19-49cc-b225-3203b9ec0456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:22.039133 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99836966-be19-49cc-b225-3203b9ec0456 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:22.057999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 719/1443] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:25:24.384037 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be65c1f-a0c4-4742-b7f1-a7f029e2d007 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:24.384592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be65c1f-a0c4-4742-b7f1-a7f029e2d007 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:24.384592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be65c1f-a0c4-4742-b7f1-a7f029e2d007 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:24.386042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:25:24.391483 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbfe07-ce60-4ef8-8069-e0a09079568f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:24.391894 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbfe07-ce60-4ef8-8069-e0a09079568f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:24.392705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbfe07-ce60-4ef8-8069-e0a09079568f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:24.462689 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4dbbfe07-ce60-4ef8-8069-e0a09079568f None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:24.463905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4dbbfe07-ce60-4ef8-8069-e0a09079568f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:24.476736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:24.561142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:25:24.842302 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be65c1f-a0c4-4742-b7f1-a7f029e2d007 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:24.843844 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1be65c1f-a0c4-4742-b7f1-a7f029e2d007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:24.947644 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be65c1f-a0c4-4742-b7f1-a7f029e2d007 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:24.960340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:25.025695 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1513c-f26e-45e8-b3ee-4d3a1c93e2e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:25.026327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1513c-f26e-45e8-b3ee-4d3a1c93e2e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:25.026602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1513c-f26e-45e8-b3ee-4d3a1c93e2e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:25.026870 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1513c-f26e-45e8-b3ee-4d3a1c93e2e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:25.028458 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c5d1513c-f26e-45e8-b3ee-4d3a1c93e2e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:25.140447 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1513c-f26e-45e8-b3ee-4d3a1c93e2e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:25.142097 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1513c-f26e-45e8-b3ee-4d3a1c93e2e2 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:25.161980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 726/1446] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:25:27.756779 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f82d6b-89c1-424d-a982-0e9b7c295bfe None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:27.757322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f82d6b-89c1-424d-a982-0e9b7c295bfe None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:27.757322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f82d6b-89c1-424d-a982-0e9b7c295bfe None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:27.758682 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:25:27.764044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7181dc6-332c-4e5c-9bac-6b2df14df409 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:27.764776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7181dc6-332c-4e5c-9bac-6b2df14df409 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:27.764882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7181dc6-332c-4e5c-9bac-6b2df14df409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:27.813288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:27.832712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e7181dc6-332c-4e5c-9bac-6b2df14df409 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:27.837579 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e7181dc6-332c-4e5c-9bac-6b2df14df409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:27.936446 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:25:28.238941 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f82d6b-89c1-424d-a982-0e9b7c295bfe None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:28.240525 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c2f82d6b-89c1-424d-a982-0e9b7c295bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:28.352658 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f82d6b-89c1-424d-a982-0e9b7c295bfe None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:28.398014 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:28.433857 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c271a-7eb0-4fd9-ad40-4705cda8156b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:28.434398 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c271a-7eb0-4fd9-ad40-4705cda8156b service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:28.434671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c271a-7eb0-4fd9-ad40-4705cda8156b service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:28.434936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c271a-7eb0-4fd9-ad40-4705cda8156b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:28.436749 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-aa7c271a-7eb0-4fd9-ad40-4705cda8156b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:28.553268 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c271a-7eb0-4fd9-ad40-4705cda8156b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:28.554670 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c271a-7eb0-4fd9-ad40-4705cda8156b service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:28.576176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 722/1449] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:25:30.914455 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38888179-bd58-43b0-a1e9-11d5483c22a2 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:30.915010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38888179-bd58-43b0-a1e9-11d5483c22a2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:30.915010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38888179-bd58-43b0-a1e9-11d5483c22a2 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:30.916965 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:25:30.923590 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfadd9-45bd-445d-bacd-5cc714ae065e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:30.924136 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfadd9-45bd-445d-bacd-5cc714ae065e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:30.924136 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfadd9-45bd-445d-bacd-5cc714ae065e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:30.996959 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9bcfadd9-45bd-445d-bacd-5cc714ae065e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:30.998328 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9bcfadd9-45bd-445d-bacd-5cc714ae065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:31.021055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:31.101416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:25:31.387821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38888179-bd58-43b0-a1e9-11d5483c22a2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:31.389636 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-38888179-bd58-43b0-a1e9-11d5483c22a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:31.503245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38888179-bd58-43b0-a1e9-11d5483c22a2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:31.526290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:31.585639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0f91a-0c67-4878-92b2-aa5ae7517760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:31.586277 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0f91a-0c67-4878-92b2-aa5ae7517760 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:31.586554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0f91a-0c67-4878-92b2-aa5ae7517760 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:31.586824 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0f91a-0c67-4878-92b2-aa5ae7517760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:31.588458 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e3e0f91a-0c67-4878-92b2-aa5ae7517760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:31.851732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0f91a-0c67-4878-92b2-aa5ae7517760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:31.853173 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0f91a-0c67-4878-92b2-aa5ae7517760 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:31.877535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 729/1452] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:25:34.158315 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef1db8-0edf-41bc-af22-2e335224f700 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:34.158918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef1db8-0edf-41bc-af22-2e335224f700 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:34.158918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef1db8-0edf-41bc-af22-2e335224f700 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:34.160280 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:25:34.166927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f056a-9707-44f1-a1f8-ff8db79c3fc9 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:34.167558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f056a-9707-44f1-a1f8-ff8db79c3fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:34.167558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f056a-9707-44f1-a1f8-ff8db79c3fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:34.231920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:34.234913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ed6f056a-9707-44f1-a1f8-ff8db79c3fc9 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:34.236139 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ed6f056a-9707-44f1-a1f8-ff8db79c3fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:34.336899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:25:34.642786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef1db8-0edf-41bc-af22-2e335224f700 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:34.644380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d0ef1db8-0edf-41bc-af22-2e335224f700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:34.761929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef1db8-0edf-41bc-af22-2e335224f700 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:34.817546 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:34.844142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01ea89-8efd-410a-9c2e-e718cb117dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:34.844757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01ea89-8efd-410a-9c2e-e718cb117dab service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:34.845040 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01ea89-8efd-410a-9c2e-e718cb117dab service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:34.845298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01ea89-8efd-410a-9c2e-e718cb117dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:34.846973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0a01ea89-8efd-410a-9c2e-e718cb117dab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:34.967490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01ea89-8efd-410a-9c2e-e718cb117dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:34.969471 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01ea89-8efd-410a-9c2e-e718cb117dab service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:34.992965 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 725/1455] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:25:37.255507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a5c45-2a98-4400-aa0c-756eeb20ac4d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:37.256171 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a5c45-2a98-4400-aa0c-756eeb20ac4d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:37.256171 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a5c45-2a98-4400-aa0c-756eeb20ac4d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:37.257296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:25:37.262673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed52de-1a0a-446e-812c-19e35d6a9831 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:37.263094 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed52de-1a0a-446e-812c-19e35d6a9831 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:37.263270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed52de-1a0a-446e-812c-19e35d6a9831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:37.330653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-51ed52de-1a0a-446e-812c-19e35d6a9831 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:37.331893 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-51ed52de-1a0a-446e-812c-19e35d6a9831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:37.361848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:37.433752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:25:37.726031 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a5c45-2a98-4400-aa0c-756eeb20ac4d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:37.727665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c36a5c45-2a98-4400-aa0c-756eeb20ac4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:37.841833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a5c45-2a98-4400-aa0c-756eeb20ac4d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:37.871245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:37.918794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b9dbe-30b5-4628-8747-ef91604fa027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:37.919397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b9dbe-30b5-4628-8747-ef91604fa027 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:37.919672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b9dbe-30b5-4628-8747-ef91604fa027 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:37.919940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b9dbe-30b5-4628-8747-ef91604fa027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:37.921565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-da1b9dbe-30b5-4628-8747-ef91604fa027 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:38.036111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b9dbe-30b5-4628-8747-ef91604fa027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:38.037467 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b9dbe-30b5-4628-8747-ef91604fa027 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:38.057863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 732/1458] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:25:40.308975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be6966-aad4-4020-9814-6f81614db3a2 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:40.309530 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be6966-aad4-4020-9814-6f81614db3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:40.309530 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be6966-aad4-4020-9814-6f81614db3a2 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:40.310826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:25:40.316213 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1bc82-0fad-482c-b1e7-26cd4e9359eb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:40.316666 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1bc82-0fad-482c-b1e7-26cd4e9359eb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:40.316775 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1bc82-0fad-482c-b1e7-26cd4e9359eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:40.381061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-efe1bc82-0fad-482c-b1e7-26cd4e9359eb None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:40.382285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-efe1bc82-0fad-482c-b1e7-26cd4e9359eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:40.391071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:40.478497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:25:40.757502 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be6966-aad4-4020-9814-6f81614db3a2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:40.759057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-84be6966-aad4-4020-9814-6f81614db3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:40.865450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be6966-aad4-4020-9814-6f81614db3a2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:40.921177 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:40.940469 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae17170-83a4-49ca-946c-25fee06d11ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:40.946045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae17170-83a4-49ca-946c-25fee06d11ba service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:40.946045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae17170-83a4-49ca-946c-25fee06d11ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:40.946045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae17170-83a4-49ca-946c-25fee06d11ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:40.946045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9ae17170-83a4-49ca-946c-25fee06d11ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:41.054206 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae17170-83a4-49ca-946c-25fee06d11ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:41.055634 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae17170-83a4-49ca-946c-25fee06d11ba service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:41.074378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 728/1461] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:25:43.297704 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d82bf-839d-4d26-9408-3d536057dabd None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:43.298307 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d82bf-839d-4d26-9408-3d536057dabd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:43.298307 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d82bf-839d-4d26-9408-3d536057dabd None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:43.299559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:25:43.305038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7d777-eee8-459d-9436-84ed393eefee None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:43.305475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7d777-eee8-459d-9436-84ed393eefee None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:43.305570 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7d777-eee8-459d-9436-84ed393eefee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:43.371639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c7e7d777-eee8-459d-9436-84ed393eefee None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:43.372869 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c7e7d777-eee8-459d-9436-84ed393eefee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:43.412008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:43.471253 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:25:43.758089 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d82bf-839d-4d26-9408-3d536057dabd None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:43.759618 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-396d82bf-839d-4d26-9408-3d536057dabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:43.863628 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d82bf-839d-4d26-9408-3d536057dabd None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:43.900530 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:43.937541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba18ee7-9a10-4f2b-b492-5aaea7d3edf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:43.938181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba18ee7-9a10-4f2b-b492-5aaea7d3edf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:43.938458 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba18ee7-9a10-4f2b-b492-5aaea7d3edf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:43.938735 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba18ee7-9a10-4f2b-b492-5aaea7d3edf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:43.940349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6ba18ee7-9a10-4f2b-b492-5aaea7d3edf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:44.052187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba18ee7-9a10-4f2b-b492-5aaea7d3edf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:44.053627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba18ee7-9a10-4f2b-b492-5aaea7d3edf4 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:44.074767 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 735/1464] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:25:46.317168 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce279834-f208-4852-b57f-b5c2b1ecd586 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:46.317695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce279834-f208-4852-b57f-b5c2b1ecd586 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:46.317695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce279834-f208-4852-b57f-b5c2b1ecd586 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:46.318995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:25:46.324433 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c6c25-3bfa-4525-9256-a5ad73a5c15e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:46.324842 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c6c25-3bfa-4525-9256-a5ad73a5c15e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:46.325011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c6c25-3bfa-4525-9256-a5ad73a5c15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:46.391491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-aa0c6c25-3bfa-4525-9256-a5ad73a5c15e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:46.392723 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-aa0c6c25-3bfa-4525-9256-a5ad73a5c15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:46.412126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:46.492010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:25:46.776088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce279834-f208-4852-b57f-b5c2b1ecd586 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:46.777633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ce279834-f208-4852-b57f-b5c2b1ecd586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:46.882623 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce279834-f208-4852-b57f-b5c2b1ecd586 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:46.953013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:46.959427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe78559-f367-4ad4-a340-87ee1ec9d17d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:46.960030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe78559-f367-4ad4-a340-87ee1ec9d17d service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:46.960308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe78559-f367-4ad4-a340-87ee1ec9d17d service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:46.960583 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe78559-f367-4ad4-a340-87ee1ec9d17d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:46.962230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cfe78559-f367-4ad4-a340-87ee1ec9d17d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:47.072017 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe78559-f367-4ad4-a340-87ee1ec9d17d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:47.073449 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe78559-f367-4ad4-a340-87ee1ec9d17d service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:47.092866 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 731/1467] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:25:49.278209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8a896-70c0-4e7b-bec5-ffb4a23290a3 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:49.278759 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8a896-70c0-4e7b-bec5-ffb4a23290a3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:49.278759 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8a896-70c0-4e7b-bec5-ffb4a23290a3 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:49.281899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:25:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:25:49.287417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266befe-33c6-403e-8437-130e72880501 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:49.287885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266befe-33c6-403e-8437-130e72880501 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:49.287994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266befe-33c6-403e-8437-130e72880501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:49.356105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b266befe-33c6-403e-8437-130e72880501 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:25:49.357385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b266befe-33c6-403e-8437-130e72880501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:49.407405 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:49.457903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:25:49.747584 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8a896-70c0-4e7b-bec5-ffb4a23290a3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:25:49.749645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-dbc8a896-70c0-4e7b-bec5-ffb4a23290a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:49.854105 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8a896-70c0-4e7b-bec5-ffb4a23290a3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:25:49.902495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:25:49.928621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895989e-0c7f-4982-a7df-21db5ba96952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:25:49.929223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895989e-0c7f-4982-a7df-21db5ba96952 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:25:49.929497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895989e-0c7f-4982-a7df-21db5ba96952 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:25:49.929789 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895989e-0c7f-4982-a7df-21db5ba96952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:25:49.931385 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5895989e-0c7f-4982-a7df-21db5ba96952 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:25:50.049802 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895989e-0c7f-4982-a7df-21db5ba96952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:25:50.051175 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895989e-0c7f-4982-a7df-21db5ba96952 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:25:50.069082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 738/1470] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:25:59.456249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=22 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:00.066770 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=66 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:10.952160 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafc918-4831-47f5-8c97-4c1b383625ef None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:10.952734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafc918-4831-47f5-8c97-4c1b383625ef None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:10.952734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafc918-4831-47f5-8c97-4c1b383625ef None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:10.954099 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 733/1471] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:26:10.959691 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c29e9-59f0-4048-87a3-cc2c0c03844f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:10.960183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c29e9-59f0-4048-87a3-cc2c0c03844f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:10.960290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c29e9-59f0-4048-87a3-cc2c0c03844f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:11.028660 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-579c29e9-59f0-4048-87a3-cc2c0c03844f None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:26:11.030002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-579c29e9-59f0-4048-87a3-cc2c0c03844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:11.127009 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 739/1472] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:26:11.425968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd4a2c-efd9-47ab-acb4-8ac084106652 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:11.426249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd4a2c-efd9-47ab-acb4-8ac084106652 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:11.426517 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd4a2c-efd9-47ab-acb4-8ac084106652 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:11.427870 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 734/1473] 10.222.0.82 () {54 vars in 962 bytes} [Fri Sep 23 15:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:26:11.433661 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc62f2-fb9b-4940-b5bb-3dfc165f6978 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:11.433969 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc62f2-fb9b-4940-b5bb-3dfc165f6978 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:11.434284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc62f2-fb9b-4940-b5bb-3dfc165f6978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:11.510156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-38bc62f2-fb9b-4940-b5bb-3dfc165f6978 None None] MFA Rules not processed for user `1879a3ad7be74303b9feceff75f62979`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:26:11.511927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-38bc62f2-fb9b-4940-b5bb-3dfc165f6978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:11.532320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:11.585629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 740/1474] 10.222.0.82 () {58 vars in 1059 bytes} [Fri Sep 23 15:26:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:26:11.593797 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd4a2c-efd9-47ab-acb4-8ac084106652 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:26:11.595642 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6afd4a2c-efd9-47ab-acb4-8ac084106652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:11.706729 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd4a2c-efd9-47ab-acb4-8ac084106652 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:26:11.782903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b27fa7-8ae9-4496-9ce6-6cb75a86f07e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1879a3ad7be74303b9feceff75f62979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:26:11.783499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b27fa7-8ae9-4496-9ce6-6cb75a86f07e service glance] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:11.783779 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b27fa7-8ae9-4496-9ce6-6cb75a86f07e service glance] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:11.784039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b27fa7-8ae9-4496-9ce6-6cb75a86f07e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:11.785646 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e6b27fa7-8ae9-4496-9ce6-6cb75a86f07e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:11.840151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:11.896033 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b27fa7-8ae9-4496-9ce6-6cb75a86f07e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:26:11.897472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b27fa7-8ae9-4496-9ce6-6cb75a86f07e service glance] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:26:11.916967 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 735/1475] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:26:14.185692 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474c1f5-d857-40eb-8734-644fd030c55d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:14.186335 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474c1f5-d857-40eb-8734-644fd030c55d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:14.186335 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474c1f5-d857-40eb-8734-644fd030c55d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:14.187629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 741/1476] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:26:14.193029 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b3e42-aec8-47ad-a9f0-1ef7d708737e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:14.193480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b3e42-aec8-47ad-a9f0-1ef7d708737e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:14.193594 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b3e42-aec8-47ad-a9f0-1ef7d708737e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:14.258628 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bc0b3e42-aec8-47ad-a9f0-1ef7d708737e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:26:14.259731 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bc0b3e42-aec8-47ad-a9f0-1ef7d708737e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:14.356458 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 736/1477] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:26:14.634527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474c1f5-d857-40eb-8734-644fd030c55d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:26:14.637134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c474c1f5-d857-40eb-8734-644fd030c55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:14.762113 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474c1f5-d857-40eb-8734-644fd030c55d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:26:14.813311 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:14.856884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8bebc-2410-4d07-92ee-7ed3a8a52352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:26:14.857487 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8bebc-2410-4d07-92ee-7ed3a8a52352 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:14.857896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8bebc-2410-4d07-92ee-7ed3a8a52352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:14.858055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8bebc-2410-4d07-92ee-7ed3a8a52352 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:14.858671 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8bebc-2410-4d07-92ee-7ed3a8a52352 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:26:14.860417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-e0d8bebc-2410-4d07-92ee-7ed3a8a52352 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:26:14.860417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: warnings.warn(msg) Sep 23 15:26:14.860417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: Sep 23 15:26:14.861533 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8bebc-2410-4d07-92ee-7ed3a8a52352 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:26:14.881233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 742/1478] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Sep 23 15:26:14 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:26:17.050200 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63607ac-81c1-420e-92b6-082d10670e7f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:17.050753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63607ac-81c1-420e-92b6-082d10670e7f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:17.050753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63607ac-81c1-420e-92b6-082d10670e7f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:17.052078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 737/1479] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:26:17.057193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c61c4c-27d9-44fa-963b-0b47ee523394 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:17.058132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c61c4c-27d9-44fa-963b-0b47ee523394 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:17.058246 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c61c4c-27d9-44fa-963b-0b47ee523394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:17.124306 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f0c61c4c-27d9-44fa-963b-0b47ee523394 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:26:17.125534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f0c61c4c-27d9-44fa-963b-0b47ee523394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:17.218481 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 743/1480] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:26:17.512473 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63607ac-81c1-420e-92b6-082d10670e7f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:26:17.514110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d63607ac-81c1-420e-92b6-082d10670e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:17.524263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:17.661325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63607ac-81c1-420e-92b6-082d10670e7f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:26:17.739640 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:17.772872 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1df33b-f8be-4d97-96fb-22c489cc4084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:26:17.773439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1df33b-f8be-4d97-96fb-22c489cc4084 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:17.773718 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1df33b-f8be-4d97-96fb-22c489cc4084 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:17.774013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1df33b-f8be-4d97-96fb-22c489cc4084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:17.775602 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8b1df33b-f8be-4d97-96fb-22c489cc4084 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:17.865094 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1df33b-f8be-4d97-96fb-22c489cc4084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:26:17.866700 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1df33b-f8be-4d97-96fb-22c489cc4084 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:26:17.884307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 738/1481] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:26:20.216382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d159b3-3e46-4258-93b3-356ec6a32060 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:20.216963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d159b3-3e46-4258-93b3-356ec6a32060 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:20.216963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d159b3-3e46-4258-93b3-356ec6a32060 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:20.218304 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 744/1482] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:26:20.223740 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2852807-cc69-4374-bce2-879b68d86449 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:20.224130 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2852807-cc69-4374-bce2-879b68d86449 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:20.224284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2852807-cc69-4374-bce2-879b68d86449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:20.289073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d2852807-cc69-4374-bce2-879b68d86449 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:26:20.290293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d2852807-cc69-4374-bce2-879b68d86449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:20.335016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:20.385507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 739/1483] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:26:20.674221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d159b3-3e46-4258-93b3-356ec6a32060 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:26:20.675789 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-11d159b3-3e46-4258-93b3-356ec6a32060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:20.699100 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:20.778942 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d159b3-3e46-4258-93b3-356ec6a32060 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:26:20.855083 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9ac57-3e0e-4798-845e-7c45a3e616ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:26:20.855692 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9ac57-3e0e-4798-845e-7c45a3e616ef service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:20.855966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9ac57-3e0e-4798-845e-7c45a3e616ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:20.856232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9ac57-3e0e-4798-845e-7c45a3e616ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:20.857952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9be9ac57-3e0e-4798-845e-7c45a3e616ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:20.934845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:20.968233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9ac57-3e0e-4798-845e-7c45a3e616ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:26:20.969690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9ac57-3e0e-4798-845e-7c45a3e616ef service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:26:20.988908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 745/1484] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:26:23.215918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2d28e-d81c-4352-b037-6221c6aa1740 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:23.216483 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2d28e-d81c-4352-b037-6221c6aa1740 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:23.216483 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2d28e-d81c-4352-b037-6221c6aa1740 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:23.217895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 740/1485] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:26:23.223215 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef997a-a95b-4e60-aa75-b2a909c45569 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:23.223652 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef997a-a95b-4e60-aa75-b2a909c45569 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:23.223807 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef997a-a95b-4e60-aa75-b2a909c45569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:23.289997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4fef997a-a95b-4e60-aa75-b2a909c45569 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:26:23.291206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4fef997a-a95b-4e60-aa75-b2a909c45569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:23.385466 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 746/1486] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:26:23.671575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2d28e-d81c-4352-b037-6221c6aa1740 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:26:23.673121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5ac2d28e-d81c-4352-b037-6221c6aa1740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:23.775751 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2d28e-d81c-4352-b037-6221c6aa1740 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:26:23.846067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:23.847536 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfd9f6-fb2e-4431-a6d2-e4078e94133c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:26:23.848156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfd9f6-fb2e-4431-a6d2-e4078e94133c service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:23.848431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfd9f6-fb2e-4431-a6d2-e4078e94133c service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:23.848700 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfd9f6-fb2e-4431-a6d2-e4078e94133c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:23.850321 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4fdfd9f6-fb2e-4431-a6d2-e4078e94133c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:23.957479 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfd9f6-fb2e-4431-a6d2-e4078e94133c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:26:23.958945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfd9f6-fb2e-4431-a6d2-e4078e94133c service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:26:23.977356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 741/1487] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:26:26.315817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f788243-c1dc-4623-b6dc-be5c7bdc6147 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:26.316374 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f788243-c1dc-4623-b6dc-be5c7bdc6147 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:26.316374 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f788243-c1dc-4623-b6dc-be5c7bdc6147 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:26.317628 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 747/1488] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:26:26.323476 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfb403-870d-4054-8006-7e85a50a0a05 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:26.323925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfb403-870d-4054-8006-7e85a50a0a05 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:26.324022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfb403-870d-4054-8006-7e85a50a0a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:26.390187 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-55dfb403-870d-4054-8006-7e85a50a0a05 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:26:26.391400 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-55dfb403-870d-4054-8006-7e85a50a0a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:26.444040 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:26.488241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 742/1489] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:26:26.781899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f788243-c1dc-4623-b6dc-be5c7bdc6147 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:26:26.783424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8f788243-c1dc-4623-b6dc-be5c7bdc6147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:26.821027 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:26.893504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f788243-c1dc-4623-b6dc-be5c7bdc6147 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:26:26.970272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe2b33-b5bf-4984-b0b5-4c5d42799190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:26:26.970882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2b33-b5bf-4984-b0b5-4c5d42799190 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:26.971159 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2b33-b5bf-4984-b0b5-4c5d42799190 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:26.971431 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2b33-b5bf-4984-b0b5-4c5d42799190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:26.973082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cabe2b33-b5bf-4984-b0b5-4c5d42799190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:27.054220 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:27.082791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe2b33-b5bf-4984-b0b5-4c5d42799190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:26:27.084230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe2b33-b5bf-4984-b0b5-4c5d42799190 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:26:27.102681 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 748/1490] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:26:29.728692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05781fc-777d-4a39-8576-ad7efb565cb0 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:29.729235 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05781fc-777d-4a39-8576-ad7efb565cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:29.729235 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05781fc-777d-4a39-8576-ad7efb565cb0 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:29.730722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 743/1491] 10.222.0.82 () {54 vars in 927 bytes} [Fri Sep 23 15:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:26:29.736201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf032f-58c7-4e68-85fd-1edfeadda534 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:29.736624 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf032f-58c7-4e68-85fd-1edfeadda534 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:29.736742 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf032f-58c7-4e68-85fd-1edfeadda534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:29.801370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bedf032f-58c7-4e68-85fd-1edfeadda534 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:26:29.802661 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bedf032f-58c7-4e68-85fd-1edfeadda534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:29.897670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 749/1492] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Sep 23 15:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:26:30.190060 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05781fc-777d-4a39-8576-ad7efb565cb0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:26:30.191678 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e05781fc-777d-4a39-8576-ad7efb565cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:30.293312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05781fc-777d-4a39-8576-ad7efb565cb0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:26:30.367434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b4a9c-8899-4ee5-91c5-28db623047c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:26:30.368063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b4a9c-8899-4ee5-91c5-28db623047c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:26:30.368372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b4a9c-8899-4ee5-91c5-28db623047c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:26:30.368642 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b4a9c-8899-4ee5-91c5-28db623047c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:26:30.370271 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0b5b4a9c-8899-4ee5-91c5-28db623047c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:26:30.378749 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:30.479451 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b4a9c-8899-4ee5-91c5-28db623047c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:26:30.480922 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b4a9c-8899-4ee5-91c5-28db623047c6 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:26:30.499213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 744/1493] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:26:39.896167 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=82 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:26:40.496955 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=50 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:17.886033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560ce68-aa50-4347-8545-834c67257b3d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:17.886639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560ce68-aa50-4347-8545-834c67257b3d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:17.886639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560ce68-aa50-4347-8545-834c67257b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:17.970343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8560ce68-aa50-4347-8545-834c67257b3d None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:28:17.970343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8560ce68-aa50-4347-8545-834c67257b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:28:18.075043 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 750/1494] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:28:18.083804 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7dea7-1771-439b-86ec-dbed70fe6d0e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:18.084323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7dea7-1771-439b-86ec-dbed70fe6d0e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:18.084620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7dea7-1771-439b-86ec-dbed70fe6d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:18.104995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-47e7dea7-1771-439b-86ec-dbed70fe6d0e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:28:18.106278 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-47e7dea7-1771-439b-86ec-dbed70fe6d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:28:18.114811 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 745/1495] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:28:18.128768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560ce68-aa50-4347-8545-834c67257b3d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:28:18.138961 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560ce68-aa50-4347-8545-834c67257b3d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:28:18.143749 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a48e3-78ba-4ef9-8ab4-49e26fea6628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:28:18.144615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a48e3-78ba-4ef9-8ab4-49e26fea6628 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:18.144888 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a48e3-78ba-4ef9-8ab4-49e26fea6628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:18.145157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a48e3-78ba-4ef9-8ab4-49e26fea6628 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:18.146421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a48e3-78ba-4ef9-8ab4-49e26fea6628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:28:18.146719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a48e3-78ba-4ef9-8ab4-49e26fea6628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:28:18.147738 dv-cinder-855013-3-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-638a48e3-78ba-4ef9-8ab4-49e26fea6628 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:28:18.147738 dv-cinder-855013-3-smb devstack@keystone.service[81642]: warnings.warn(msg) Sep 23 15:28:18.147738 dv-cinder-855013-3-smb devstack@keystone.service[81642]: Sep 23 15:28:18.148610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a48e3-78ba-4ef9-8ab4-49e26fea6628 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:28:18.160536 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 751/1496] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:28:18.172833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7dea7-1771-439b-86ec-dbed70fe6d0e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:28:18.181928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7dea7-1771-439b-86ec-dbed70fe6d0e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:28:18.186513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3236897-d152-4406-9343-54c4d950edcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:28:18.187121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3236897-d152-4406-9343-54c4d950edcd admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:18.187394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3236897-d152-4406-9343-54c4d950edcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:18.187661 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3236897-d152-4406-9343-54c4d950edcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:18.188295 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3236897-d152-4406-9343-54c4d950edcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:28:18.190045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: WARNING py.warnings [None req-a3236897-d152-4406-9343-54c4d950edcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:28:18.190045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: warnings.warn(msg) Sep 23 15:28:18.190045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: Sep 23 15:28:18.191226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3236897-d152-4406-9343-54c4d950edcd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:28:18.365251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 746/1497] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:28:18 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:28:18.369688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a48e3-78ba-4ef9-8ab4-49e26fea6628 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:28:18.380163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a48e3-78ba-4ef9-8ab4-49e26fea6628 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:28:18.433638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:18.440316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaafca7-6983-4c6d-ad51-99564ccb0629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:28:18.440921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaafca7-6983-4c6d-ad51-99564ccb0629 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:18.441197 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaafca7-6983-4c6d-ad51-99564ccb0629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:18.441495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaafca7-6983-4c6d-ad51-99564ccb0629 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:18.442223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaafca7-6983-4c6d-ad51-99564ccb0629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:28:18.443748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-5eaafca7-6983-4c6d-ad51-99564ccb0629 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:28:18.443748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: warnings.warn(msg) Sep 23 15:28:18.443748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: Sep 23 15:28:18.448906 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaafca7-6983-4c6d-ad51-99564ccb0629 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:28:18.575196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 752/1498] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:28:18 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:28:18.579240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3236897-d152-4406-9343-54c4d950edcd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:28:18.589273 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3236897-d152-4406-9343-54c4d950edcd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:28:18.593764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8dde2-8d28-48bc-9396-04c7dcc114c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:28:18.594357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8dde2-8d28-48bc-9396-04c7dcc114c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:18.594630 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8dde2-8d28-48bc-9396-04c7dcc114c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:18.594897 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8dde2-8d28-48bc-9396-04c7dcc114c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:18.595527 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8dde2-8d28-48bc-9396-04c7dcc114c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:28:18.596520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: WARNING py.warnings [None req-31d8dde2-8d28-48bc-9396-04c7dcc114c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:28:18.596520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: warnings.warn(msg) Sep 23 15:28:18.596520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: Sep 23 15:28:18.597386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8dde2-8d28-48bc-9396-04c7dcc114c7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:28:18.610462 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 747/1499] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:28:18.615222 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaafca7-6983-4c6d-ad51-99564ccb0629 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:28:18.625369 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaafca7-6983-4c6d-ad51-99564ccb0629 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:28:18.630066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d72cc-c256-41be-bb4d-021b6e40b9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:28:18.630713 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d72cc-c256-41be-bb4d-021b6e40b9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:18.630994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d72cc-c256-41be-bb4d-021b6e40b9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:18.631325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d72cc-c256-41be-bb4d-021b6e40b9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:18.631968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d72cc-c256-41be-bb4d-021b6e40b9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:28:18.632991 dv-cinder-855013-3-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-fc0d72cc-c256-41be-bb4d-021b6e40b9f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:28:18.632991 dv-cinder-855013-3-smb devstack@keystone.service[81642]: warnings.warn(msg) Sep 23 15:28:18.632991 dv-cinder-855013-3-smb devstack@keystone.service[81642]: Sep 23 15:28:18.633904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d72cc-c256-41be-bb4d-021b6e40b9f6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:28:18.648555 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 753/1500] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:28:18.652705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8dde2-8d28-48bc-9396-04c7dcc114c7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:28:18.663518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8dde2-8d28-48bc-9396-04c7dcc114c7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:28:18.668109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc6814-c199-4393-ba66-827192234c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:28:18.668756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc6814-c199-4393-ba66-827192234c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:18.669061 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc6814-c199-4393-ba66-827192234c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:18.669339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc6814-c199-4393-ba66-827192234c6b admin admin] PATH_INFO: `/v3/projects/78a6d728bc194a4aaf38f453c2c18f80/users/0e511e3c90834c4da78f8dbc8c3b3994/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:18.684562 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc6814-c199-4393-ba66-827192234c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a6d728bc194a4aaf38f453c2c18f80, user_id=0e511e3c90834c4da78f8dbc8c3b3994, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:28:18.685527 dv-cinder-855013-3-smb devstack@keystone.service[81643]: WARNING py.warnings [None req-88fc6814-c199-4393-ba66-827192234c6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:28:18.685527 dv-cinder-855013-3-smb devstack@keystone.service[81643]: warnings.warn(msg) Sep 23 15:28:18.685527 dv-cinder-855013-3-smb devstack@keystone.service[81643]: Sep 23 15:28:18.687478 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc6814-c199-4393-ba66-827192234c6b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:28:18.782030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 748/1501] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:28:18 2022] PUT /identity/v3/projects/78a6d728bc194a4aaf38f453c2c18f80/users/0e511e3c90834c4da78f8dbc8c3b3994/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:28:18.795057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e1e82-b8b1-4831-90ba-b7da82e8c034 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:18.795343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e1e82-b8b1-4831-90ba-b7da82e8c034 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:18.795619 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e1e82-b8b1-4831-90ba-b7da82e8c034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:18.824391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2a4e1e82-b8b1-4831-90ba-b7da82e8c034 None None] MFA Rules not processed for user `0e511e3c90834c4da78f8dbc8c3b3994`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:28:18.825636 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2a4e1e82-b8b1-4831-90ba-b7da82e8c034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:28:18.890381 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 754/1502] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:28:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:28:18.904669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004afeb-b40b-4211-a6fb-4147de718515 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:18.904956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004afeb-b40b-4211-a6fb-4147de718515 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:18.905284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004afeb-b40b-4211-a6fb-4147de718515 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:18.906752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 749/1503] 10.222.0.82 () {54 vars in 963 bytes} [Fri Sep 23 15:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:28:18.912191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e2d9-dcbf-4b84-802e-84ad40fad8ed None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:18.912478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e2d9-dcbf-4b84-802e-84ad40fad8ed None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:18.912751 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e2d9-dcbf-4b84-802e-84ad40fad8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:18.972057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9be9e2d9-dcbf-4b84-802e-84ad40fad8ed None None] MFA Rules not processed for user `47bd08ee89014df281d0c0d5f8f6cabc`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:28:18.973259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9be9e2d9-dcbf-4b84-802e-84ad40fad8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:28:19.052399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 755/1504] 10.222.0.82 () {58 vars in 1060 bytes} [Fri Sep 23 15:28:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:28:19.060977 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004afeb-b40b-4211-a6fb-4147de718515 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:28:19.072123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004afeb-b40b-4211-a6fb-4147de718515 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:28:19.075872 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b196ed-bdef-4429-b6eb-37f0a41f5761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:28:19.076726 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b196ed-bdef-4429-b6eb-37f0a41f5761 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:19.077230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b196ed-bdef-4429-b6eb-37f0a41f5761 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:19.077507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b196ed-bdef-4429-b6eb-37f0a41f5761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:19.087227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b196ed-bdef-4429-b6eb-37f0a41f5761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:28:19.089925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b196ed-bdef-4429-b6eb-37f0a41f5761 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:28:19.099481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 750/1505] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:28:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:28:19.145924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7322ff6-9ca0-4d32-b5dd-96cbda5ff3ee None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:19.146263 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7322ff6-9ca0-4d32-b5dd-96cbda5ff3ee None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:19.146469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7322ff6-9ca0-4d32-b5dd-96cbda5ff3ee None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:19.147742 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 756/1506] 10.222.0.82 () {52 vars in 830 bytes} [Fri Sep 23 15:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:28:19.151500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b196ed-bdef-4429-b6eb-37f0a41f5761 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:28:19.213875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b196ed-bdef-4429-b6eb-37f0a41f5761 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:28:19.218582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab881fa-ec52-49ee-bb68-e09753ad2567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:28:19.219151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab881fa-ec52-49ee-bb68-e09753ad2567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:19.219476 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab881fa-ec52-49ee-bb68-e09753ad2567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:19.219752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab881fa-ec52-49ee-bb68-e09753ad2567 admin admin] PATH_INFO: `/v3/users/0e511e3c90834c4da78f8dbc8c3b3994` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:19.220876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab881fa-ec52-49ee-bb68-e09753ad2567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e511e3c90834c4da78f8dbc8c3b3994)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:28:19.221921 dv-cinder-855013-3-smb devstack@keystone.service[81643]: WARNING py.warnings [None req-cab881fa-ec52-49ee-bb68-e09753ad2567 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:28:19.221921 dv-cinder-855013-3-smb devstack@keystone.service[81643]: warnings.warn(msg) Sep 23 15:28:19.221921 dv-cinder-855013-3-smb devstack@keystone.service[81643]: Sep 23 15:28:19.223124 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab881fa-ec52-49ee-bb68-e09753ad2567 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:28:19.448607 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cab881fa-ec52-49ee-bb68-e09753ad2567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e511e3c90834c4da78f8dbc8c3b3994'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:28:19.475075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cab881fa-ec52-49ee-bb68-e09753ad2567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e511e3c90834c4da78f8dbc8c3b3994'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:28:19.486138 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cab881fa-ec52-49ee-bb68-e09753ad2567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e511e3c90834c4da78f8dbc8c3b3994'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:28:19.486846 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cab881fa-ec52-49ee-bb68-e09753ad2567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e511e3c90834c4da78f8dbc8c3b3994'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:28:19.490795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:19.603826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cab881fa-ec52-49ee-bb68-e09753ad2567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e511e3c90834c4da78f8dbc8c3b3994'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:28:19.612329 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 751/1507] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:28:19 2022] DELETE /identity/v3/users/0e511e3c90834c4da78f8dbc8c3b3994 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:28:19.616770 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0446fc-8d01-4d55-a129-00cadb78f357 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:19.617076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0446fc-8d01-4d55-a129-00cadb78f357 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:19.617351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0446fc-8d01-4d55-a129-00cadb78f357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:19.636498 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7a0446fc-8d01-4d55-a129-00cadb78f357 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:28:19.637685 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7a0446fc-8d01-4d55-a129-00cadb78f357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:28:19.647568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:19.697568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 757/1508] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:28:19.707992 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab881fa-ec52-49ee-bb68-e09753ad2567 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:28:19.709460 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cab881fa-ec52-49ee-bb68-e09753ad2567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:28:19.785561 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab881fa-ec52-49ee-bb68-e09753ad2567 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:28:19.789490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cb235-148f-4ede-8d05-eaa38dd4c765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:28:19.790128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb235-148f-4ede-8d05-eaa38dd4c765 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:19.790408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb235-148f-4ede-8d05-eaa38dd4c765 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:19.790678 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cb235-148f-4ede-8d05-eaa38dd4c765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:19.799687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cb235-148f-4ede-8d05-eaa38dd4c765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:28:19.801115 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cb235-148f-4ede-8d05-eaa38dd4c765 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:28:19.810903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 752/1509] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:28:20.292450 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0446fc-8d01-4d55-a129-00cadb78f357 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:28:20.294115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7a0446fc-8d01-4d55-a129-00cadb78f357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:28:20.306847 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0446fc-8d01-4d55-a129-00cadb78f357 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:28:20.311879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d8156-ad99-4344-947f-1b50f4ecbeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:28:20.312513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d8156-ad99-4344-947f-1b50f4ecbeec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:28:20.312806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d8156-ad99-4344-947f-1b50f4ecbeec admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:28:20.313096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d8156-ad99-4344-947f-1b50f4ecbeec admin admin] PATH_INFO: `/v3/projects/78a6d728bc194a4aaf38f453c2c18f80` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:28:20.314267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d8156-ad99-4344-947f-1b50f4ecbeec admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a6d728bc194a4aaf38f453c2c18f80)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:28:20.315312 dv-cinder-855013-3-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-759d8156-ad99-4344-947f-1b50f4ecbeec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:28:20.315312 dv-cinder-855013-3-smb devstack@keystone.service[81642]: warnings.warn(msg) Sep 23 15:28:20.315312 dv-cinder-855013-3-smb devstack@keystone.service[81642]: Sep 23 15:28:20.316466 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d8156-ad99-4344-947f-1b50f4ecbeec admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:28:20.439425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-759d8156-ad99-4344-947f-1b50f4ecbeec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a6d728bc194a4aaf38f453c2c18f80', 'request_id': 'req-759d8156-ad99-4344-947f-1b50f4ecbeec'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:28:20.501131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-759d8156-ad99-4344-947f-1b50f4ecbeec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a6d728bc194a4aaf38f453c2c18f80', 'request_id': 'req-759d8156-ad99-4344-947f-1b50f4ecbeec'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:28:20.515680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-759d8156-ad99-4344-947f-1b50f4ecbeec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a6d728bc194a4aaf38f453c2c18f80', 'request_id': 'req-759d8156-ad99-4344-947f-1b50f4ecbeec'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:28:20.526788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-759d8156-ad99-4344-947f-1b50f4ecbeec admin admin] The token cache is being invalidate because project 78a6d728bc194a4aaf38f453c2c18f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:28:20.527073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-759d8156-ad99-4344-947f-1b50f4ecbeec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:28:20.527724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-759d8156-ad99-4344-947f-1b50f4ecbeec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:28:20.529303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 758/1510] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:28:20 2022] DELETE /identity/v3/projects/78a6d728bc194a4aaf38f453c2c18f80 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:28:29.806752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:28:30.523834 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:29:59.045798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286499f-6f01-46fc-a12f-9ae860a08070 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:29:59.046395 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286499f-6f01-46fc-a12f-9ae860a08070 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:29:59.046395 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286499f-6f01-46fc-a12f-9ae860a08070 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:29:59.047623 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:29:59.053255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a99f43-151d-4311-9794-2651399a317e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:29:59.053727 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a99f43-151d-4311-9794-2651399a317e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:29:59.053864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a99f43-151d-4311-9794-2651399a317e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:29:59.075615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-51a99f43-151d-4311-9794-2651399a317e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:29:59.076889 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-51a99f43-151d-4311-9794-2651399a317e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:29:59.136263 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:29:59.288146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286499f-6f01-46fc-a12f-9ae860a08070 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:29:59.289894 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0286499f-6f01-46fc-a12f-9ae860a08070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:29:59.391851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286499f-6f01-46fc-a12f-9ae860a08070 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:29:59.397256 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde42b2-c0e1-4241-990a-f277de0aee80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:29:59.398126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde42b2-c0e1-4241-990a-f277de0aee80 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:29:59.398403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde42b2-c0e1-4241-990a-f277de0aee80 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:29:59.398673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde42b2-c0e1-4241-990a-f277de0aee80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:29:59.406563 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde42b2-c0e1-4241-990a-f277de0aee80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:29:59.408131 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde42b2-c0e1-4241-990a-f277de0aee80 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:29:59.417824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 754/1513] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:30:00.509516 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96053a5c-f696-4cb0-a14c-8d370117f66a None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:00.510107 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96053a5c-f696-4cb0-a14c-8d370117f66a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:00.510107 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96053a5c-f696-4cb0-a14c-8d370117f66a None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:00.511453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:30:00.517667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a31710-595f-47c5-b079-52353fb54edf None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:00.518127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a31710-595f-47c5-b079-52353fb54edf None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:00.518236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a31710-595f-47c5-b079-52353fb54edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:00.538805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e8a31710-595f-47c5-b079-52353fb54edf None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:30:00.540003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e8a31710-595f-47c5-b079-52353fb54edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:30:00.547800 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:30:00.654280 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f78f-ab42-4c29-a739-c55b99ac2118 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:00.654608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f78f-ab42-4c29-a739-c55b99ac2118 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:00.654904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f78f-ab42-4c29-a739-c55b99ac2118 None None] PATH_INFO: `/v3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:00.656244 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 761/1516] 10.222.0.91 () {54 vars in 925 bytes} [Fri Sep 23 15:30:00 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:30:00.669519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf735-952b-443f-86e5-b57b49a85070 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:00.669838 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf735-952b-443f-86e5-b57b49a85070 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:00.670140 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf735-952b-443f-86e5-b57b49a85070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:00.700560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6f78f-ab42-4c29-a739-c55b99ac2118 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:30:00.716697 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6f78f-ab42-4c29-a739-c55b99ac2118 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:30:00.722371 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2e1c9-8844-43e3-95e9-68768155a354 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:30:00.722974 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2e1c9-8844-43e3-95e9-68768155a354 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:00.723252 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2e1c9-8844-43e3-95e9-68768155a354 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:00.723525 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2e1c9-8844-43e3-95e9-68768155a354 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:00.724518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7c1cf735-952b-443f-86e5-b57b49a85070 None None] MFA Rules not processed for user `a25109eeb1b34b3689b10e3f7c44a6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:30:00.725698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7c1cf735-952b-443f-86e5-b57b49a85070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:30:00.731990 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2e1c9-8844-43e3-95e9-68768155a354 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:30:00.733585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2e1c9-8844-43e3-95e9-68768155a354 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:30:00.743326 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 762/1517] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:30:00.805692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 756/1518] 10.222.0.91 () {58 vars in 1015 bytes} [Fri Sep 23 15:30:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:30:09.712243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f52fba-a530-4cd0-a0d2-a83a009305cf None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:09.712705 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f52fba-a530-4cd0-a0d2-a83a009305cf None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:09.712823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f52fba-a530-4cd0-a0d2-a83a009305cf None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:09.714189 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 763/1519] 10.222.0.82 () {54 vars in 961 bytes} [Fri Sep 23 15:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:30:09.719310 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c1521-1d50-40b4-ae34-e893571d4d31 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:09.719751 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c1521-1d50-40b4-ae34-e893571d4d31 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:09.719850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c1521-1d50-40b4-ae34-e893571d4d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:09.741347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-593c1521-1d50-40b4-ae34-e893571d4d31 None None] MFA Rules not processed for user `a25109eeb1b34b3689b10e3f7c44a6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:30:09.742665 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-593c1521-1d50-40b4-ae34-e893571d4d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:30:09.751697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 757/1520] 10.222.0.82 () {58 vars in 1058 bytes} [Fri Sep 23 15:30:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:30:09.759626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f52fba-a530-4cd0-a0d2-a83a009305cf None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:30:09.774541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f52fba-a530-4cd0-a0d2-a83a009305cf None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:30:09.779692 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb087dc2-886c-4587-8fab-df5d16ee4287 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25109eeb1b34b3689b10e3f7c44a6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:30:09.780340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb087dc2-886c-4587-8fab-df5d16ee4287 service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:09.780704 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb087dc2-886c-4587-8fab-df5d16ee4287 service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:09.780988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb087dc2-886c-4587-8fab-df5d16ee4287 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:09.790735 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb087dc2-886c-4587-8fab-df5d16ee4287 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:30:09.792402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb087dc2-886c-4587-8fab-df5d16ee4287 service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:30:09.803150 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 764/1521] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:30:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:30:12.223976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d7e02-9658-4686-80eb-3b451b764a8b None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:12.224515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d7e02-9658-4686-80eb-3b451b764a8b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:12.224515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d7e02-9658-4686-80eb-3b451b764a8b None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:12.225787 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:30:12.231949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42855164-2800-417f-bf6a-2c6064caa4d4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:12.232381 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42855164-2800-417f-bf6a-2c6064caa4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:12.232504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42855164-2800-417f-bf6a-2c6064caa4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:12.252794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-42855164-2800-417f-bf6a-2c6064caa4d4 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:30:12.254037 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-42855164-2800-417f-bf6a-2c6064caa4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:30:12.262537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:30:12.415399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d7e02-9658-4686-80eb-3b451b764a8b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:30:12.429851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d7e02-9658-4686-80eb-3b451b764a8b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:30:12.435146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b3f50-fa8a-483e-8a21-54e349267831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:30:12.435739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b3f50-fa8a-483e-8a21-54e349267831 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:12.436015 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b3f50-fa8a-483e-8a21-54e349267831 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:12.436286 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b3f50-fa8a-483e-8a21-54e349267831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:12.443154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:12.445384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b3f50-fa8a-483e-8a21-54e349267831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:30:12.446996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b3f50-fa8a-483e-8a21-54e349267831 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:30:12.456217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 759/1524] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:30:13.530910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b990865-4b5f-4a0c-910f-ddbdb0d042b8 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:13.531424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b990865-4b5f-4a0c-910f-ddbdb0d042b8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:13.531424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b990865-4b5f-4a0c-910f-ddbdb0d042b8 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:13.532749 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 15:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:30:13.539188 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3e8e5-76ec-4197-a159-4d49c6ead431 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:13.540324 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3e8e5-76ec-4197-a159-4d49c6ead431 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:13.540324 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3e8e5-76ec-4197-a159-4d49c6ead431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:13.559052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6eb3e8e5-76ec-4197-a159-4d49c6ead431 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:30:13.560240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6eb3e8e5-76ec-4197-a159-4d49c6ead431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:30:13.568447 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 15:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:30:13.720297 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b990865-4b5f-4a0c-910f-ddbdb0d042b8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:30:13.735055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b990865-4b5f-4a0c-910f-ddbdb0d042b8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:30:13.741057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46d2f9-2270-46b4-ba28-5180c9e2ea89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:30:13.741652 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46d2f9-2270-46b4-ba28-5180c9e2ea89 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:13.741952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46d2f9-2270-46b4-ba28-5180c9e2ea89 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:13.742225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46d2f9-2270-46b4-ba28-5180c9e2ea89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:13.750549 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46d2f9-2270-46b4-ba28-5180c9e2ea89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:30:13.755559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46d2f9-2270-46b4-ba28-5180c9e2ea89 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:30:13.762334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 767/1527] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:30:18.055423 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764bb26-9358-4721-8778-315a8ed0013f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:18.055967 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764bb26-9358-4721-8778-315a8ed0013f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:18.056067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764bb26-9358-4721-8778-315a8ed0013f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:18.057494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:30:18.062770 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4c999-5aab-4d30-a9d9-16935760ccce None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:18.063213 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4c999-5aab-4d30-a9d9-16935760ccce None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:18.063312 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4c999-5aab-4d30-a9d9-16935760ccce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:18.082985 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bef4c999-5aab-4d30-a9d9-16935760ccce None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:30:18.084185 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bef4c999-5aab-4d30-a9d9-16935760ccce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:30:18.092121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:30:18.387254 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764bb26-9358-4721-8778-315a8ed0013f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:30:18.389052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5764bb26-9358-4721-8778-315a8ed0013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:30:18.447136 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764bb26-9358-4721-8778-315a8ed0013f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:30:18.450727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f9650-ebd7-4a53-9bb3-c59da0f55e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:30:18.451337 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f9650-ebd7-4a53-9bb3-c59da0f55e25 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:18.451616 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f9650-ebd7-4a53-9bb3-c59da0f55e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:18.451888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f9650-ebd7-4a53-9bb3-c59da0f55e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:18.460994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f9650-ebd7-4a53-9bb3-c59da0f55e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:30:18.462457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f9650-ebd7-4a53-9bb3-c59da0f55e25 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:30:18.471875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 762/1530] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:30:20.646048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb9449-3e6a-4a52-95e0-14b4a280c75b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:20.646578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb9449-3e6a-4a52-95e0-14b4a280c75b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:20.646578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb9449-3e6a-4a52-95e0-14b4a280c75b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:20.647922 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:30:20.654049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac066330-7864-4bec-8690-116a4c9aab9c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:20.654484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac066330-7864-4bec-8690-116a4c9aab9c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:20.654593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac066330-7864-4bec-8690-116a4c9aab9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:20.674194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ac066330-7864-4bec-8690-116a4c9aab9c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:30:20.675415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ac066330-7864-4bec-8690-116a4c9aab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:30:20.683534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:30:20.976695 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb9449-3e6a-4a52-95e0-14b4a280c75b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:30:20.982187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=52 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:20.988273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb9449-3e6a-4a52-95e0-14b4a280c75b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:30:20.992421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486c689-d809-49f5-8765-5ca3a8d4c15a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:30:20.993031 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486c689-d809-49f5-8765-5ca3a8d4c15a service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:20.993302 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486c689-d809-49f5-8765-5ca3a8d4c15a service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:20.993566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486c689-d809-49f5-8765-5ca3a8d4c15a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:21.002369 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486c689-d809-49f5-8765-5ca3a8d4c15a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:30:21.003831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486c689-d809-49f5-8765-5ca3a8d4c15a service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:30:21.013094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 770/1533] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:30:24.936319 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f7d8-60a7-42a2-af89-5f6229bd4240 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:24.936881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f7d8-60a7-42a2-af89-5f6229bd4240 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:24.936881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f7d8-60a7-42a2-af89-5f6229bd4240 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:24.938240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:30:24.943744 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46e2d-7167-4e4a-9ebe-5386f77708c8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:24.944200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46e2d-7167-4e4a-9ebe-5386f77708c8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:24.944314 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46e2d-7167-4e4a-9ebe-5386f77708c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:24.964913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2ef46e2d-7167-4e4a-9ebe-5386f77708c8 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:30:24.966083 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2ef46e2d-7167-4e4a-9ebe-5386f77708c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:30:24.978779 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:30:25.284023 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62f7d8-60a7-42a2-af89-5f6229bd4240 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:30:25.286515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cb62f7d8-60a7-42a2-af89-5f6229bd4240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:30:25.344559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62f7d8-60a7-42a2-af89-5f6229bd4240 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:30:25.348104 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c86de3-b402-4d05-ab56-f75e0e809837 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:30:25.348698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c86de3-b402-4d05-ab56-f75e0e809837 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:25.348971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c86de3-b402-4d05-ab56-f75e0e809837 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:25.349237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c86de3-b402-4d05-ab56-f75e0e809837 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:25.358086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c86de3-b402-4d05-ab56-f75e0e809837 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:30:25.359510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c86de3-b402-4d05-ab56-f75e0e809837 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:30:25.368692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 765/1536] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:30:27.513023 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1a749-4b86-43ac-9a46-adb16aeeb4ec None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:27.513618 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1a749-4b86-43ac-9a46-adb16aeeb4ec None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:27.513618 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1a749-4b86-43ac-9a46-adb16aeeb4ec None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:27.515059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 15:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:30:27.520870 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ca417-f9e4-4ec7-8dc8-cc145c8eef10 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:27.521334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ca417-f9e4-4ec7-8dc8-cc145c8eef10 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:27.521581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ca417-f9e4-4ec7-8dc8-cc145c8eef10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:27.542613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4b6ca417-f9e4-4ec7-8dc8-cc145c8eef10 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:30:27.543831 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4b6ca417-f9e4-4ec7-8dc8-cc145c8eef10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:30:27.552299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 15:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:30:27.853100 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1a749-4b86-43ac-9a46-adb16aeeb4ec None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:30:27.854959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a7e1a749-4b86-43ac-9a46-adb16aeeb4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:30:27.869029 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1a749-4b86-43ac-9a46-adb16aeeb4ec None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:30:27.872569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c38e89-e3b6-4dab-843c-49efbf0c4714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:30:27.873169 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c38e89-e3b6-4dab-843c-49efbf0c4714 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:30:27.873442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c38e89-e3b6-4dab-843c-49efbf0c4714 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:30:27.873711 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c38e89-e3b6-4dab-843c-49efbf0c4714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:30:27.882794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c38e89-e3b6-4dab-843c-49efbf0c4714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:30:27.884287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c38e89-e3b6-4dab-843c-49efbf0c4714 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:30:27.894111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 773/1539] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:30:37.536897 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=63 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:30:37.896413 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=14 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:55.961370 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878cfa8-135a-433f-a671-c8af750e939a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:55.962184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878cfa8-135a-433f-a671-c8af750e939a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:55.962184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878cfa8-135a-433f-a671-c8af750e939a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.006809 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5878cfa8-135a-433f-a671-c8af750e939a None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:56.008137 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5878cfa8-135a-433f-a671-c8af750e939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:56.009627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d88a8-b1f0-42c9-a59a-d2109a514b29 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.010171 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d88a8-b1f0-42c9-a59a-d2109a514b29 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.010171 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d88a8-b1f0-42c9-a59a-d2109a514b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.021564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 767/1540] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:56.041360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5a4d88a8-b1f0-42c9-a59a-d2109a514b29 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:56.042772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5a4d88a8-b1f0-42c9-a59a-d2109a514b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:56.048902 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b9b80-9e1f-40b6-a8ff-e1c41a69595a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.049193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b9b80-9e1f-40b6-a8ff-e1c41a69595a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.049460 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b9b80-9e1f-40b6-a8ff-e1c41a69595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.058731 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 774/1541] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:56.067508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143b0b0-9e64-4765-96e5-d062e986d1e3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.067856 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143b0b0-9e64-4765-96e5-d062e986d1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.068069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143b0b0-9e64-4765-96e5-d062e986d1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.080979 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-213b9b80-9e1f-40b6-a8ff-e1c41a69595a None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:56.083037 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-213b9b80-9e1f-40b6-a8ff-e1c41a69595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:56.099176 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c143b0b0-9e64-4765-96e5-d062e986d1e3 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:56.100413 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c143b0b0-9e64-4765-96e5-d062e986d1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:56.105720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 768/1542] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:56.109888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b9b80-9e1f-40b6-a8ff-e1c41a69595a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:56.116715 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 775/1543] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:31:56.121900 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143b0b0-9e64-4765-96e5-d062e986d1e3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:56.122769 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b9b80-9e1f-40b6-a8ff-e1c41a69595a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:56.131992 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143b0b0-9e64-4765-96e5-d062e986d1e3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:56.135805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffb2ca-70e3-43a0-bbff-29eff91ff4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:56.136700 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffb2ca-70e3-43a0-bbff-29eff91ff4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.136984 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffb2ca-70e3-43a0-bbff-29eff91ff4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.137255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffb2ca-70e3-43a0-bbff-29eff91ff4c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.137937 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffb2ca-70e3-43a0-bbff-29eff91ff4c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:31:56.138240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffb2ca-70e3-43a0-bbff-29eff91ff4c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:56.139252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: WARNING py.warnings [None req-d1ffb2ca-70e3-43a0-bbff-29eff91ff4c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:31:56.139252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: warnings.warn(msg) Sep 23 15:31:56.139252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: Sep 23 15:31:56.140143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffb2ca-70e3-43a0-bbff-29eff91ff4c9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:56.141683 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bae38-2ff6-4c22-bb1c-01056b41c65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:56.142361 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bae38-2ff6-4c22-bb1c-01056b41c65e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.142607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bae38-2ff6-4c22-bb1c-01056b41c65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.142879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bae38-2ff6-4c22-bb1c-01056b41c65e admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.143672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bae38-2ff6-4c22-bb1c-01056b41c65e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:31:56.143977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bae38-2ff6-4c22-bb1c-01056b41c65e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:56.145583 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bae38-2ff6-4c22-bb1c-01056b41c65e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:56.162078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 769/1544] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:31:56.168903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffb2ca-70e3-43a0-bbff-29eff91ff4c9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:56.171204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 776/1545] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:31:56.179266 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bae38-2ff6-4c22-bb1c-01056b41c65e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:56.184784 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffb2ca-70e3-43a0-bbff-29eff91ff4c9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:56.191621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bae38-2ff6-4c22-bb1c-01056b41c65e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:56.195195 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bed44-8490-4646-9229-f3299e7108c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:56.195819 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bed44-8490-4646-9229-f3299e7108c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.196234 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bed44-8490-4646-9229-f3299e7108c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.196507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bed44-8490-4646-9229-f3299e7108c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.197703 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5bed44-8490-4646-9229-f3299e7108c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:56.199623 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5bed44-8490-4646-9229-f3299e7108c1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:56.210580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c0c6e-e6cb-40d0-8188-228e807c8b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:56.211215 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c0c6e-e6cb-40d0-8188-228e807c8b2b admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.211555 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c0c6e-e6cb-40d0-8188-228e807c8b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.211773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c0c6e-e6cb-40d0-8188-228e807c8b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.212408 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c0c6e-e6cb-40d0-8188-228e807c8b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:56.214067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-908c0c6e-e6cb-40d0-8188-228e807c8b2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:31:56.214067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: warnings.warn(msg) Sep 23 15:31:56.214067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: Sep 23 15:31:56.215241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c0c6e-e6cb-40d0-8188-228e807c8b2b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:56.385927 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 770/1546] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:31:56.387389 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa75e0-7ab6-4000-97c5-1488b690c2dd None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.387697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa75e0-7ab6-4000-97c5-1488b690c2dd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.388095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa75e0-7ab6-4000-97c5-1488b690c2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.409191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-cdfa75e0-7ab6-4000-97c5-1488b690c2dd None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:56.410399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cdfa75e0-7ab6-4000-97c5-1488b690c2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:56.428158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 777/1547] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/projects => generated 383 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:31:56.428158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08376e-1e65-460a-8232-baa54c3a449e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.428158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08376e-1e65-460a-8232-baa54c3a449e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.428158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08376e-1e65-460a-8232-baa54c3a449e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.450653 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ce08376e-1e65-460a-8232-baa54c3a449e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:56.451854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ce08376e-1e65-460a-8232-baa54c3a449e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:56.481084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 771/1548] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:56.481084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9011b94-e643-4f09-a3da-3f17aed26091 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.481084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9011b94-e643-4f09-a3da-3f17aed26091 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.481084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9011b94-e643-4f09-a3da-3f17aed26091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.502514 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d9011b94-e643-4f09-a3da-3f17aed26091 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:56.503715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d9011b94-e643-4f09-a3da-3f17aed26091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:56.515970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 778/1549] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:56.517698 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85727b-783f-42b7-897a-39d0c8a7d595 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.518011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85727b-783f-42b7-897a-39d0c8a7d595 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.518281 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85727b-783f-42b7-897a-39d0c8a7d595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.538975 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bf85727b-783f-42b7-897a-39d0c8a7d595 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:56.540482 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bf85727b-783f-42b7-897a-39d0c8a7d595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:56.548427 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 779/1550] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:56.551553 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca2662-a68b-4b97-b471-d004177aa003 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.551912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca2662-a68b-4b97-b471-d004177aa003 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.552190 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca2662-a68b-4b97-b471-d004177aa003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.565875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 772/1551] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:56.566975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9011b94-e643-4f09-a3da-3f17aed26091 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:56.578165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9011b94-e643-4f09-a3da-3f17aed26091 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:56.579306 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-95ca2662-a68b-4b97-b471-d004177aa003 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:56.580503 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-95ca2662-a68b-4b97-b471-d004177aa003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:56.582834 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00db790-07b4-400c-b775-18d7e6aa248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:56.583429 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00db790-07b4-400c-b775-18d7e6aa248d admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.583705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00db790-07b4-400c-b775-18d7e6aa248d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.583971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00db790-07b4-400c-b775-18d7e6aa248d admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.584598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00db790-07b4-400c-b775-18d7e6aa248d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:56.585590 dv-cinder-855013-3-smb devstack@keystone.service[81643]: WARNING py.warnings [None req-b00db790-07b4-400c-b775-18d7e6aa248d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:31:56.585590 dv-cinder-855013-3-smb devstack@keystone.service[81643]: warnings.warn(msg) Sep 23 15:31:56.585590 dv-cinder-855013-3-smb devstack@keystone.service[81643]: Sep 23 15:31:56.586920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00db790-07b4-400c-b775-18d7e6aa248d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:56.588730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 780/1552] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:56.589503 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca2662-a68b-4b97-b471-d004177aa003 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:56.599082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca2662-a68b-4b97-b471-d004177aa003 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:56.603665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736d809-6ca7-43c5-9fa9-e6f1be16c6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:56.604252 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d809-6ca7-43c5-9fa9-e6f1be16c6f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.604528 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d809-6ca7-43c5-9fa9-e6f1be16c6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.604790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d809-6ca7-43c5-9fa9-e6f1be16c6f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.605495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736d809-6ca7-43c5-9fa9-e6f1be16c6f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:56.607440 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736d809-6ca7-43c5-9fa9-e6f1be16c6f4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:56.706313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 773/1553] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:56.707562 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44b39e-0e23-4ef0-9ce0-7297b1c12f85 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.707847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44b39e-0e23-4ef0-9ce0-7297b1c12f85 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.708125 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44b39e-0e23-4ef0-9ce0-7297b1c12f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.727323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5c44b39e-0e23-4ef0-9ce0-7297b1c12f85 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:56.729015 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5c44b39e-0e23-4ef0-9ce0-7297b1c12f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:56.736848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 774/1554] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:56.737975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e90282-7999-4643-997e-930d69a1525d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.738256 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e90282-7999-4643-997e-930d69a1525d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.738526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e90282-7999-4643-997e-930d69a1525d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.757853 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 781/1555] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:56.765488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f7e90282-7999-4643-997e-930d69a1525d None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:56.765785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583cdbd-6497-4e9f-869d-acde9b498a2e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.765896 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f7e90282-7999-4643-997e-930d69a1525d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:56.765989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583cdbd-6497-4e9f-869d-acde9b498a2e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.765989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583cdbd-6497-4e9f-869d-acde9b498a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.770003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 775/1556] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:56.770003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c429209-7604-4f10-ac3a-dab28858a7bc None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.770003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c429209-7604-4f10-ac3a-dab28858a7bc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.770003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c429209-7604-4f10-ac3a-dab28858a7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.783412 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0583cdbd-6497-4e9f-869d-acde9b498a2e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:56.784639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0583cdbd-6497-4e9f-869d-acde9b498a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:56.788371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6c429209-7604-4f10-ac3a-dab28858a7bc None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:56.789532 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6c429209-7604-4f10-ac3a-dab28858a7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:56.792895 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 782/1557] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:56.794175 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca796-2349-45c8-b437-95733f25df91 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.794451 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca796-2349-45c8-b437-95733f25df91 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.794722 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca796-2349-45c8-b437-95733f25df91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.799944 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 776/1558] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:56.800090 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fab237-feac-4220-9c26-eca2c63cd05e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.808731 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fab237-feac-4220-9c26-eca2c63cd05e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.808731 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fab237-feac-4220-9c26-eca2c63cd05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.815653 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-687ca796-2349-45c8-b437-95733f25df91 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:56.817054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-687ca796-2349-45c8-b437-95733f25df91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:56.821617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-73fab237-feac-4220-9c26-eca2c63cd05e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:56.825965 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-73fab237-feac-4220-9c26-eca2c63cd05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:56.826087 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 783/1559] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:56.826615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ca796-2349-45c8-b437-95733f25df91 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:56.831271 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 777/1560] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:56.832063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fab237-feac-4220-9c26-eca2c63cd05e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:56.840745 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ca796-2349-45c8-b437-95733f25df91 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:56.844405 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fab237-feac-4220-9c26-eca2c63cd05e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:56.845516 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924181fa-37a6-4888-94e2-cfc4de7d7c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:56.846151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924181fa-37a6-4888-94e2-cfc4de7d7c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.846422 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924181fa-37a6-4888-94e2-cfc4de7d7c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.846693 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924181fa-37a6-4888-94e2-cfc4de7d7c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.847331 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924181fa-37a6-4888-94e2-cfc4de7d7c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:56.848918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924181fa-37a6-4888-94e2-cfc4de7d7c80 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:56.849050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91767c8-bbdd-4273-887e-a8e3a82000be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:56.849681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91767c8-bbdd-4273-887e-a8e3a82000be admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.849998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91767c8-bbdd-4273-887e-a8e3a82000be admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.850266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91767c8-bbdd-4273-887e-a8e3a82000be admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.850936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91767c8-bbdd-4273-887e-a8e3a82000be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:31:56.851233 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91767c8-bbdd-4273-887e-a8e3a82000be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:56.852792 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91767c8-bbdd-4273-887e-a8e3a82000be admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:56.855910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:56.860945 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 784/1561] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:31:56.861811 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924181fa-37a6-4888-94e2-cfc4de7d7c80 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:56.865694 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 778/1562] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:31:56.867053 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e7a75-7d62-4ef2-bc97-d2d2ec7d2b02 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.867336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e7a75-7d62-4ef2-bc97-d2d2ec7d2b02 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.867604 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e7a75-7d62-4ef2-bc97-d2d2ec7d2b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.878550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924181fa-37a6-4888-94e2-cfc4de7d7c80 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:56.883193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3a5c8-339f-4c34-831c-79f2f7f16a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:56.884011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3a5c8-339f-4c34-831c-79f2f7f16a23 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.884352 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3a5c8-339f-4c34-831c-79f2f7f16a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.884631 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3a5c8-339f-4c34-831c-79f2f7f16a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.885275 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3a5c8-339f-4c34-831c-79f2f7f16a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:56.886994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3a5c8-339f-4c34-831c-79f2f7f16a23 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:56.888093 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-529e7a75-7d62-4ef2-bc97-d2d2ec7d2b02 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:56.889502 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-529e7a75-7d62-4ef2-bc97-d2d2ec7d2b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:56.897185 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 785/1563] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:31:56.898396 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3a5c8-339f-4c34-831c-79f2f7f16a23 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:56.899152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 779/1564] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:56.899979 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e7a75-7d62-4ef2-bc97-d2d2ec7d2b02 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:56.909628 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e7a75-7d62-4ef2-bc97-d2d2ec7d2b02 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:56.911794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3a5c8-339f-4c34-831c-79f2f7f16a23 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:56.914491 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4c272-fd20-4255-995e-47f7fc369c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:56.915125 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4c272-fd20-4255-995e-47f7fc369c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.915404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4c272-fd20-4255-995e-47f7fc369c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.916200 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4c272-fd20-4255-995e-47f7fc369c7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.916858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4c272-fd20-4255-995e-47f7fc369c7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:31:56.916981 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeffbc2-5110-4102-9245-ffa55299249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:56.917425 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4c272-fd20-4255-995e-47f7fc369c7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:56.917547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeffbc2-5110-4102-9245-ffa55299249b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.917713 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeffbc2-5110-4102-9245-ffa55299249b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.918136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeffbc2-5110-4102-9245-ffa55299249b admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.918759 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeffbc2-5110-4102-9245-ffa55299249b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:31:56.919062 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeffbc2-5110-4102-9245-ffa55299249b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:56.919175 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4c272-fd20-4255-995e-47f7fc369c7d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:56.920648 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeffbc2-5110-4102-9245-ffa55299249b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:56.933109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 780/1565] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:31:56.933759 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 786/1566] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:31:56.934420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4c272-fd20-4255-995e-47f7fc369c7d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:56.935061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeffbc2-5110-4102-9245-ffa55299249b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:56.946565 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4c272-fd20-4255-995e-47f7fc369c7d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:56.950462 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeffbc2-5110-4102-9245-ffa55299249b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:56.951211 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023baaf-45eb-40f5-aa17-b7b4e8b809b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:56.951808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023baaf-45eb-40f5-aa17-b7b4e8b809b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.952083 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023baaf-45eb-40f5-aa17-b7b4e8b809b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.952351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023baaf-45eb-40f5-aa17-b7b4e8b809b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.953006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023baaf-45eb-40f5-aa17-b7b4e8b809b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:31:56.953302 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023baaf-45eb-40f5-aa17-b7b4e8b809b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:56.954957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023baaf-45eb-40f5-aa17-b7b4e8b809b7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:56.955091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6a746-9f16-4b82-9914-ad2ee88856b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:56.955597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6a746-9f16-4b82-9914-ad2ee88856b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.955875 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6a746-9f16-4b82-9914-ad2ee88856b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.956147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6a746-9f16-4b82-9914-ad2ee88856b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.956783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6a746-9f16-4b82-9914-ad2ee88856b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:31:56.957082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6a746-9f16-4b82-9914-ad2ee88856b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:56.958715 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6a746-9f16-4b82-9914-ad2ee88856b3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:56.967817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 781/1567] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:31:56.967817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023baaf-45eb-40f5-aa17-b7b4e8b809b7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:56.978848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 787/1568] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:31:56.979875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023baaf-45eb-40f5-aa17-b7b4e8b809b7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:56.980296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6a746-9f16-4b82-9914-ad2ee88856b3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:56.984517 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02b819-62d2-4e49-b74e-0ddeb182add8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:56.985142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02b819-62d2-4e49-b74e-0ddeb182add8 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.985417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02b819-62d2-4e49-b74e-0ddeb182add8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.985912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02b819-62d2-4e49-b74e-0ddeb182add8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.986406 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02b819-62d2-4e49-b74e-0ddeb182add8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:56.988038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02b819-62d2-4e49-b74e-0ddeb182add8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:56.991524 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6a746-9f16-4b82-9914-ad2ee88856b3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:56.996634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d6d64-ef73-4a6c-9baf-a896b22c7183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:56.997224 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d6d64-ef73-4a6c-9baf-a896b22c7183 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:56.997526 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d6d64-ef73-4a6c-9baf-a896b22c7183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:56.997829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d6d64-ef73-4a6c-9baf-a896b22c7183 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:56.998451 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d6d64-ef73-4a6c-9baf-a896b22c7183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:56.999175 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 782/1569] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:31:56.999834 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02b819-62d2-4e49-b74e-0ddeb182add8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:57.000468 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d6d64-ef73-4a6c-9baf-a896b22c7183 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:57.010969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02b819-62d2-4e49-b74e-0ddeb182add8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:57.015531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e4a96-54ff-472a-8827-af882bdaf7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:57.016120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e4a96-54ff-472a-8827-af882bdaf7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:57.016398 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e4a96-54ff-472a-8827-af882bdaf7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:57.016674 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e4a96-54ff-472a-8827-af882bdaf7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:57.017309 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e4a96-54ff-472a-8827-af882bdaf7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:57.018931 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e4a96-54ff-472a-8827-af882bdaf7e2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:57.029575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 783/1570] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:31:57.030390 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e4a96-54ff-472a-8827-af882bdaf7e2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:57.040430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e4a96-54ff-472a-8827-af882bdaf7e2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:57.045647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63704165-eea4-4de3-b759-fbfa40cbe49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:57.046271 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63704165-eea4-4de3-b759-fbfa40cbe49b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:57.046550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63704165-eea4-4de3-b759-fbfa40cbe49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:57.046822 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63704165-eea4-4de3-b759-fbfa40cbe49b admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:57.047500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63704165-eea4-4de3-b759-fbfa40cbe49b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:31:57.047795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63704165-eea4-4de3-b759-fbfa40cbe49b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:57.049377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63704165-eea4-4de3-b759-fbfa40cbe49b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:57.061136 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 784/1571] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:31:57.061940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63704165-eea4-4de3-b759-fbfa40cbe49b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:57.071263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63704165-eea4-4de3-b759-fbfa40cbe49b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:57.075889 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f94b30-439d-4bd5-b722-c1a023271118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:57.080548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f94b30-439d-4bd5-b722-c1a023271118 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:57.080548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f94b30-439d-4bd5-b722-c1a023271118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:57.080548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f94b30-439d-4bd5-b722-c1a023271118 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:57.080548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f94b30-439d-4bd5-b722-c1a023271118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:57.080548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f94b30-439d-4bd5-b722-c1a023271118 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:57.112684 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:57.119911 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 788/1572] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:31:56 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:57.120822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d6d64-ef73-4a6c-9baf-a896b22c7183 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:57.181471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d6d64-ef73-4a6c-9baf-a896b22c7183 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:57.186981 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 785/1573] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:31:57 2022] POST /identity/v3/projects => generated 405 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:57.186981 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f94b30-439d-4bd5-b722-c1a023271118 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:57.187240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fae72-470d-4cea-ad35-e163d6559715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:57.187240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fae72-470d-4cea-ad35-e163d6559715 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:57.187443 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fae72-470d-4cea-ad35-e163d6559715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:57.187539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fae72-470d-4cea-ad35-e163d6559715 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:57.188221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fae72-470d-4cea-ad35-e163d6559715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:57.190189 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fae72-470d-4cea-ad35-e163d6559715 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:57.246706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f94b30-439d-4bd5-b722-c1a023271118 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:57.251355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e66d9-6b76-4226-91c9-ce7db3957841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:57.251955 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e66d9-6b76-4226-91c9-ce7db3957841 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:57.252234 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e66d9-6b76-4226-91c9-ce7db3957841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:57.252511 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e66d9-6b76-4226-91c9-ce7db3957841 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:57.253134 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e66d9-6b76-4226-91c9-ce7db3957841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:57.255399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e66d9-6b76-4226-91c9-ce7db3957841 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:57.292787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 789/1574] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:31:57 2022] POST /identity/v3/projects => generated 389 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:57.293614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fae72-470d-4cea-ad35-e163d6559715 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:57.354503 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fae72-470d-4cea-ad35-e163d6559715 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:57.359207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144cfc4-a5cf-417f-af1d-e91438b7473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:57.359812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144cfc4-a5cf-417f-af1d-e91438b7473c admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:57.360091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144cfc4-a5cf-417f-af1d-e91438b7473c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:57.360370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144cfc4-a5cf-417f-af1d-e91438b7473c admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:57.360988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144cfc4-a5cf-417f-af1d-e91438b7473c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:57.362937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144cfc4-a5cf-417f-af1d-e91438b7473c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:57.364803 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 786/1575] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:31:57 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:57.365612 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e66d9-6b76-4226-91c9-ce7db3957841 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:57.420467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:57.439895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e66d9-6b76-4226-91c9-ce7db3957841 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:57.444636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce733a1-25d9-424c-b2a5-ff139d3589df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:57.455305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce733a1-25d9-424c-b2a5-ff139d3589df admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:57.455305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce733a1-25d9-424c-b2a5-ff139d3589df admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:57.455305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce733a1-25d9-424c-b2a5-ff139d3589df admin admin] PATH_INFO: `/v3/projects/d5836149591f474ca4d0590f6b54aeb6/users/916f85e42444497ca4d4993f233d63c2/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:57.460771 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce733a1-25d9-424c-b2a5-ff139d3589df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5836149591f474ca4d0590f6b54aeb6, user_id=916f85e42444497ca4d4993f233d63c2, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:57.464115 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce733a1-25d9-424c-b2a5-ff139d3589df admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:57.486877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 790/1576] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:31:57 2022] POST /identity/v3/projects => generated 393 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:57.490050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144cfc4-a5cf-417f-af1d-e91438b7473c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:57.551313 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144cfc4-a5cf-417f-af1d-e91438b7473c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:57.554602 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 787/1577] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:31:57 2022] PUT /identity/v3/projects/d5836149591f474ca4d0590f6b54aeb6/users/916f85e42444497ca4d4993f233d63c2/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:31:57.555404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce733a1-25d9-424c-b2a5-ff139d3589df admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:57.564085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:57.610171 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12ab5a-95a0-41ee-9d5f-5fc857800b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:57.610832 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12ab5a-95a0-41ee-9d5f-5fc857800b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:57.611109 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12ab5a-95a0-41ee-9d5f-5fc857800b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:57.611380 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12ab5a-95a0-41ee-9d5f-5fc857800b20 admin admin] PATH_INFO: `/v3/projects/7c603ad897954e7486355a268ddc9e67/users/54fa2fa4e7dc4ecdad4985d791205b95/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:57.619255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce733a1-25d9-424c-b2a5-ff139d3589df admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:57.623910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f537ae9-39b1-45af-a062-40d9f8c06c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:57.624512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f537ae9-39b1-45af-a062-40d9f8c06c03 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:57.624793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f537ae9-39b1-45af-a062-40d9f8c06c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:57.625064 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f537ae9-39b1-45af-a062-40d9f8c06c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:57.625566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12ab5a-95a0-41ee-9d5f-5fc857800b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c603ad897954e7486355a268ddc9e67, user_id=54fa2fa4e7dc4ecdad4985d791205b95, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:57.625681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f537ae9-39b1-45af-a062-40d9f8c06c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:57.626754 dv-cinder-855013-3-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-6b12ab5a-95a0-41ee-9d5f-5fc857800b20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:31:57.626754 dv-cinder-855013-3-smb devstack@keystone.service[81642]: warnings.warn(msg) Sep 23 15:31:57.626754 dv-cinder-855013-3-smb devstack@keystone.service[81642]: Sep 23 15:31:57.627645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f537ae9-39b1-45af-a062-40d9f8c06c03 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:57.629010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12ab5a-95a0-41ee-9d5f-5fc857800b20 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:57.714582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 791/1578] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:31:57 2022] PUT /identity/v3/projects/7c603ad897954e7486355a268ddc9e67/users/54fa2fa4e7dc4ecdad4985d791205b95/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:31:57.715392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12ab5a-95a0-41ee-9d5f-5fc857800b20 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:57.754923 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 788/1579] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:31:57 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:57.754923 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f537ae9-39b1-45af-a062-40d9f8c06c03 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:57.777914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12ab5a-95a0-41ee-9d5f-5fc857800b20 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:57.815281 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f537ae9-39b1-45af-a062-40d9f8c06c03 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:57.820057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172132f6-62f3-4774-9e62-7625352f665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:57.820657 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172132f6-62f3-4774-9e62-7625352f665f admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:57.820962 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172132f6-62f3-4774-9e62-7625352f665f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:57.821232 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172132f6-62f3-4774-9e62-7625352f665f admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:57.822505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172132f6-62f3-4774-9e62-7625352f665f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:57.824427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172132f6-62f3-4774-9e62-7625352f665f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:57.833552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449e8f7-3bf5-4564-970e-5695cc47b772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:57.834177 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449e8f7-3bf5-4564-970e-5695cc47b772 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:57.834453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449e8f7-3bf5-4564-970e-5695cc47b772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:57.834724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449e8f7-3bf5-4564-970e-5695cc47b772 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:57.835608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449e8f7-3bf5-4564-970e-5695cc47b772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:57.837242 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449e8f7-3bf5-4564-970e-5695cc47b772 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:57.940843 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 789/1580] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:31:57 2022] POST /identity/v3/users => generated 303 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:57.944092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172132f6-62f3-4774-9e62-7625352f665f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:57.951762 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172132f6-62f3-4774-9e62-7625352f665f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:57.956379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e686c4f-0e1f-4364-a7eb-3e493f80f885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:57.956954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e686c4f-0e1f-4364-a7eb-3e493f80f885 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:57.957231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e686c4f-0e1f-4364-a7eb-3e493f80f885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:57.957498 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e686c4f-0e1f-4364-a7eb-3e493f80f885 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:57.958173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e686c4f-0e1f-4364-a7eb-3e493f80f885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:57.960104 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e686c4f-0e1f-4364-a7eb-3e493f80f885 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:57.968364 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 792/1581] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:31:57 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:57.969189 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449e8f7-3bf5-4564-970e-5695cc47b772 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:57.978989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449e8f7-3bf5-4564-970e-5695cc47b772 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:57.983643 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11a36d-704c-4bd2-9671-d43e9431e9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:57.984227 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11a36d-704c-4bd2-9671-d43e9431e9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:57.984504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11a36d-704c-4bd2-9671-d43e9431e9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:57.984774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11a36d-704c-4bd2-9671-d43e9431e9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:57.985390 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11a36d-704c-4bd2-9671-d43e9431e9e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:57.987337 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11a36d-704c-4bd2-9671-d43e9431e9e6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.064072 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 790/1582] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:31:57 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:58.064981 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e686c4f-0e1f-4364-a7eb-3e493f80f885 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.078071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 793/1583] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:31:57 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:58.078282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e686c4f-0e1f-4364-a7eb-3e493f80f885 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.078394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffdc59-df53-49c8-a041-48f99578b6d4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.078394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffdc59-df53-49c8-a041-48f99578b6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.078394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffdc59-df53-49c8-a041-48f99578b6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.081299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af327216-6604-4af8-a047-165cfd6c9fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.082158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af327216-6604-4af8-a047-165cfd6c9fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.082434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af327216-6604-4af8-a047-165cfd6c9fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.082700 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af327216-6604-4af8-a047-165cfd6c9fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.083326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af327216-6604-4af8-a047-165cfd6c9fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.085354 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af327216-6604-4af8-a047-165cfd6c9fd7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.096720 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cbffdc59-df53-49c8-a041-48f99578b6d4 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:58.097955 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cbffdc59-df53-49c8-a041-48f99578b6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:58.105491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 794/1584] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:58.106724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47732ce-36e7-4795-8824-5aa47a996559 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.107000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47732ce-36e7-4795-8824-5aa47a996559 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.107268 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47732ce-36e7-4795-8824-5aa47a996559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.127687 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:58.136078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d47732ce-36e7-4795-8824-5aa47a996559 None None] MFA Rules not processed for user `54fa2fa4e7dc4ecdad4985d791205b95`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:58.137259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d47732ce-36e7-4795-8824-5aa47a996559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:58.177406 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 791/1585] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:31:58 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:58.178307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af327216-6604-4af8-a047-165cfd6c9fd7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.188738 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af327216-6604-4af8-a047-165cfd6c9fd7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.193687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ac9b8-752c-4028-8cce-0c4156e74b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.194328 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ac9b8-752c-4028-8cce-0c4156e74b1a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.194615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ac9b8-752c-4028-8cce-0c4156e74b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.194916 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ac9b8-752c-4028-8cce-0c4156e74b1a admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.195513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ac9b8-752c-4028-8cce-0c4156e74b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.197578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ac9b8-752c-4028-8cce-0c4156e74b1a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.200639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 795/1586] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:58.201468 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47732ce-36e7-4795-8824-5aa47a996559 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.209078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=86,keystone:INSERT=14 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:58.222231 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47732ce-36e7-4795-8824-5aa47a996559 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.227014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8ed82-cb7f-4794-b9e5-6ea4e37e93da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.227660 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8ed82-cb7f-4794-b9e5-6ea4e37e93da admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.227906 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8ed82-cb7f-4794-b9e5-6ea4e37e93da admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.228695 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8ed82-cb7f-4794-b9e5-6ea4e37e93da admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.229329 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8ed82-cb7f-4794-b9e5-6ea4e37e93da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.231034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8ed82-cb7f-4794-b9e5-6ea4e37e93da admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.241988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 796/1587] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:31:58.242837 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8ed82-cb7f-4794-b9e5-6ea4e37e93da admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.253078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8ed82-cb7f-4794-b9e5-6ea4e37e93da admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.257698 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26d2f3-63ee-4c22-8847-4f526379d918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.258306 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26d2f3-63ee-4c22-8847-4f526379d918 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.258584 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26d2f3-63ee-4c22-8847-4f526379d918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.258857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26d2f3-63ee-4c22-8847-4f526379d918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.259482 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26d2f3-63ee-4c22-8847-4f526379d918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.261254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26d2f3-63ee-4c22-8847-4f526379d918 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.271051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 797/1588] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:31:58.271852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26d2f3-63ee-4c22-8847-4f526379d918 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.281399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26d2f3-63ee-4c22-8847-4f526379d918 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.285941 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03432d1e-f5d3-45da-ae6b-dc40b24c7054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.286511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03432d1e-f5d3-45da-ae6b-dc40b24c7054 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.286788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03432d1e-f5d3-45da-ae6b-dc40b24c7054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.287059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03432d1e-f5d3-45da-ae6b-dc40b24c7054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.287678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03432d1e-f5d3-45da-ae6b-dc40b24c7054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.289432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03432d1e-f5d3-45da-ae6b-dc40b24c7054 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.300123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 798/1589] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:31:58.301059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03432d1e-f5d3-45da-ae6b-dc40b24c7054 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.306266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 792/1590] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:31:58 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:58.306266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ac9b8-752c-4028-8cce-0c4156e74b1a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.306266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-779ac9b8-752c-4028-8cce-0c4156e74b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:58.311469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03432d1e-f5d3-45da-ae6b-dc40b24c7054 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.316279 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f62efc-04ad-4c3f-a79f-6f845b2b6c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.316836 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f62efc-04ad-4c3f-a79f-6f845b2b6c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.317115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f62efc-04ad-4c3f-a79f-6f845b2b6c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.317387 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f62efc-04ad-4c3f-a79f-6f845b2b6c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.318074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f62efc-04ad-4c3f-a79f-6f845b2b6c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.319668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f62efc-04ad-4c3f-a79f-6f845b2b6c8e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.330817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 799/1591] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:31:58.336947 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f62efc-04ad-4c3f-a79f-6f845b2b6c8e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.341485 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f62efc-04ad-4c3f-a79f-6f845b2b6c8e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.346265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1cb98-4d41-4ac8-93aa-f2659af218d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.347002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1cb98-4d41-4ac8-93aa-f2659af218d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.347276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1cb98-4d41-4ac8-93aa-f2659af218d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.347542 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1cb98-4d41-4ac8-93aa-f2659af218d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.348168 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1cb98-4d41-4ac8-93aa-f2659af218d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.349823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1cb98-4d41-4ac8-93aa-f2659af218d8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.360281 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 800/1592] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:31:58.361536 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38691f75-9a70-48a5-b242-046a152e1a2b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.361827 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38691f75-9a70-48a5-b242-046a152e1a2b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.362099 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38691f75-9a70-48a5-b242-046a152e1a2b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.367207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 801/1593] 10.222.0.82 () {54 vars in 961 bytes} [Fri Sep 23 15:31:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:31:58.367207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38691f75-9a70-48a5-b242-046a152e1a2b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.367415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ac9b8-752c-4028-8cce-0c4156e74b1a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.371417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5be58-6cbe-4847-93c2-18e77b646eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.372056 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5be58-6cbe-4847-93c2-18e77b646eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.372345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5be58-6cbe-4847-93c2-18e77b646eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.372622 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5be58-6cbe-4847-93c2-18e77b646eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.376818 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38691f75-9a70-48a5-b242-046a152e1a2b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.381588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b28d9-33f2-4bb3-9d2b-44cfdbb4b068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.382225 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5be58-6cbe-4847-93c2-18e77b646eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.382362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b28d9-33f2-4bb3-9d2b-44cfdbb4b068 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.382650 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b28d9-33f2-4bb3-9d2b-44cfdbb4b068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.382930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b28d9-33f2-4bb3-9d2b-44cfdbb4b068 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.383561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b28d9-33f2-4bb3-9d2b-44cfdbb4b068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.383655 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5be58-6cbe-4847-93c2-18e77b646eb2 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.386280 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b28d9-33f2-4bb3-9d2b-44cfdbb4b068 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.394051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 793/1594] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:31:58.396109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5be58-6cbe-4847-93c2-18e77b646eb2 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.397072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 802/1595] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:31:58.397967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b28d9-33f2-4bb3-9d2b-44cfdbb4b068 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.404829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5be58-6cbe-4847-93c2-18e77b646eb2 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.410031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61551b-ca7f-4445-85cf-c99b79a5e322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.410396 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61551b-ca7f-4445-85cf-c99b79a5e322 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.410680 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61551b-ca7f-4445-85cf-c99b79a5e322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.410918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b28d9-33f2-4bb3-9d2b-44cfdbb4b068 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.411030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61551b-ca7f-4445-85cf-c99b79a5e322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.411615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61551b-ca7f-4445-85cf-c99b79a5e322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.413420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61551b-ca7f-4445-85cf-c99b79a5e322 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.417533 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d04a5-cf62-4eaf-a7c1-7708e92b6967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.418178 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d04a5-cf62-4eaf-a7c1-7708e92b6967 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.418457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d04a5-cf62-4eaf-a7c1-7708e92b6967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.418725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d04a5-cf62-4eaf-a7c1-7708e92b6967 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.419634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d04a5-cf62-4eaf-a7c1-7708e92b6967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.420992 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d04a5-cf62-4eaf-a7c1-7708e92b6967 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.424463 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 794/1596] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:31:58.425321 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61551b-ca7f-4445-85cf-c99b79a5e322 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.433587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 803/1597] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:31:58.434416 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d04a5-cf62-4eaf-a7c1-7708e92b6967 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.436990 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61551b-ca7f-4445-85cf-c99b79a5e322 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.443181 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b07c7-5c3e-485c-a980-efd19e32bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.443802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b07c7-5c3e-485c-a980-efd19e32bae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.444182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b07c7-5c3e-485c-a980-efd19e32bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.444379 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d04a5-cf62-4eaf-a7c1-7708e92b6967 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.444503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b07c7-5c3e-485c-a980-efd19e32bae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.445083 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b07c7-5c3e-485c-a980-efd19e32bae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.446730 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b07c7-5c3e-485c-a980-efd19e32bae3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.448998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d3173-e45f-4b09-a878-77fa89fdaf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.449587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d3173-e45f-4b09-a878-77fa89fdaf83 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.449915 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d3173-e45f-4b09-a878-77fa89fdaf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.450186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d3173-e45f-4b09-a878-77fa89fdaf83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.450816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d3173-e45f-4b09-a878-77fa89fdaf83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.455575 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d3173-e45f-4b09-a878-77fa89fdaf83 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.459262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 795/1598] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:31:58.459907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b07c7-5c3e-485c-a980-efd19e32bae3 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.468348 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 804/1599] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:31:58.468348 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fa917-76e4-4757-9ba7-eecf4e0a4eef None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.468348 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fa917-76e4-4757-9ba7-eecf4e0a4eef None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.468348 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fa917-76e4-4757-9ba7-eecf4e0a4eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.469919 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b07c7-5c3e-485c-a980-efd19e32bae3 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.474833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb698dc0-5b79-404c-aaba-088c52f9e437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.475432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb698dc0-5b79-404c-aaba-088c52f9e437 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.475704 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb698dc0-5b79-404c-aaba-088c52f9e437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.475970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb698dc0-5b79-404c-aaba-088c52f9e437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.476632 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb698dc0-5b79-404c-aaba-088c52f9e437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.478829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb698dc0-5b79-404c-aaba-088c52f9e437 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.489054 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 796/1600] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:31:58.490031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb698dc0-5b79-404c-aaba-088c52f9e437 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.501934 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb698dc0-5b79-404c-aaba-088c52f9e437 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.506462 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-876fa917-76e4-4757-9ba7-eecf4e0a4eef None None] MFA Rules not processed for user `6dbf682960cc447099c11862afa3206b`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:58.506764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1d0f2-dd0d-4746-a801-5410dd69bc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.507417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d0f2-dd0d-4746-a801-5410dd69bc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.507689 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d0f2-dd0d-4746-a801-5410dd69bc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.507798 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-876fa917-76e4-4757-9ba7-eecf4e0a4eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:58.507973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d0f2-dd0d-4746-a801-5410dd69bc1e admin admin] PATH_INFO: `/v3/projects/e22e45f655ac41d58516145facda78ea/users/bcdf7362657f491690378fb29ac1ec46/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.523966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1d0f2-dd0d-4746-a801-5410dd69bc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22e45f655ac41d58516145facda78ea, user_id=bcdf7362657f491690378fb29ac1ec46, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.527255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1d0f2-dd0d-4746-a801-5410dd69bc1e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.561683 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:58.578690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 805/1601] 10.222.0.82 () {58 vars in 1058 bytes} [Fri Sep 23 15:31:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:58.579502 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fa917-76e4-4757-9ba7-eecf4e0a4eef None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.590154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fa917-76e4-4757-9ba7-eecf4e0a4eef None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.594720 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efc5ab-3d22-4145-91b9-9c9e27509a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.598205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efc5ab-3d22-4145-91b9-9c9e27509a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.598205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efc5ab-3d22-4145-91b9-9c9e27509a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.598205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efc5ab-3d22-4145-91b9-9c9e27509a71 admin admin] PATH_INFO: `/v3/projects/8f048438b75a4dd5989cb8a1bf009334/users/2ff41052ee8747cb8039347a41f4e3f4/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.611230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74efc5ab-3d22-4145-91b9-9c9e27509a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f048438b75a4dd5989cb8a1bf009334, user_id=2ff41052ee8747cb8039347a41f4e3f4, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.613890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74efc5ab-3d22-4145-91b9-9c9e27509a71 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.622784 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 797/1602] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:31:58 2022] PUT /identity/v3/projects/e22e45f655ac41d58516145facda78ea/users/bcdf7362657f491690378fb29ac1ec46/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:31:58.626711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1d0f2-dd0d-4746-a801-5410dd69bc1e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.685245 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1d0f2-dd0d-4746-a801-5410dd69bc1e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.689745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8c9c3-22d5-47dd-91de-8d1de8078605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.690426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8c9c3-22d5-47dd-91de-8d1de8078605 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.690728 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8c9c3-22d5-47dd-91de-8d1de8078605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.690997 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8c9c3-22d5-47dd-91de-8d1de8078605 admin admin] PATH_INFO: `/v3/projects/ebd1c6172f374b3db629c3a9b5cf02a7/users/65e23f2d5c78471b87eb64d7a9c07b86/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.705827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8c9c3-22d5-47dd-91de-8d1de8078605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd1c6172f374b3db629c3a9b5cf02a7, user_id=65e23f2d5c78471b87eb64d7a9c07b86, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.708505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8c9c3-22d5-47dd-91de-8d1de8078605 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.716885 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 806/1603] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:31:58 2022] PUT /identity/v3/projects/8f048438b75a4dd5989cb8a1bf009334/users/2ff41052ee8747cb8039347a41f4e3f4/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:31:58.721029 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efc5ab-3d22-4145-91b9-9c9e27509a71 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.792871 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efc5ab-3d22-4145-91b9-9c9e27509a71 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.798000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc480833-46f9-4134-978f-b1373a86af75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.798591 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc480833-46f9-4134-978f-b1373a86af75 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.798768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc480833-46f9-4134-978f-b1373a86af75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.799001 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc480833-46f9-4134-978f-b1373a86af75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.799647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc480833-46f9-4134-978f-b1373a86af75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.801509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc480833-46f9-4134-978f-b1373a86af75 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.810934 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 798/1604] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:31:58 2022] PUT /identity/v3/projects/ebd1c6172f374b3db629c3a9b5cf02a7/users/65e23f2d5c78471b87eb64d7a9c07b86/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:31:58.810934 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8c9c3-22d5-47dd-91de-8d1de8078605 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.817319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 807/1605] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:31:58.823079 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc480833-46f9-4134-978f-b1373a86af75 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:58.829371 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc480833-46f9-4134-978f-b1373a86af75 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.840432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:58.878983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8c9c3-22d5-47dd-91de-8d1de8078605 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:58.885207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119f3e9-87e8-4901-9e76-7fa23ff0d428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.885930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119f3e9-87e8-4901-9e76-7fa23ff0d428 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.886186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119f3e9-87e8-4901-9e76-7fa23ff0d428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.886458 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119f3e9-87e8-4901-9e76-7fa23ff0d428 admin admin] PATH_INFO: `/v3/projects/699f177649494d049e021adad4d83617/users/a4ac6d037eee468c8eebabe4e7ce836c/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.904465 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119f3e9-87e8-4901-9e76-7fa23ff0d428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=699f177649494d049e021adad4d83617, user_id=a4ac6d037eee468c8eebabe4e7ce836c, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.905386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1e2a2-fed6-4a63-bae1-32bafec70981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:58.906300 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1e2a2-fed6-4a63-bae1-32bafec70981 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:58.906435 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1e2a2-fed6-4a63-bae1-32bafec70981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:58.906834 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1e2a2-fed6-4a63-bae1-32bafec70981 admin admin] PATH_INFO: `/v3/projects/d62e735ac8ed4d7580eacc3ca5b20451/users/b84dc5da6ae0443f92daf141837057d2/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:58.908325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119f3e9-87e8-4901-9e76-7fa23ff0d428 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:58.922700 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1e2a2-fed6-4a63-bae1-32bafec70981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62e735ac8ed4d7580eacc3ca5b20451, user_id=b84dc5da6ae0443f92daf141837057d2, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:58.925371 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1e2a2-fed6-4a63-bae1-32bafec70981 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:59.025909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 808/1606] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:31:58 2022] PUT /identity/v3/projects/d62e735ac8ed4d7580eacc3ca5b20451/users/b84dc5da6ae0443f92daf141837057d2/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:31:59.026157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 799/1607] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:31:58 2022] PUT /identity/v3/projects/699f177649494d049e021adad4d83617/users/a4ac6d037eee468c8eebabe4e7ce836c/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:31:59.026276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1e2a2-fed6-4a63-bae1-32bafec70981 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:59.026371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276537c-3d4b-407a-98ae-161fe09f5105 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:59.026371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276537c-3d4b-407a-98ae-161fe09f5105 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:59.026371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276537c-3d4b-407a-98ae-161fe09f5105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:59.060755 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9276537c-3d4b-407a-98ae-161fe09f5105 None None] MFA Rules not processed for user `bcdf7362657f491690378fb29ac1ec46`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:59.062126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9276537c-3d4b-407a-98ae-161fe09f5105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:59.085985 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:59.113562 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1e2a2-fed6-4a63-bae1-32bafec70981 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:59.119790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bdc0c-55e0-448f-9f00-36c6e72e1091 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:59.120508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bdc0c-55e0-448f-9f00-36c6e72e1091 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:59.120861 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bdc0c-55e0-448f-9f00-36c6e72e1091 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:59.121149 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bdc0c-55e0-448f-9f00-36c6e72e1091 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:59.151945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 800/1608] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:59 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:59.153967 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c4cdd-ee61-4c91-88b7-8b4b01aa7a01 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:59.154460 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c4cdd-ee61-4c91-88b7-8b4b01aa7a01 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:59.154899 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c4cdd-ee61-4c91-88b7-8b4b01aa7a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:59.175438 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-173c4cdd-ee61-4c91-88b7-8b4b01aa7a01 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:59.176885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-173c4cdd-ee61-4c91-88b7-8b4b01aa7a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:59.190489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bdc0c-55e0-448f-9f00-36c6e72e1091 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:59.192138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bdc0c-55e0-448f-9f00-36c6e72e1091 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:59.202764 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 809/1609] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:31:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:31:59.204032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca13da-62fd-4313-aea2-0c8c42a33baf None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:59.204324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca13da-62fd-4313-aea2-0c8c42a33baf None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:59.204602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca13da-62fd-4313-aea2-0c8c42a33baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:59.224488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-27ca13da-62fd-4313-aea2-0c8c42a33baf None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:59.225701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-27ca13da-62fd-4313-aea2-0c8c42a33baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:59.251607 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 801/1610] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:59.253277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c4cdd-ee61-4c91-88b7-8b4b01aa7a01 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:59.270009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c4cdd-ee61-4c91-88b7-8b4b01aa7a01 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:59.276778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b9fa1-8692-408d-88ac-ebb5e98a9fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:59.277446 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b9fa1-8692-408d-88ac-ebb5e98a9fff admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:59.277892 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b9fa1-8692-408d-88ac-ebb5e98a9fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:59.278613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b9fa1-8692-408d-88ac-ebb5e98a9fff admin admin] PATH_INFO: `/v3/projects/bb7554c7413148e49cc7048900b7ecba/users/21bce78eea1f41dea1e8cf71d12612b7/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:59.288137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 810/1611] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:59.289540 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f53ce-d85f-4ec6-a432-9a807caf135b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:59.289924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f53ce-d85f-4ec6-a432-9a807caf135b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:59.290269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f53ce-d85f-4ec6-a432-9a807caf135b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:59.304885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b9fa1-8692-408d-88ac-ebb5e98a9fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb7554c7413148e49cc7048900b7ecba, user_id=21bce78eea1f41dea1e8cf71d12612b7, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:59.309157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b9fa1-8692-408d-88ac-ebb5e98a9fff admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:59.314179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5d8f53ce-d85f-4ec6-a432-9a807caf135b None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:59.315389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5d8f53ce-d85f-4ec6-a432-9a807caf135b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:59.323875 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 811/1612] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:59.325082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082551-d131-4299-a7cc-dd8c6d0b0f70 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:59.325362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082551-d131-4299-a7cc-dd8c6d0b0f70 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:59.325634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53082551-d131-4299-a7cc-dd8c6d0b0f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:59.357354 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-53082551-d131-4299-a7cc-dd8c6d0b0f70 None None] MFA Rules not processed for user `a4ac6d037eee468c8eebabe4e7ce836c`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:59.359063 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-53082551-d131-4299-a7cc-dd8c6d0b0f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:59.379074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 802/1613] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:31:59 2022] PUT /identity/v3/projects/bb7554c7413148e49cc7048900b7ecba/users/21bce78eea1f41dea1e8cf71d12612b7/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:31:59.381618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b9fa1-8692-408d-88ac-ebb5e98a9fff admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:59.397800 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:59.460897 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 812/1614] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:59.461715 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53082551-d131-4299-a7cc-dd8c6d0b0f70 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:59.466256 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b9fa1-8692-408d-88ac-ebb5e98a9fff admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:59.471296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:59.471786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fcadc-5683-47a8-a448-6cba71f57ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:59.472969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fcadc-5683-47a8-a448-6cba71f57ddd admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:59.473482 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fcadc-5683-47a8-a448-6cba71f57ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:59.474028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fcadc-5683-47a8-a448-6cba71f57ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:59.475831 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fcadc-5683-47a8-a448-6cba71f57ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:59.478370 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fcadc-5683-47a8-a448-6cba71f57ddd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:59.519675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53082551-d131-4299-a7cc-dd8c6d0b0f70 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:59.568132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a327af4-7d46-4d1b-9364-8dd03e83937f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:59.568732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a327af4-7d46-4d1b-9364-8dd03e83937f service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:59.569009 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a327af4-7d46-4d1b-9364-8dd03e83937f service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:59.569315 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a327af4-7d46-4d1b-9364-8dd03e83937f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:59.582689 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 803/1615] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:31:59 2022] POST /identity/v3/projects => generated 403 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:59.582689 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fcadc-5683-47a8-a448-6cba71f57ddd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:59.582964 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a327af4-7d46-4d1b-9364-8dd03e83937f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:59.582964 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a327af4-7d46-4d1b-9364-8dd03e83937f service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:59.593776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 813/1616] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:31:59.594615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a327af4-7d46-4d1b-9364-8dd03e83937f service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:59.603160 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a327af4-7d46-4d1b-9364-8dd03e83937f service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:59.643622 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fcadc-5683-47a8-a448-6cba71f57ddd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:59.647340 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286611d7-f6b2-4784-90c3-8aead31010ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:59.648306 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286611d7-f6b2-4784-90c3-8aead31010ce service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:59.648664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286611d7-f6b2-4784-90c3-8aead31010ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:59.648796 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286611d7-f6b2-4784-90c3-8aead31010ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:59.656541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e376c91-110c-4c23-a21b-177cc7fed712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:59.664350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376c91-110c-4c23-a21b-177cc7fed712 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:59.664350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376c91-110c-4c23-a21b-177cc7fed712 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:59.664350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376c91-110c-4c23-a21b-177cc7fed712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:59.716825 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286611d7-f6b2-4784-90c3-8aead31010ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:59.718323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286611d7-f6b2-4784-90c3-8aead31010ce service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:59.726868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e376c91-110c-4c23-a21b-177cc7fed712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:59.728540 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e376c91-110c-4c23-a21b-177cc7fed712 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:59.729456 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 804/1617] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:31:59.730688 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d907fbd-ea1f-40c3-a672-366e02ad9d5c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:59.731038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d907fbd-ea1f-40c3-a672-366e02ad9d5c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:59.731382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d907fbd-ea1f-40c3-a672-366e02ad9d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:59.740095 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 814/1618] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:31:59.741863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f08f8-ae77-4505-ac39-8453867ee0ea None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:59.742008 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f08f8-ae77-4505-ac39-8453867ee0ea None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:59.742333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f08f8-ae77-4505-ac39-8453867ee0ea None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:59.748527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 815/1619] 10.222.0.82 () {54 vars in 912 bytes} [Fri Sep 23 15:31:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:31:59.752443 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f08f8-ae77-4505-ac39-8453867ee0ea None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:59.752617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9d907fbd-ea1f-40c3-a672-366e02ad9d5c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:59.753280 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9d907fbd-ea1f-40c3-a672-366e02ad9d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:59.762708 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 805/1620] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:31:59.763596 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d907fbd-ea1f-40c3-a672-366e02ad9d5c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:59.764836 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f08f8-ae77-4505-ac39-8453867ee0ea None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:59.769783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc72280-3a7b-4936-8464-f7a1351ace96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:59.770776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc72280-3a7b-4936-8464-f7a1351ace96 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:59.771126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc72280-3a7b-4936-8464-f7a1351ace96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:59.771467 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc72280-3a7b-4936-8464-f7a1351ace96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:59.772172 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc72280-3a7b-4936-8464-f7a1351ace96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:59.774377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc72280-3a7b-4936-8464-f7a1351ace96 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:59.775018 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d907fbd-ea1f-40c3-a672-366e02ad9d5c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:31:59.781659 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1604d-e0ec-4496-a24e-780bfd17e783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:31:59.782437 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1604d-e0ec-4496-a24e-780bfd17e783 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:59.782811 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1604d-e0ec-4496-a24e-780bfd17e783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:59.783178 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1604d-e0ec-4496-a24e-780bfd17e783 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:59.783953 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1604d-e0ec-4496-a24e-780bfd17e783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:31:59.786277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1604d-e0ec-4496-a24e-780bfd17e783 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:31:59.794305 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:31:59.913940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 816/1621] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:31:59 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:59.913940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b772b5a-e805-484e-979e-6fe6cbb5d807 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:31:59.913940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b772b5a-e805-484e-979e-6fe6cbb5d807 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:31:59.913940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b772b5a-e805-484e-979e-6fe6cbb5d807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:31:59.934621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7b772b5a-e805-484e-979e-6fe6cbb5d807 None None] MFA Rules not processed for user `6dbf682960cc447099c11862afa3206b`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:31:59.935836 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7b772b5a-e805-484e-979e-6fe6cbb5d807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:31:59.948906 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 806/1622] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:31:59 2022] POST /identity/v3/users => generated 308 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:31:59.949779 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1604d-e0ec-4496-a24e-780bfd17e783 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:31:59.974414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1604d-e0ec-4496-a24e-780bfd17e783 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:00.026024 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:00.088041 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8196c-0efe-4372-b557-9bc0b1cde9dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:00.088666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8196c-0efe-4372-b557-9bc0b1cde9dd service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:00.089707 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8196c-0efe-4372-b557-9bc0b1cde9dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:00.090047 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8196c-0efe-4372-b557-9bc0b1cde9dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:00.114969 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 817/1623] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Sep 23 15:31:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:00.116140 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b772b5a-e805-484e-979e-6fe6cbb5d807 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:00.405512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8196c-0efe-4372-b557-9bc0b1cde9dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:00.405512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8196c-0efe-4372-b557-9bc0b1cde9dd service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:00.405512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 807/1624] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:00.405512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8196c-0efe-4372-b557-9bc0b1cde9dd service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:00.405512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8196c-0efe-4372-b557-9bc0b1cde9dd service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:00.407250 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b772b5a-e805-484e-979e-6fe6cbb5d807 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:00.408559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901047c-2303-4b7e-b0cc-73283983f8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:00.408559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901047c-2303-4b7e-b0cc-73283983f8fe admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:00.408559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901047c-2303-4b7e-b0cc-73283983f8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:00.408559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901047c-2303-4b7e-b0cc-73283983f8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:00.410495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901047c-2303-4b7e-b0cc-73283983f8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:00.410495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901047c-2303-4b7e-b0cc-73283983f8fe admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:00.411975 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68b078-cfb6-4bc7-8321-072613c9a3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:00.411975 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68b078-cfb6-4bc7-8321-072613c9a3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:00.411975 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68b078-cfb6-4bc7-8321-072613c9a3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:00.411975 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68b078-cfb6-4bc7-8321-072613c9a3e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:00.412558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68b078-cfb6-4bc7-8321-072613c9a3e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:00.412558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68b078-cfb6-4bc7-8321-072613c9a3e7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:00.412765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 808/1625] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:00.412765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901047c-2303-4b7e-b0cc-73283983f8fe admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:00.412765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901047c-2303-4b7e-b0cc-73283983f8fe admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:00.412765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3172d12-8723-4fae-8238-5cf92b098e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:00.413073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3172d12-8723-4fae-8238-5cf92b098e24 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:00.413073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3172d12-8723-4fae-8238-5cf92b098e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:00.413073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3172d12-8723-4fae-8238-5cf92b098e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:00.413073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3172d12-8723-4fae-8238-5cf92b098e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:00.413073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3172d12-8723-4fae-8238-5cf92b098e24 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:00.413073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 809/1626] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:00.413465 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3172d12-8723-4fae-8238-5cf92b098e24 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:00.475905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3172d12-8723-4fae-8238-5cf92b098e24 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:00.475905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282dd18e-1dc5-4ae6-b03b-c82f4e48f1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:00.475905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dd18e-1dc5-4ae6-b03b-c82f4e48f1bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:00.475905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dd18e-1dc5-4ae6-b03b-c82f4e48f1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:00.476420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dd18e-1dc5-4ae6-b03b-c82f4e48f1bd admin admin] PATH_INFO: `/v3/projects/fa402ff8494e47b098a1a7d947d67cc1/users/53018ba4f4524e359b18361ff701a879/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:00.476420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282dd18e-1dc5-4ae6-b03b-c82f4e48f1bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa402ff8494e47b098a1a7d947d67cc1, user_id=53018ba4f4524e359b18361ff701a879, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:00.476420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282dd18e-1dc5-4ae6-b03b-c82f4e48f1bd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:00.555519 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 818/1627] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:32:00 2022] POST /identity/v3/users => generated 297 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:00.563179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68b078-cfb6-4bc7-8321-072613c9a3e7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:00.579212 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68b078-cfb6-4bc7-8321-072613c9a3e7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:00.588737 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e0b22-174b-42de-b3df-5766f0b35c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:00.589363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e0b22-174b-42de-b3df-5766f0b35c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:00.589642 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e0b22-174b-42de-b3df-5766f0b35c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:00.589945 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e0b22-174b-42de-b3df-5766f0b35c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:00.606042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e0b22-174b-42de-b3df-5766f0b35c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:00.607842 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e0b22-174b-42de-b3df-5766f0b35c61 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:00.626059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 819/1628] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:00.629532 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e0b22-174b-42de-b3df-5766f0b35c61 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:00.640467 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e0b22-174b-42de-b3df-5766f0b35c61 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:00.651066 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 810/1629] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:00 2022] PUT /identity/v3/projects/fa402ff8494e47b098a1a7d947d67cc1/users/53018ba4f4524e359b18361ff701a879/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:00.654759 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe14f6-0691-452c-b870-9d4f303a625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:00.655527 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282dd18e-1dc5-4ae6-b03b-c82f4e48f1bd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:00.656002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe14f6-0691-452c-b870-9d4f303a625b admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:00.656621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe14f6-0691-452c-b870-9d4f303a625b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:00.657026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe14f6-0691-452c-b870-9d4f303a625b admin admin] PATH_INFO: `/v3/projects/dcbc005a48fd49e5a7028c940c3be055/users/b1b9c8a32028442e991c6df1a5a491ad/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:00.692388 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe14f6-0691-452c-b870-9d4f303a625b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbc005a48fd49e5a7028c940c3be055, user_id=b1b9c8a32028442e991c6df1a5a491ad, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:00.695487 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe14f6-0691-452c-b870-9d4f303a625b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:00.763609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:00.786494 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 820/1630] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:00 2022] PUT /identity/v3/projects/dcbc005a48fd49e5a7028c940c3be055/users/b1b9c8a32028442e991c6df1a5a491ad/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:00.789296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe14f6-0691-452c-b870-9d4f303a625b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:00.796625 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282dd18e-1dc5-4ae6-b03b-c82f4e48f1bd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:00.906863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:00.929236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67a213-8aef-4c35-9473-9b840016cf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:00.930672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67a213-8aef-4c35-9473-9b840016cf27 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:00.930951 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67a213-8aef-4c35-9473-9b840016cf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:00.931255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67a213-8aef-4c35-9473-9b840016cf27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:00.933640 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67a213-8aef-4c35-9473-9b840016cf27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:00.937161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67a213-8aef-4c35-9473-9b840016cf27 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:00.977132 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 811/1631] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:00.978985 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe14f6-0691-452c-b870-9d4f303a625b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:00.982062 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67a213-8aef-4c35-9473-9b840016cf27 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:00.988772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6856a6-0a45-4fdf-937c-43d79bc274b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:00.989331 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6856a6-0a45-4fdf-937c-43d79bc274b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:00.991314 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6856a6-0a45-4fdf-937c-43d79bc274b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:00.991602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6856a6-0a45-4fdf-937c-43d79bc274b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:00.992916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6856a6-0a45-4fdf-937c-43d79bc274b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:00.998528 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6856a6-0a45-4fdf-937c-43d79bc274b4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:01.004192 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67a213-8aef-4c35-9473-9b840016cf27 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:01.018282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d78c9-2102-4c6c-bcdb-f5792b8ced65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:01.019815 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d78c9-2102-4c6c-bcdb-f5792b8ced65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:01.020094 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d78c9-2102-4c6c-bcdb-f5792b8ced65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:01.027797 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d78c9-2102-4c6c-bcdb-f5792b8ced65 admin admin] PATH_INFO: `/v3/projects/fa402ff8494e47b098a1a7d947d67cc1/users/53018ba4f4524e359b18361ff701a879/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:01.027797 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d78c9-2102-4c6c-bcdb-f5792b8ced65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa402ff8494e47b098a1a7d947d67cc1, user_id=53018ba4f4524e359b18361ff701a879, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:01.028527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 821/1632] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:32:01.029797 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d78c9-2102-4c6c-bcdb-f5792b8ced65 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:01.033098 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6856a6-0a45-4fdf-937c-43d79bc274b4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:01.055145 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6856a6-0a45-4fdf-937c-43d79bc274b4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:01.060229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 812/1633] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:00 2022] PUT /identity/v3/projects/fa402ff8494e47b098a1a7d947d67cc1/users/53018ba4f4524e359b18361ff701a879/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:32:01.071997 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f502b-decd-497a-b3ef-0b6298655f9b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:01.072631 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f502b-decd-497a-b3ef-0b6298655f9b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:01.073055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f502b-decd-497a-b3ef-0b6298655f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:01.174643 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b82f502b-decd-497a-b3ef-0b6298655f9b None None] MFA Rules not processed for user `53018ba4f4524e359b18361ff701a879`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:01.177615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b82f502b-decd-497a-b3ef-0b6298655f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:01.198739 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f0ab-fbd1-4268-93b8-d973736822dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:01.199676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f0ab-fbd1-4268-93b8-d973736822dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:01.200598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f0ab-fbd1-4268-93b8-d973736822dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:01.201140 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f0ab-fbd1-4268-93b8-d973736822dd admin admin] PATH_INFO: `/v3/projects/dcbc005a48fd49e5a7028c940c3be055/users/b1b9c8a32028442e991c6df1a5a491ad/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:01.203756 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1f0ab-fbd1-4268-93b8-d973736822dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbc005a48fd49e5a7028c940c3be055, user_id=b1b9c8a32028442e991c6df1a5a491ad, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:01.207530 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1f0ab-fbd1-4268-93b8-d973736822dd admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:01.225644 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 822/1634] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:01 2022] PUT /identity/v3/projects/dcbc005a48fd49e5a7028c940c3be055/users/b1b9c8a32028442e991c6df1a5a491ad/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:32:01.239289 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dcd79-46f1-4924-a86d-f40b6dcac8ad None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:01.239573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dcd79-46f1-4924-a86d-f40b6dcac8ad None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:01.239841 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dcd79-46f1-4924-a86d-f40b6dcac8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:01.298449 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 813/1635] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:01 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:01.311332 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f502b-decd-497a-b3ef-0b6298655f9b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:01.335270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-120dcd79-46f1-4924-a86d-f40b6dcac8ad None None] MFA Rules not processed for user `b1b9c8a32028442e991c6df1a5a491ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:01.336550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-120dcd79-46f1-4924-a86d-f40b6dcac8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:01.428859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f502b-decd-497a-b3ef-0b6298655f9b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:01.442945 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 823/1636] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:01.498928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768a0a9-8a9a-42ea-ab1b-eebd3632f3e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:01.499555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768a0a9-8a9a-42ea-ab1b-eebd3632f3e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:01.500217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768a0a9-8a9a-42ea-ab1b-eebd3632f3e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:01.500217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768a0a9-8a9a-42ea-ab1b-eebd3632f3e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:01.624680 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768a0a9-8a9a-42ea-ab1b-eebd3632f3e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:01.626489 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768a0a9-8a9a-42ea-ab1b-eebd3632f3e7 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:01.642385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 814/1637] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:01 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:32:01.731895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:01.737971 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dcd79-46f1-4924-a86d-f40b6dcac8ad None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:01.749375 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120dcd79-46f1-4924-a86d-f40b6dcac8ad None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:01.754034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ed290-1f74-4ae5-abf8-076e90dcdd27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:01.754930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ed290-1f74-4ae5-abf8-076e90dcdd27 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:01.755333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ed290-1f74-4ae5-abf8-076e90dcdd27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:01.755739 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ed290-1f74-4ae5-abf8-076e90dcdd27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:01.767574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ed290-1f74-4ae5-abf8-076e90dcdd27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:01.769449 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ed290-1f74-4ae5-abf8-076e90dcdd27 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:01.795253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 824/1638] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:02.160182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768a0a9-8a9a-42ea-ab1b-eebd3632f3e7 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:02.170617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768a0a9-8a9a-42ea-ab1b-eebd3632f3e7 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:02.186488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e025453-3808-401e-8539-1e848d8a8b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:02.189952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e025453-3808-401e-8539-1e848d8a8b45 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:02.190437 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e025453-3808-401e-8539-1e848d8a8b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:02.190891 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e025453-3808-401e-8539-1e848d8a8b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:02.241496 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ed290-1f74-4ae5-abf8-076e90dcdd27 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:02.308546 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e025453-3808-401e-8539-1e848d8a8b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:02.311048 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e025453-3808-401e-8539-1e848d8a8b45 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:02.337203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 815/1639] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:02.349718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:02.380564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10354acd-b31b-4d7a-9cc2-99f302d80880 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:02.380894 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10354acd-b31b-4d7a-9cc2-99f302d80880 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:02.381174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10354acd-b31b-4d7a-9cc2-99f302d80880 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:02.382883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 816/1640] 10.222.0.82 () {54 vars in 961 bytes} [Fri Sep 23 15:32:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:32:02.385967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ed290-1f74-4ae5-abf8-076e90dcdd27 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:02.391853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27d31c-dde5-441f-85d6-03ab1ae180db None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:02.392207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27d31c-dde5-441f-85d6-03ab1ae180db None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:02.392544 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27d31c-dde5-441f-85d6-03ab1ae180db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:02.392954 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541121c1-594b-4fd3-b0bb-976886376e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:02.393539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541121c1-594b-4fd3-b0bb-976886376e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:02.393850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541121c1-594b-4fd3-b0bb-976886376e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:02.394251 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541121c1-594b-4fd3-b0bb-976886376e94 admin admin] PATH_INFO: `/v3/users/bcdf7362657f491690378fb29ac1ec46` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:02.396450 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541121c1-594b-4fd3-b0bb-976886376e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcdf7362657f491690378fb29ac1ec46)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:02.397648 dv-cinder-855013-3-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-541121c1-594b-4fd3-b0bb-976886376e94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:32:02.397648 dv-cinder-855013-3-smb devstack@keystone.service[81642]: warnings.warn(msg) Sep 23 15:32:02.397648 dv-cinder-855013-3-smb devstack@keystone.service[81642]: Sep 23 15:32:02.400384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541121c1-594b-4fd3-b0bb-976886376e94 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:02.422678 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-eb27d31c-dde5-441f-85d6-03ab1ae180db None None] MFA Rules not processed for user `6dbf682960cc447099c11862afa3206b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:02.424248 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-eb27d31c-dde5-441f-85d6-03ab1ae180db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:02.561680 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 817/1641] 10.222.0.82 () {58 vars in 1058 bytes} [Fri Sep 23 15:32:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:32:02.568411 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a8215-ae50-4a9c-96fd-54156e0312a4 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:02.568874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a8215-ae50-4a9c-96fd-54156e0312a4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:02.569153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a8215-ae50-4a9c-96fd-54156e0312a4 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:02.571080 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 818/1642] 10.222.0.82 () {54 vars in 912 bytes} [Fri Sep 23 15:32:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:32:02.576363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c9a8a-f8cc-49e6-bd83-3a9723bae43d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:02.576713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c9a8a-f8cc-49e6-bd83-3a9723bae43d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:02.585350 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c9a8a-f8cc-49e6-bd83-3a9723bae43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:02.619004 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7a6c9a8a-f8cc-49e6-bd83-3a9723bae43d None None] MFA Rules not processed for user `6dbf682960cc447099c11862afa3206b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:02.620710 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7a6c9a8a-f8cc-49e6-bd83-3a9723bae43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:02.639983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 819/1643] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Sep 23 15:32:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:32:02.656440 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c9a8a-f8cc-49e6-bd83-3a9723bae43d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:02.675817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c9a8a-f8cc-49e6-bd83-3a9723bae43d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:02.680105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c70ed-c6f7-4a33-b0ae-1c77d614a828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:02.681379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c70ed-c6f7-4a33-b0ae-1c77d614a828 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:02.681726 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c70ed-c6f7-4a33-b0ae-1c77d614a828 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:02.682057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c70ed-c6f7-4a33-b0ae-1c77d614a828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:02.717577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c70ed-c6f7-4a33-b0ae-1c77d614a828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:02.726212 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c70ed-c6f7-4a33-b0ae-1c77d614a828 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:02.732895 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-541121c1-594b-4fd3-b0bb-976886376e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcdf7362657f491690378fb29ac1ec46'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:02.777953 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 820/1644] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:02.809773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-541121c1-594b-4fd3-b0bb-976886376e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcdf7362657f491690378fb29ac1ec46'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:02.850449 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-541121c1-594b-4fd3-b0bb-976886376e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcdf7362657f491690378fb29ac1ec46'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:02.856319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-541121c1-594b-4fd3-b0bb-976886376e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcdf7362657f491690378fb29ac1ec46'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:02.925411 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-541121c1-594b-4fd3-b0bb-976886376e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcdf7362657f491690378fb29ac1ec46'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:02.941836 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 825/1645] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:02 2022] DELETE /identity/v3/users/bcdf7362657f491690378fb29ac1ec46 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:02.947797 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cbec1-5927-4888-a995-f87cd0b3276e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:02.948086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cbec1-5927-4888-a995-f87cd0b3276e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:02.948361 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cbec1-5927-4888-a995-f87cd0b3276e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:03.034886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-cb2cbec1-5927-4888-a995-f87cd0b3276e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:03.037203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cb2cbec1-5927-4888-a995-f87cd0b3276e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:03.162301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 821/1646] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:03.350252 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541121c1-594b-4fd3-b0bb-976886376e94 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:03.354172 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-541121c1-594b-4fd3-b0bb-976886376e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:03.449466 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541121c1-594b-4fd3-b0bb-976886376e94 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:03.456904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd28e3-35a5-47c1-8682-4afa40d926c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:03.457940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd28e3-35a5-47c1-8682-4afa40d926c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:03.458173 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd28e3-35a5-47c1-8682-4afa40d926c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:03.458615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd28e3-35a5-47c1-8682-4afa40d926c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:03.472062 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd28e3-35a5-47c1-8682-4afa40d926c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:03.474254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd28e3-35a5-47c1-8682-4afa40d926c8 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:03.489831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 826/1647] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:03.777988 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:05.550387 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cbec1-5927-4888-a995-f87cd0b3276e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:05.552277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cb2cbec1-5927-4888-a995-f87cd0b3276e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:05.574861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cbec1-5927-4888-a995-f87cd0b3276e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:05.602665 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51575b76-946a-4ed7-b830-c7dc6ef20f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:05.604054 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51575b76-946a-4ed7-b830-c7dc6ef20f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:05.609647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51575b76-946a-4ed7-b830-c7dc6ef20f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:05.610307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51575b76-946a-4ed7-b830-c7dc6ef20f73 admin admin] PATH_INFO: `/v3/projects/e22e45f655ac41d58516145facda78ea` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:05.615532 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51575b76-946a-4ed7-b830-c7dc6ef20f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e22e45f655ac41d58516145facda78ea)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:05.619765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: WARNING py.warnings [None req-51575b76-946a-4ed7-b830-c7dc6ef20f73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 15:32:05.619765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: warnings.warn(msg) Sep 23 15:32:05.619765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: Sep 23 15:32:05.623066 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51575b76-946a-4ed7-b830-c7dc6ef20f73 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:05.851336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-51575b76-946a-4ed7-b830-c7dc6ef20f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22e45f655ac41d58516145facda78ea', 'request_id': 'req-51575b76-946a-4ed7-b830-c7dc6ef20f73'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:05.994954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-51575b76-946a-4ed7-b830-c7dc6ef20f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22e45f655ac41d58516145facda78ea', 'request_id': 'req-51575b76-946a-4ed7-b830-c7dc6ef20f73'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:06.003525 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-51575b76-946a-4ed7-b830-c7dc6ef20f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22e45f655ac41d58516145facda78ea', 'request_id': 'req-51575b76-946a-4ed7-b830-c7dc6ef20f73'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:06.050790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-51575b76-946a-4ed7-b830-c7dc6ef20f73 admin admin] The token cache is being invalidate because project e22e45f655ac41d58516145facda78ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:32:06.051091 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-51575b76-946a-4ed7-b830-c7dc6ef20f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:06.054458 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-51575b76-946a-4ed7-b830-c7dc6ef20f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:06.061877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 822/1648] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:05 2022] DELETE /identity/v3/projects/e22e45f655ac41d58516145facda78ea => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:06.063457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd28e3-35a5-47c1-8682-4afa40d926c8 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:06.073936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd28e3-35a5-47c1-8682-4afa40d926c8 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:06.209214 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22128a95-7a89-48f6-b2e6-6d4c28983459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:06.211852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22128a95-7a89-48f6-b2e6-6d4c28983459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:06.212189 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22128a95-7a89-48f6-b2e6-6d4c28983459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:06.212471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22128a95-7a89-48f6-b2e6-6d4c28983459 admin admin] PATH_INFO: `/v3/users/53018ba4f4524e359b18361ff701a879` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:06.214039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22128a95-7a89-48f6-b2e6-6d4c28983459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53018ba4f4524e359b18361ff701a879)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:06.221704 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22128a95-7a89-48f6-b2e6-6d4c28983459 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:06.253449 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:06.509248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-22128a95-7a89-48f6-b2e6-6d4c28983459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53018ba4f4524e359b18361ff701a879'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:06.541407 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-22128a95-7a89-48f6-b2e6-6d4c28983459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53018ba4f4524e359b18361ff701a879'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:06.557574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-22128a95-7a89-48f6-b2e6-6d4c28983459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53018ba4f4524e359b18361ff701a879'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:06.558527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-22128a95-7a89-48f6-b2e6-6d4c28983459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53018ba4f4524e359b18361ff701a879'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:06.651016 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-22128a95-7a89-48f6-b2e6-6d4c28983459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53018ba4f4524e359b18361ff701a879'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:06.658217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 827/1649] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:06 2022] DELETE /identity/v3/users/53018ba4f4524e359b18361ff701a879 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:08.404679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51575b76-946a-4ed7-b830-c7dc6ef20f73 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:08.406755 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-51575b76-946a-4ed7-b830-c7dc6ef20f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:08.426613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51575b76-946a-4ed7-b830-c7dc6ef20f73 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:08.588414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:08.601637 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3fb15-baba-46b9-b3a1-a3cc8f8e26e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:08.603143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3fb15-baba-46b9-b3a1-a3cc8f8e26e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:08.604957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3fb15-baba-46b9-b3a1-a3cc8f8e26e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:08.605401 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3fb15-baba-46b9-b3a1-a3cc8f8e26e9 admin admin] PATH_INFO: `/v3/projects/fa402ff8494e47b098a1a7d947d67cc1` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:08.608361 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3fb15-baba-46b9-b3a1-a3cc8f8e26e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa402ff8494e47b098a1a7d947d67cc1)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:08.614831 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3fb15-baba-46b9-b3a1-a3cc8f8e26e9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:08.873248 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-bcc3fb15-baba-46b9-b3a1-a3cc8f8e26e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa402ff8494e47b098a1a7d947d67cc1', 'request_id': 'req-bcc3fb15-baba-46b9-b3a1-a3cc8f8e26e9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:08.983520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-bcc3fb15-baba-46b9-b3a1-a3cc8f8e26e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa402ff8494e47b098a1a7d947d67cc1', 'request_id': 'req-bcc3fb15-baba-46b9-b3a1-a3cc8f8e26e9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:08.994768 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-bcc3fb15-baba-46b9-b3a1-a3cc8f8e26e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa402ff8494e47b098a1a7d947d67cc1', 'request_id': 'req-bcc3fb15-baba-46b9-b3a1-a3cc8f8e26e9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:09.018377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-bcc3fb15-baba-46b9-b3a1-a3cc8f8e26e9 admin admin] The token cache is being invalidate because project fa402ff8494e47b098a1a7d947d67cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:32:09.019020 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-bcc3fb15-baba-46b9-b3a1-a3cc8f8e26e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:09.020369 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-bcc3fb15-baba-46b9-b3a1-a3cc8f8e26e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:09.022409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 823/1650] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:08 2022] DELETE /identity/v3/projects/fa402ff8494e47b098a1a7d947d67cc1 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:09.028762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e7689-35d6-43ad-bea7-03c1cfdabb20 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:09.029529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e7689-35d6-43ad-bea7-03c1cfdabb20 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:09.030071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e7689-35d6-43ad-bea7-03c1cfdabb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:09.077986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2f8e7689-35d6-43ad-bea7-03c1cfdabb20 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:09.081980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2f8e7689-35d6-43ad-bea7-03c1cfdabb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:09.269969 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 828/1651] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:09.271564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c720fa7-8238-4fc8-89ff-e5506b91c7b2 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:09.271686 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c720fa7-8238-4fc8-89ff-e5506b91c7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:09.271945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c720fa7-8238-4fc8-89ff-e5506b91c7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:09.324244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2c720fa7-8238-4fc8-89ff-e5506b91c7b2 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:09.325626 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2c720fa7-8238-4fc8-89ff-e5506b91c7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:09.366274 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 824/1652] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:09.368500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e7689-35d6-43ad-bea7-03c1cfdabb20 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:09.386904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e7689-35d6-43ad-bea7-03c1cfdabb20 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:09.396650 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea38f21-5ef3-4a2d-8bac-36cde83fd3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:09.397287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38f21-5ef3-4a2d-8bac-36cde83fd3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:09.398214 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38f21-5ef3-4a2d-8bac-36cde83fd3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:09.398494 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38f21-5ef3-4a2d-8bac-36cde83fd3e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:09.399382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea38f21-5ef3-4a2d-8bac-36cde83fd3e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:32:09.400293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea38f21-5ef3-4a2d-8bac-36cde83fd3e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:09.406883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea38f21-5ef3-4a2d-8bac-36cde83fd3e5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:09.441817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 829/1653] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:32:09.447042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c720fa7-8238-4fc8-89ff-e5506b91c7b2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:09.457017 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c720fa7-8238-4fc8-89ff-e5506b91c7b2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:09.473628 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb19b4f-a5ea-442a-b7bf-d32312114c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:09.474430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb19b4f-a5ea-442a-b7bf-d32312114c97 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:09.474708 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb19b4f-a5ea-442a-b7bf-d32312114c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:09.474976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb19b4f-a5ea-442a-b7bf-d32312114c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:09.475624 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb19b4f-a5ea-442a-b7bf-d32312114c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:09.477993 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb19b4f-a5ea-442a-b7bf-d32312114c97 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:09.600447 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 825/1654] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:32:09 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:09.604574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea38f21-5ef3-4a2d-8bac-36cde83fd3e5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:09.618458 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea38f21-5ef3-4a2d-8bac-36cde83fd3e5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:09.845491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12f02e-4a56-4b34-a5fd-803eb881cac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:09.845980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12f02e-4a56-4b34-a5fd-803eb881cac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:09.846261 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12f02e-4a56-4b34-a5fd-803eb881cac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:09.846539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12f02e-4a56-4b34-a5fd-803eb881cac8 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:09.847187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12f02e-4a56-4b34-a5fd-803eb881cac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:09.849360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12f02e-4a56-4b34-a5fd-803eb881cac8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:09.927926 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb19b4f-a5ea-442a-b7bf-d32312114c97 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:09.933262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-deb19b4f-a5ea-442a-b7bf-d32312114c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:09.953289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb19b4f-a5ea-442a-b7bf-d32312114c97 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:09.969299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd0ec8-fb4c-449a-b330-57d8743cf51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:09.972702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd0ec8-fb4c-449a-b330-57d8743cf51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:09.972702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd0ec8-fb4c-449a-b330-57d8743cf51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:09.972702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd0ec8-fb4c-449a-b330-57d8743cf51d admin admin] PATH_INFO: `/v3/users/54fa2fa4e7dc4ecdad4985d791205b95` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:09.976349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd0ec8-fb4c-449a-b330-57d8743cf51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=54fa2fa4e7dc4ecdad4985d791205b95)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:09.980713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd0ec8-fb4c-449a-b330-57d8743cf51d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:10.010356 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:10.014922 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 830/1655] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:32:09 2022] POST /identity/v3/users => generated 289 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:10.019046 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12f02e-4a56-4b34-a5fd-803eb881cac8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:10.041593 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12f02e-4a56-4b34-a5fd-803eb881cac8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:10.056293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1750d84-227b-4513-a31f-6c5598757b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:10.058674 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1750d84-227b-4513-a31f-6c5598757b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:10.061667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1750d84-227b-4513-a31f-6c5598757b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:10.062296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1750d84-227b-4513-a31f-6c5598757b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:10.063185 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1750d84-227b-4513-a31f-6c5598757b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:10.068130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1750d84-227b-4513-a31f-6c5598757b22 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:10.096975 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 831/1656] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:32:10.098745 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1750d84-227b-4513-a31f-6c5598757b22 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:10.128330 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1750d84-227b-4513-a31f-6c5598757b22 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:10.140144 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1039f2-d2da-4dad-9a31-8e524db986af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:10.142097 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1039f2-d2da-4dad-9a31-8e524db986af admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:10.144441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1039f2-d2da-4dad-9a31-8e524db986af admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:10.144937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1039f2-d2da-4dad-9a31-8e524db986af admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:10.146194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1039f2-d2da-4dad-9a31-8e524db986af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:10.148662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1039f2-d2da-4dad-9a31-8e524db986af admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:10.176731 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 832/1657] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:10.182107 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1039f2-d2da-4dad-9a31-8e524db986af admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:10.226576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1039f2-d2da-4dad-9a31-8e524db986af admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:10.242386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e3cd0ec8-fb4c-449a-b330-57d8743cf51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54fa2fa4e7dc4ecdad4985d791205b95'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:10.249775 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfb7c3-4080-4c2e-8019-86bba2c13338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:10.250489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfb7c3-4080-4c2e-8019-86bba2c13338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:10.250947 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfb7c3-4080-4c2e-8019-86bba2c13338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:10.251221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfb7c3-4080-4c2e-8019-86bba2c13338 admin admin] PATH_INFO: `/v3/projects/2abcd595f2e540c79d1c557dd00a6f8d/users/f21150d591e94569afdfcc7bf2662079/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:10.281929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e3cd0ec8-fb4c-449a-b330-57d8743cf51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54fa2fa4e7dc4ecdad4985d791205b95'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:10.302904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfb7c3-4080-4c2e-8019-86bba2c13338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abcd595f2e540c79d1c557dd00a6f8d, user_id=f21150d591e94569afdfcc7bf2662079, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:10.310653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e3cd0ec8-fb4c-449a-b330-57d8743cf51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54fa2fa4e7dc4ecdad4985d791205b95'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:10.312050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e3cd0ec8-fb4c-449a-b330-57d8743cf51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54fa2fa4e7dc4ecdad4985d791205b95'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:10.314636 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfb7c3-4080-4c2e-8019-86bba2c13338 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:10.429480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e3cd0ec8-fb4c-449a-b330-57d8743cf51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54fa2fa4e7dc4ecdad4985d791205b95'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:10.443540 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 833/1658] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:10 2022] PUT /identity/v3/projects/2abcd595f2e540c79d1c557dd00a6f8d/users/f21150d591e94569afdfcc7bf2662079/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:10.444336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 826/1659] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:09 2022] DELETE /identity/v3/users/54fa2fa4e7dc4ecdad4985d791205b95 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:10.449237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a8f39-8316-486f-b887-bd30ad3d27e3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:10.449346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a8f39-8316-486f-b887-bd30ad3d27e3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:10.449622 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a8f39-8316-486f-b887-bd30ad3d27e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:10.454676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc1ff8-523d-4fe8-81b8-103b1d818856 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:10.455486 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc1ff8-523d-4fe8-81b8-103b1d818856 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:10.455905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc1ff8-523d-4fe8-81b8-103b1d818856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:10.508754 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7c8a8f39-8316-486f-b887-bd30ad3d27e3 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:10.517057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7c8a8f39-8316-486f-b887-bd30ad3d27e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:10.586394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3ecc1ff8-523d-4fe8-81b8-103b1d818856 None None] MFA Rules not processed for user `f21150d591e94569afdfcc7bf2662079`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:10.590173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3ecc1ff8-523d-4fe8-81b8-103b1d818856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:10.675526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:10.695735 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 834/1660] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:10.710506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a8f39-8316-486f-b887-bd30ad3d27e3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:10.713303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7c8a8f39-8316-486f-b887-bd30ad3d27e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:10.867519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 827/1661] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:10.869786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc1ff8-523d-4fe8-81b8-103b1d818856 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:10.893589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3ecc1ff8-523d-4fe8-81b8-103b1d818856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:10.986504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc1ff8-523d-4fe8-81b8-103b1d818856 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:10.995702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a8f39-8316-486f-b887-bd30ad3d27e3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:11.013347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab19b0d-2e70-4982-a9b1-d9be239716f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:11.013682 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786d3e7-e0db-4153-ba7a-e1a3474cf0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:11.014590 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786d3e7-e0db-4153-ba7a-e1a3474cf0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:11.014922 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786d3e7-e0db-4153-ba7a-e1a3474cf0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:11.015148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786d3e7-e0db-4153-ba7a-e1a3474cf0e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:11.016326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786d3e7-e0db-4153-ba7a-e1a3474cf0e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:11.018363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786d3e7-e0db-4153-ba7a-e1a3474cf0e2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:11.025709 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab19b0d-2e70-4982-a9b1-d9be239716f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:11.027988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab19b0d-2e70-4982-a9b1-d9be239716f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:11.033727 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab19b0d-2e70-4982-a9b1-d9be239716f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:11.054383 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab19b0d-2e70-4982-a9b1-d9be239716f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:11.056578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab19b0d-2e70-4982-a9b1-d9be239716f0 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:11.080135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 835/1662] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:32:11.250626 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 828/1663] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:32:10 2022] POST /identity/v3/projects => generated 373 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:11.250717 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab19b0d-2e70-4982-a9b1-d9be239716f0 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:11.263080 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab19b0d-2e70-4982-a9b1-d9be239716f0 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:11.405622 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae67f68-41e3-4653-9c55-5d8d5a89decf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:11.405622 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae67f68-41e3-4653-9c55-5d8d5a89decf admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:11.405622 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae67f68-41e3-4653-9c55-5d8d5a89decf admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:11.405999 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae67f68-41e3-4653-9c55-5d8d5a89decf admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:11.406447 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae67f68-41e3-4653-9c55-5d8d5a89decf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:11.408563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae67f68-41e3-4653-9c55-5d8d5a89decf admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:11.560363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 836/1664] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:32:11 2022] POST /identity/v3/users => generated 293 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:11.564629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786d3e7-e0db-4153-ba7a-e1a3474cf0e2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:11.577721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786d3e7-e0db-4153-ba7a-e1a3474cf0e2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:11.594557 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61f008-7615-422e-b9e7-9a2d0cec8f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:11.595353 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61f008-7615-422e-b9e7-9a2d0cec8f93 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:11.595833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61f008-7615-422e-b9e7-9a2d0cec8f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:11.596379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61f008-7615-422e-b9e7-9a2d0cec8f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:11.597179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61f008-7615-422e-b9e7-9a2d0cec8f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:11.599151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61f008-7615-422e-b9e7-9a2d0cec8f93 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:11.625358 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 829/1665] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:11.626571 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae67f68-41e3-4653-9c55-5d8d5a89decf admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:11.640277 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae67f68-41e3-4653-9c55-5d8d5a89decf admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:11.652688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea18d2-3a9f-43d9-a35a-e11975ca87d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:11.655825 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea18d2-3a9f-43d9-a35a-e11975ca87d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:11.656158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea18d2-3a9f-43d9-a35a-e11975ca87d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:11.656960 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea18d2-3a9f-43d9-a35a-e11975ca87d2 admin admin] PATH_INFO: `/v3/projects/187695620ec74843bf4b2064169f8cda/users/aec8e4886d4444ccba8d9f5002a4829c/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:11.698178 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea18d2-3a9f-43d9-a35a-e11975ca87d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=187695620ec74843bf4b2064169f8cda, user_id=aec8e4886d4444ccba8d9f5002a4829c, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:11.703269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea18d2-3a9f-43d9-a35a-e11975ca87d2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:11.806902 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 837/1666] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:11 2022] PUT /identity/v3/projects/187695620ec74843bf4b2064169f8cda/users/aec8e4886d4444ccba8d9f5002a4829c/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:11.808812 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61f008-7615-422e-b9e7-9a2d0cec8f93 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:11.869636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61f008-7615-422e-b9e7-9a2d0cec8f93 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:12.017198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:12.023801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419aae2-37f7-4934-88f0-a11d09187947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:12.025035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419aae2-37f7-4934-88f0-a11d09187947 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:12.025323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419aae2-37f7-4934-88f0-a11d09187947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:12.025594 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419aae2-37f7-4934-88f0-a11d09187947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:12.027560 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419aae2-37f7-4934-88f0-a11d09187947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:12.031493 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419aae2-37f7-4934-88f0-a11d09187947 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:12.059881 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea18d2-3a9f-43d9-a35a-e11975ca87d2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:12.060836 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 830/1667] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:12.085674 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea18d2-3a9f-43d9-a35a-e11975ca87d2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:12.104513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618ce1c-ca29-4428-b40f-2e4999faf4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:12.105547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618ce1c-ca29-4428-b40f-2e4999faf4cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:12.105967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618ce1c-ca29-4428-b40f-2e4999faf4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:12.106376 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618ce1c-ca29-4428-b40f-2e4999faf4cb admin admin] PATH_INFO: `/v3/projects/187695620ec74843bf4b2064169f8cda/users/aec8e4886d4444ccba8d9f5002a4829c/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:12.112091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618ce1c-ca29-4428-b40f-2e4999faf4cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=187695620ec74843bf4b2064169f8cda, user_id=aec8e4886d4444ccba8d9f5002a4829c, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:12.121417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618ce1c-ca29-4428-b40f-2e4999faf4cb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:12.151560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 838/1668] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:12 2022] PUT /identity/v3/projects/187695620ec74843bf4b2064169f8cda/users/aec8e4886d4444ccba8d9f5002a4829c/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:32:12.163173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aba0e-97c4-4cc6-b289-72391afe0d2f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:12.163465 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aba0e-97c4-4cc6-b289-72391afe0d2f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:12.163747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aba0e-97c4-4cc6-b289-72391afe0d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:12.250159 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b76aba0e-97c4-4cc6-b289-72391afe0d2f None None] MFA Rules not processed for user `aec8e4886d4444ccba8d9f5002a4829c`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:12.251442 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b76aba0e-97c4-4cc6-b289-72391afe0d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:12.485706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 831/1669] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:12.491901 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618ce1c-ca29-4428-b40f-2e4999faf4cb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:12.493685 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8618ce1c-ca29-4428-b40f-2e4999faf4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:12.638594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618ce1c-ca29-4428-b40f-2e4999faf4cb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:12.643262 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72613164-2fa1-4bd0-adce-99dfe10b4ea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:12.644289 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72613164-2fa1-4bd0-adce-99dfe10b4ea5 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:12.644289 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72613164-2fa1-4bd0-adce-99dfe10b4ea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:12.644491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72613164-2fa1-4bd0-adce-99dfe10b4ea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:12.773428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72613164-2fa1-4bd0-adce-99dfe10b4ea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:12.776781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72613164-2fa1-4bd0-adce-99dfe10b4ea5 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:12.810233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 839/1670] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:13.796389 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dd2b3-c96f-460d-8245-ae7987b1e098 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:13.798306 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dd2b3-c96f-460d-8245-ae7987b1e098 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:13.798306 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dd2b3-c96f-460d-8245-ae7987b1e098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:13.837835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:13.860725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a17dd2b3-c96f-460d-8245-ae7987b1e098 None None] MFA Rules not processed for user `916f85e42444497ca4d4993f233d63c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:13.862181 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a17dd2b3-c96f-460d-8245-ae7987b1e098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:13.916036 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72613164-2fa1-4bd0-adce-99dfe10b4ea5 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:13.918210 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-72613164-2fa1-4bd0-adce-99dfe10b4ea5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:14.105229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72613164-2fa1-4bd0-adce-99dfe10b4ea5 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:14.116267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9d65a-486a-487d-9e60-56f9aeaf7d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:14.116806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 832/1671] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:14.119886 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9d65a-486a-487d-9e60-56f9aeaf7d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:14.120347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9d65a-486a-487d-9e60-56f9aeaf7d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:14.120697 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9d65a-486a-487d-9e60-56f9aeaf7d98 admin admin] PATH_INFO: `/v3/projects/7c603ad897954e7486355a268ddc9e67` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:14.127474 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9d65a-486a-487d-9e60-56f9aeaf7d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c603ad897954e7486355a268ddc9e67)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:14.129651 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9d65a-486a-487d-9e60-56f9aeaf7d98 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:14.147489 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dd2b3-c96f-460d-8245-ae7987b1e098 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:14.151627 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a17dd2b3-c96f-460d-8245-ae7987b1e098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:14.164501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:14.349721 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e5c9d65a-486a-487d-9e60-56f9aeaf7d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c603ad897954e7486355a268ddc9e67', 'request_id': 'req-e5c9d65a-486a-487d-9e60-56f9aeaf7d98'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:14.369113 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dd2b3-c96f-460d-8245-ae7987b1e098 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:14.544135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e5c9d65a-486a-487d-9e60-56f9aeaf7d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c603ad897954e7486355a268ddc9e67', 'request_id': 'req-e5c9d65a-486a-487d-9e60-56f9aeaf7d98'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:14.550446 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04262e41-a718-43f3-82c8-0302b4047848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:14.552229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04262e41-a718-43f3-82c8-0302b4047848 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:14.555259 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04262e41-a718-43f3-82c8-0302b4047848 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:14.555259 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04262e41-a718-43f3-82c8-0302b4047848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:14.558571 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e5c9d65a-486a-487d-9e60-56f9aeaf7d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c603ad897954e7486355a268ddc9e67', 'request_id': 'req-e5c9d65a-486a-487d-9e60-56f9aeaf7d98'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:14.600133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e5c9d65a-486a-487d-9e60-56f9aeaf7d98 admin admin] The token cache is being invalidate because project 7c603ad897954e7486355a268ddc9e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:32:14.600621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e5c9d65a-486a-487d-9e60-56f9aeaf7d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:14.605989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e5c9d65a-486a-487d-9e60-56f9aeaf7d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:14.613182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 840/1672] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:13 2022] DELETE /identity/v3/projects/7c603ad897954e7486355a268ddc9e67 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:32:14.624235 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d07df-a134-41f6-a3c6-966d032f0ffd None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:14.624745 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d07df-a134-41f6-a3c6-966d032f0ffd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:14.627567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d07df-a134-41f6-a3c6-966d032f0ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:14.685770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04262e41-a718-43f3-82c8-0302b4047848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:14.688123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04262e41-a718-43f3-82c8-0302b4047848 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:14.700305 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9f5d07df-a134-41f6-a3c6-966d032f0ffd None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:14.705589 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9f5d07df-a134-41f6-a3c6-966d032f0ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:14.721619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 833/1673] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:14.775566 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04262e41-a718-43f3-82c8-0302b4047848 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:14.777396 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-04262e41-a718-43f3-82c8-0302b4047848 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:14.872729 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 841/1674] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:14.874605 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5825c21-6cd9-4b5e-9e25-c3c10af26bad None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:14.874852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5825c21-6cd9-4b5e-9e25-c3c10af26bad None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:14.875147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5825c21-6cd9-4b5e-9e25-c3c10af26bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:14.920282 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e5825c21-6cd9-4b5e-9e25-c3c10af26bad None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:14.921663 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e5825c21-6cd9-4b5e-9e25-c3c10af26bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:14.942466 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 842/1675] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:14.944858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5825c21-6cd9-4b5e-9e25-c3c10af26bad None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:14.968118 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5825c21-6cd9-4b5e-9e25-c3c10af26bad None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:14.979234 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85054419-99a5-443c-a82b-fd2294e39993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:14.980686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85054419-99a5-443c-a82b-fd2294e39993 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:14.981715 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85054419-99a5-443c-a82b-fd2294e39993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:14.982649 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85054419-99a5-443c-a82b-fd2294e39993 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:14.984588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85054419-99a5-443c-a82b-fd2294e39993 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:32:14.986360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85054419-99a5-443c-a82b-fd2294e39993 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:14.988124 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04262e41-a718-43f3-82c8-0302b4047848 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:14.988588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85054419-99a5-443c-a82b-fd2294e39993 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:14.994485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f1056-52e2-4768-8cf7-aebda3ecfd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:14.995394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f1056-52e2-4768-8cf7-aebda3ecfd78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:14.995810 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f1056-52e2-4768-8cf7-aebda3ecfd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:14.996240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f1056-52e2-4768-8cf7-aebda3ecfd78 admin admin] PATH_INFO: `/v3/users/a4ac6d037eee468c8eebabe4e7ce836c` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:15.001157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f1056-52e2-4768-8cf7-aebda3ecfd78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ac6d037eee468c8eebabe4e7ce836c)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:15.003399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f1056-52e2-4768-8cf7-aebda3ecfd78 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:15.024166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 843/1676] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:32:15.028085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85054419-99a5-443c-a82b-fd2294e39993 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:15.055161 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85054419-99a5-443c-a82b-fd2294e39993 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:15.067011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00a79c-13fd-4559-a120-74a65700b69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:15.072004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00a79c-13fd-4559-a120-74a65700b69a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:15.072004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00a79c-13fd-4559-a120-74a65700b69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:15.072004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00a79c-13fd-4559-a120-74a65700b69a admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:15.072004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00a79c-13fd-4559-a120-74a65700b69a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:15.078760 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00a79c-13fd-4559-a120-74a65700b69a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:15.260523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 844/1677] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:32:15 2022] POST /identity/v3/projects => generated 375 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:15.261945 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8345f01-03dd-4cf6-b48c-390ce077b35d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:15.262976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8345f01-03dd-4cf6-b48c-390ce077b35d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:15.263257 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8345f01-03dd-4cf6-b48c-390ce077b35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:15.331465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b8345f01-03dd-4cf6-b48c-390ce077b35d None None] MFA Rules not processed for user `2ff41052ee8747cb8039347a41f4e3f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:15.332922 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b8345f01-03dd-4cf6-b48c-390ce077b35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:15.432301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-924f1056-52e2-4768-8cf7-aebda3ecfd78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ac6d037eee468c8eebabe4e7ce836c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:15.464818 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-924f1056-52e2-4768-8cf7-aebda3ecfd78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ac6d037eee468c8eebabe4e7ce836c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:15.485059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 845/1678] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:15.486604 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f7ac7-5891-4178-8db4-ea9a41599a51 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:15.558009 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f7ac7-5891-4178-8db4-ea9a41599a51 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:15.558114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-924f1056-52e2-4768-8cf7-aebda3ecfd78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ac6d037eee468c8eebabe4e7ce836c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:15.558200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f7ac7-5891-4178-8db4-ea9a41599a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:15.558285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-924f1056-52e2-4768-8cf7-aebda3ecfd78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ac6d037eee468c8eebabe4e7ce836c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:15.558363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-619f7ac7-5891-4178-8db4-ea9a41599a51 None None] MFA Rules not processed for user `21bce78eea1f41dea1e8cf71d12612b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:15.558363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-619f7ac7-5891-4178-8db4-ea9a41599a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:15.705721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-924f1056-52e2-4768-8cf7-aebda3ecfd78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ac6d037eee468c8eebabe4e7ce836c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:15.705721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 834/1679] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:14 2022] DELETE /identity/v3/users/a4ac6d037eee468c8eebabe4e7ce836c => generated 0 bytes in 917 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:15.706255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 846/1680] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:15.706324 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f1056-52e2-4768-8cf7-aebda3ecfd78 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:15.706389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f7ac7-5891-4178-8db4-ea9a41599a51 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:15.706389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-619f7ac7-5891-4178-8db4-ea9a41599a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:15.706504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-924f1056-52e2-4768-8cf7-aebda3ecfd78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:15.857973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f1056-52e2-4768-8cf7-aebda3ecfd78 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:15.880099 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b5c61-bf85-47d7-a60f-1bf2d55f58bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:15.880743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b5c61-bf85-47d7-a60f-1bf2d55f58bc admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:15.881025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b5c61-bf85-47d7-a60f-1bf2d55f58bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:15.881297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b5c61-bf85-47d7-a60f-1bf2d55f58bc admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:15.884597 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b5c61-bf85-47d7-a60f-1bf2d55f58bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:15.885253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f7ac7-5891-4178-8db4-ea9a41599a51 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:15.889669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b5c61-bf85-47d7-a60f-1bf2d55f58bc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:16.043595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:16.074128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e893a-31d8-4ed0-9db5-c0b82e6040a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:16.075551 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e893a-31d8-4ed0-9db5-c0b82e6040a9 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:16.076039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e893a-31d8-4ed0-9db5-c0b82e6040a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:16.076531 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e893a-31d8-4ed0-9db5-c0b82e6040a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:16.079055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-164e893a-31d8-4ed0-9db5-c0b82e6040a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:16.095904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 835/1681] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:32:15 2022] POST /identity/v3/users => generated 288 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:16.097669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b187ea-04c8-40f4-b70b-0bb380150cce None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:16.098257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b187ea-04c8-40f4-b70b-0bb380150cce None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:16.103481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b187ea-04c8-40f4-b70b-0bb380150cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:16.166202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-94b187ea-04c8-40f4-b70b-0bb380150cce None None] MFA Rules not processed for user `21bce78eea1f41dea1e8cf71d12612b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:16.167765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-94b187ea-04c8-40f4-b70b-0bb380150cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:16.199868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e893a-31d8-4ed0-9db5-c0b82e6040a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:16.204327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e893a-31d8-4ed0-9db5-c0b82e6040a9 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:16.246286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 847/1682] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:16.255778 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176800d-5d39-48a7-8a3a-b8c4e2ab6617 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:16.256068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176800d-5d39-48a7-8a3a-b8c4e2ab6617 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:16.256373 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176800d-5d39-48a7-8a3a-b8c4e2ab6617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:16.314190 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:16.333517 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7176800d-5d39-48a7-8a3a-b8c4e2ab6617 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:16.340282 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7176800d-5d39-48a7-8a3a-b8c4e2ab6617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:16.375771 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 848/1683] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:16.376585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176800d-5d39-48a7-8a3a-b8c4e2ab6617 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:16.385431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 836/1684] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:16.392633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b187ea-04c8-40f4-b70b-0bb380150cce None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:16.392633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-94b187ea-04c8-40f4-b70b-0bb380150cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:16.414455 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176800d-5d39-48a7-8a3a-b8c4e2ab6617 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:16.429638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9a3f1-b58a-47cd-b58a-1752858745f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:16.431687 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9a3f1-b58a-47cd-b58a-1752858745f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:16.433213 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9a3f1-b58a-47cd-b58a-1752858745f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:16.434187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9a3f1-b58a-47cd-b58a-1752858745f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:16.435958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9a3f1-b58a-47cd-b58a-1752858745f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:16.440969 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9a3f1-b58a-47cd-b58a-1752858745f3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:16.497081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 849/1685] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:16.514778 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9a3f1-b58a-47cd-b58a-1752858745f3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:16.523290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f4f9a3f1-b58a-47cd-b58a-1752858745f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:16.572646 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b187ea-04c8-40f4-b70b-0bb380150cce None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:16.583032 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f299f-81d5-471c-8fb2-eeadab774e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:16.585996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f299f-81d5-471c-8fb2-eeadab774e0c service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:16.585996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f299f-81d5-471c-8fb2-eeadab774e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:16.586324 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f299f-81d5-471c-8fb2-eeadab774e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:16.599504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9a3f1-b58a-47cd-b58a-1752858745f3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:16.618394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29352033-1378-4316-9b73-a1e211d6c196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:16.623855 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29352033-1378-4316-9b73-a1e211d6c196 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:16.624068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f299f-81d5-471c-8fb2-eeadab774e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:16.624164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29352033-1378-4316-9b73-a1e211d6c196 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:16.624410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29352033-1378-4316-9b73-a1e211d6c196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:16.629926 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f299f-81d5-471c-8fb2-eeadab774e0c service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:16.646673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29352033-1378-4316-9b73-a1e211d6c196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:16.649115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29352033-1378-4316-9b73-a1e211d6c196 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:16.664040 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 837/1686] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:32:16.677883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f299f-81d5-471c-8fb2-eeadab774e0c service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:16.698228 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 850/1687] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:16.717097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f299f-81d5-471c-8fb2-eeadab774e0c service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:16.744226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2dae7-1cb2-42c3-be9c-a7a49813e422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:16.744869 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2dae7-1cb2-42c3-be9c-a7a49813e422 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:16.745163 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2dae7-1cb2-42c3-be9c-a7a49813e422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:16.745422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2dae7-1cb2-42c3-be9c-a7a49813e422 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:16.750321 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2dae7-1cb2-42c3-be9c-a7a49813e422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:16.751986 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2dae7-1cb2-42c3-be9c-a7a49813e422 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:16.787727 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29352033-1378-4316-9b73-a1e211d6c196 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:16.787930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 838/1688] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:16.808030 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29352033-1378-4316-9b73-a1e211d6c196 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:16.830059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bd21c-dbae-40b8-b5ce-3e020827f8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:16.830745 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bd21c-dbae-40b8-b5ce-3e020827f8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:16.831022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bd21c-dbae-40b8-b5ce-3e020827f8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:16.831442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bd21c-dbae-40b8-b5ce-3e020827f8f1 admin admin] PATH_INFO: `/v3/projects/9cf4667c093943fcae433495b7c84d24/users/7fd5c4fac2ab4fd6b83f63500497a28e/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:16.870051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bd21c-dbae-40b8-b5ce-3e020827f8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf4667c093943fcae433495b7c84d24, user_id=7fd5c4fac2ab4fd6b83f63500497a28e, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:16.873087 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bd21c-dbae-40b8-b5ce-3e020827f8f1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:17.002193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 851/1689] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:16 2022] PUT /identity/v3/projects/9cf4667c093943fcae433495b7c84d24/users/7fd5c4fac2ab4fd6b83f63500497a28e/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:32:17.011292 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc3bbe-5b6e-414a-a56f-fd0c3d5dd27d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:17.011589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc3bbe-5b6e-414a-a56f-fd0c3d5dd27d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:17.016087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc3bbe-5b6e-414a-a56f-fd0c3d5dd27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:17.117511 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:17.123161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-04fc3bbe-5b6e-414a-a56f-fd0c3d5dd27d None None] MFA Rules not processed for user `7fd5c4fac2ab4fd6b83f63500497a28e`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:17.125374 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-04fc3bbe-5b6e-414a-a56f-fd0c3d5dd27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:17.327647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 839/1690] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:32:17.342016 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bd21c-dbae-40b8-b5ce-3e020827f8f1 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:17.467689 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bd21c-dbae-40b8-b5ce-3e020827f8f1 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:17.476022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931b8e1-9cc6-44e8-81e3-7747358e0c29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:17.477132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931b8e1-9cc6-44e8-81e3-7747358e0c29 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:17.478345 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931b8e1-9cc6-44e8-81e3-7747358e0c29 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:17.478767 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931b8e1-9cc6-44e8-81e3-7747358e0c29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:17.488929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931b8e1-9cc6-44e8-81e3-7747358e0c29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:17.491286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931b8e1-9cc6-44e8-81e3-7747358e0c29 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:17.505093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 852/1691] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:17.628394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc3bbe-5b6e-414a-a56f-fd0c3d5dd27d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:17.630277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-04fc3bbe-5b6e-414a-a56f-fd0c3d5dd27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:17.733566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931b8e1-9cc6-44e8-81e3-7747358e0c29 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:17.736549 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7931b8e1-9cc6-44e8-81e3-7747358e0c29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:17.935321 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc3bbe-5b6e-414a-a56f-fd0c3d5dd27d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:17.960308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59812370-ce18-4e65-adbc-b35fdc78e109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:17.964906 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59812370-ce18-4e65-adbc-b35fdc78e109 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:17.966602 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59812370-ce18-4e65-adbc-b35fdc78e109 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:17.966989 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59812370-ce18-4e65-adbc-b35fdc78e109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:17.974054 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-59812370-ce18-4e65-adbc-b35fdc78e109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:18.062033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931b8e1-9cc6-44e8-81e3-7747358e0c29 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:18.083238 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f675c-b72f-46cb-87c3-1fba41b49329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:18.083895 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f675c-b72f-46cb-87c3-1fba41b49329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:18.084173 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f675c-b72f-46cb-87c3-1fba41b49329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:18.084686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f675c-b72f-46cb-87c3-1fba41b49329 admin admin] PATH_INFO: `/v3/projects/699f177649494d049e021adad4d83617` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:18.087854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f675c-b72f-46cb-87c3-1fba41b49329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=699f177649494d049e021adad4d83617)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:18.095969 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f675c-b72f-46cb-87c3-1fba41b49329 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:18.336670 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59812370-ce18-4e65-adbc-b35fdc78e109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:18.338721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59812370-ce18-4e65-adbc-b35fdc78e109 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:18.341965 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f85f675c-b72f-46cb-87c3-1fba41b49329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699f177649494d049e021adad4d83617', 'request_id': 'req-f85f675c-b72f-46cb-87c3-1fba41b49329'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:18.377275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 840/1692] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:18.397791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59812370-ce18-4e65-adbc-b35fdc78e109 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:18.435545 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f85f675c-b72f-46cb-87c3-1fba41b49329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699f177649494d049e021adad4d83617', 'request_id': 'req-f85f675c-b72f-46cb-87c3-1fba41b49329'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:18.436567 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59812370-ce18-4e65-adbc-b35fdc78e109 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:18.460107 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f85f675c-b72f-46cb-87c3-1fba41b49329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699f177649494d049e021adad4d83617', 'request_id': 'req-f85f675c-b72f-46cb-87c3-1fba41b49329'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:18.487278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f85f675c-b72f-46cb-87c3-1fba41b49329 admin admin] The token cache is being invalidate because project 699f177649494d049e021adad4d83617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:32:18.487886 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f85f675c-b72f-46cb-87c3-1fba41b49329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:18.489247 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f85f675c-b72f-46cb-87c3-1fba41b49329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:18.497984 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 853/1693] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:17 2022] DELETE /identity/v3/projects/699f177649494d049e021adad4d83617 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:32:18.499862 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f675c-b72f-46cb-87c3-1fba41b49329 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:18.502501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f85f675c-b72f-46cb-87c3-1fba41b49329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:18.625102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafccb1-b0e0-434f-afc5-6181f4dea3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:18.626275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafccb1-b0e0-434f-afc5-6181f4dea3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:18.626872 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafccb1-b0e0-434f-afc5-6181f4dea3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:18.627308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafccb1-b0e0-434f-afc5-6181f4dea3ca admin admin] PATH_INFO: `/v3/users/7fd5c4fac2ab4fd6b83f63500497a28e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:18.628794 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafccb1-b0e0-434f-afc5-6181f4dea3ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd5c4fac2ab4fd6b83f63500497a28e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:18.631275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafccb1-b0e0-434f-afc5-6181f4dea3ca admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:18.668925 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:18.781126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f675c-b72f-46cb-87c3-1fba41b49329 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:18.799715 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689df153-f1b7-41da-8e6a-f6c0413ba5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:18.800372 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689df153-f1b7-41da-8e6a-f6c0413ba5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:18.800645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689df153-f1b7-41da-8e6a-f6c0413ba5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:18.800910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689df153-f1b7-41da-8e6a-f6c0413ba5f2 admin admin] PATH_INFO: `/v3/users/b1b9c8a32028442e991c6df1a5a491ad` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:18.804412 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689df153-f1b7-41da-8e6a-f6c0413ba5f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1b9c8a32028442e991c6df1a5a491ad)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:18.809650 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689df153-f1b7-41da-8e6a-f6c0413ba5f2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:18.914414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-caafccb1-b0e0-434f-afc5-6181f4dea3ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd5c4fac2ab4fd6b83f63500497a28e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:18.959859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-caafccb1-b0e0-434f-afc5-6181f4dea3ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd5c4fac2ab4fd6b83f63500497a28e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:18.998772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-caafccb1-b0e0-434f-afc5-6181f4dea3ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd5c4fac2ab4fd6b83f63500497a28e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:18.999536 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-caafccb1-b0e0-434f-afc5-6181f4dea3ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd5c4fac2ab4fd6b83f63500497a28e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:19.022433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:19.090770 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-caafccb1-b0e0-434f-afc5-6181f4dea3ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd5c4fac2ab4fd6b83f63500497a28e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:19.099352 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 841/1694] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:18 2022] DELETE /identity/v3/users/7fd5c4fac2ab4fd6b83f63500497a28e => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:19.101713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5738b-9877-434d-ae9c-5d59e7e11552 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:19.102844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5738b-9877-434d-ae9c-5d59e7e11552 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:19.103037 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-689df153-f1b7-41da-8e6a-f6c0413ba5f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1b9c8a32028442e991c6df1a5a491ad'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:19.104501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5738b-9877-434d-ae9c-5d59e7e11552 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:19.106119 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 842/1695] 10.222.0.82 () {54 vars in 912 bytes} [Fri Sep 23 15:32:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:32:19.112637 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0956ce-a1c1-4afc-9079-026860f810a8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:19.113163 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0956ce-a1c1-4afc-9079-026860f810a8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:19.113587 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0956ce-a1c1-4afc-9079-026860f810a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:19.142487 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-689df153-f1b7-41da-8e6a-f6c0413ba5f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1b9c8a32028442e991c6df1a5a491ad'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:19.170135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-689df153-f1b7-41da-8e6a-f6c0413ba5f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1b9c8a32028442e991c6df1a5a491ad'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:19.171498 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-689df153-f1b7-41da-8e6a-f6c0413ba5f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1b9c8a32028442e991c6df1a5a491ad'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:19.179317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5d0956ce-a1c1-4afc-9079-026860f810a8 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:19.181162 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5d0956ce-a1c1-4afc-9079-026860f810a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:19.205254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:19.288603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-689df153-f1b7-41da-8e6a-f6c0413ba5f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1b9c8a32028442e991c6df1a5a491ad'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:19.299533 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 854/1696] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:18 2022] DELETE /identity/v3/users/b1b9c8a32028442e991c6df1a5a491ad => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:19.303595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd1937-ce4b-4562-a2be-ff8e08b2a52f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:19.303595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd1937-ce4b-4562-a2be-ff8e08b2a52f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:19.303595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd1937-ce4b-4562-a2be-ff8e08b2a52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:19.392972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 843/1697] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:19.444358 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0956ce-a1c1-4afc-9079-026860f810a8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:19.454724 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5d0956ce-a1c1-4afc-9079-026860f810a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:19.464355 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d5bd1937-ce4b-4562-a2be-ff8e08b2a52f None None] MFA Rules not processed for user `defbff3e8f934dab9c800c7207c1d539`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:19.465684 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d5bd1937-ce4b-4562-a2be-ff8e08b2a52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:19.613956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0956ce-a1c1-4afc-9079-026860f810a8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:19.625166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 855/1698] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Sep 23 15:32:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:19.626222 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5b59d-26e0-4f98-82d2-76d9b5f3066a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:19.627078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5b59d-26e0-4f98-82d2-76d9b5f3066a service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:19.627532 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5b59d-26e0-4f98-82d2-76d9b5f3066a service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:19.628013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5b59d-26e0-4f98-82d2-76d9b5f3066a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:19.793030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5b59d-26e0-4f98-82d2-76d9b5f3066a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:19.794629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5b59d-26e0-4f98-82d2-76d9b5f3066a service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:19.821789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 844/1699] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:19.952955 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd1937-ce4b-4562-a2be-ff8e08b2a52f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:19.968341 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd1937-ce4b-4562-a2be-ff8e08b2a52f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:19.972193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab666e2-560d-4868-8415-b2aabf6e9ad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:19.972735 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab666e2-560d-4868-8415-b2aabf6e9ad5 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:19.973012 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab666e2-560d-4868-8415-b2aabf6e9ad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:19.973283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab666e2-560d-4868-8415-b2aabf6e9ad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:19.989650 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab666e2-560d-4868-8415-b2aabf6e9ad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:19.992428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab666e2-560d-4868-8415-b2aabf6e9ad5 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:20.010295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 856/1700] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:20.132926 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6015b06-c88d-43d4-8489-bb6a6f9bcd73 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:20.134088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6015b06-c88d-43d4-8489-bb6a6f9bcd73 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:20.134574 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6015b06-c88d-43d4-8489-bb6a6f9bcd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:20.150889 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14154435-5cf4-4882-910a-08a1646a2105 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:20.151423 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14154435-5cf4-4882-910a-08a1646a2105 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:20.151927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14154435-5cf4-4882-910a-08a1646a2105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:20.229613 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-14154435-5cf4-4882-910a-08a1646a2105 None None] MFA Rules not processed for user `b84dc5da6ae0443f92daf141837057d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:20.230980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-14154435-5cf4-4882-910a-08a1646a2105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:20.295096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c6015b06-c88d-43d4-8489-bb6a6f9bcd73 None None] MFA Rules not processed for user `65e23f2d5c78471b87eb64d7a9c07b86`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:20.296422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c6015b06-c88d-43d4-8489-bb6a6f9bcd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:20.346651 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 857/1701] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:20.350836 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6f70b-1f9d-4ccc-86d5-d4051b45dc93 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:20.351074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6f70b-1f9d-4ccc-86d5-d4051b45dc93 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:20.351776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6f70b-1f9d-4ccc-86d5-d4051b45dc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:20.388341 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-61f6f70b-1f9d-4ccc-86d5-d4051b45dc93 None None] MFA Rules not processed for user `b84dc5da6ae0443f92daf141837057d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:20.389698 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-61f6f70b-1f9d-4ccc-86d5-d4051b45dc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:20.407232 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 845/1702] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:20.412882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 858/1703] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:32:20.422183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6015b06-c88d-43d4-8489-bb6a6f9bcd73 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:20.424029 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c6015b06-c88d-43d4-8489-bb6a6f9bcd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:20.506243 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:20.564458 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6015b06-c88d-43d4-8489-bb6a6f9bcd73 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:20.570267 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7b4ed-bf06-4401-87b0-9da9df4fd5f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:20.571564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7b4ed-bf06-4401-87b0-9da9df4fd5f1 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:20.571744 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7b4ed-bf06-4401-87b0-9da9df4fd5f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:20.573079 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7b4ed-bf06-4401-87b0-9da9df4fd5f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:20.588355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7b4ed-bf06-4401-87b0-9da9df4fd5f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:20.590012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7b4ed-bf06-4401-87b0-9da9df4fd5f1 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:20.603104 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 846/1704] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:20.816376 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:21.316262 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6f70b-1f9d-4ccc-86d5-d4051b45dc93 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:21.318031 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-61f6f70b-1f9d-4ccc-86d5-d4051b45dc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:21.387465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6f70b-1f9d-4ccc-86d5-d4051b45dc93 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:21.407140 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e906a1-e7e9-4763-86a6-e430006953f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:21.408016 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e906a1-e7e9-4763-86a6-e430006953f6 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:21.409179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e906a1-e7e9-4763-86a6-e430006953f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:21.409179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e906a1-e7e9-4763-86a6-e430006953f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:21.437669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7b4ed-bf06-4401-87b0-9da9df4fd5f1 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:21.448679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f4f7b4ed-bf06-4401-87b0-9da9df4fd5f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:21.449379 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e906a1-e7e9-4763-86a6-e430006953f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:21.449379 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e906a1-e7e9-4763-86a6-e430006953f6 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:21.482040 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 859/1705] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:21.485786 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e906a1-e7e9-4763-86a6-e430006953f6 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:21.495892 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-00e906a1-e7e9-4763-86a6-e430006953f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:21.533673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e906a1-e7e9-4763-86a6-e430006953f6 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:21.547776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95faa4f-917a-4914-8707-b3f733827320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:21.548956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95faa4f-917a-4914-8707-b3f733827320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:21.549236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95faa4f-917a-4914-8707-b3f733827320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:21.549506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95faa4f-917a-4914-8707-b3f733827320 admin admin] PATH_INFO: `/v3/projects/9cf4667c093943fcae433495b7c84d24` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:21.552192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95faa4f-917a-4914-8707-b3f733827320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf4667c093943fcae433495b7c84d24)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:21.554251 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95faa4f-917a-4914-8707-b3f733827320 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:21.625864 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7b4ed-bf06-4401-87b0-9da9df4fd5f1 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:21.632956 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea9fdc-14c1-4b4b-b400-a5a4856f24c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25109eeb1b34b3689b10e3f7c44a6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:21.634515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea9fdc-14c1-4b4b-b400-a5a4856f24c3 service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:21.634972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea9fdc-14c1-4b4b-b400-a5a4856f24c3 service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:21.635555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea9fdc-14c1-4b4b-b400-a5a4856f24c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:21.639767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-70ea9fdc-14c1-4b4b-b400-a5a4856f24c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:21.654138 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea9fdc-14c1-4b4b-b400-a5a4856f24c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:21.656079 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea9fdc-14c1-4b4b-b400-a5a4856f24c3 service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:21.689045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 847/1706] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:32:21.690141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea9fdc-14c1-4b4b-b400-a5a4856f24c3 service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:21.692179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-70ea9fdc-14c1-4b4b-b400-a5a4856f24c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:21.739839 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea9fdc-14c1-4b4b-b400-a5a4856f24c3 service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:21.763594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c95faa4f-917a-4914-8707-b3f733827320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf4667c093943fcae433495b7c84d24', 'request_id': 'req-c95faa4f-917a-4914-8707-b3f733827320'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:21.851113 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c95faa4f-917a-4914-8707-b3f733827320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf4667c093943fcae433495b7c84d24', 'request_id': 'req-c95faa4f-917a-4914-8707-b3f733827320'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:21.861645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd39eed-1b71-46d1-bbac-78b7a0397be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:21.861645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd39eed-1b71-46d1-bbac-78b7a0397be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:21.861645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd39eed-1b71-46d1-bbac-78b7a0397be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:21.861645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd39eed-1b71-46d1-bbac-78b7a0397be6 admin admin] PATH_INFO: `/v3/projects/dcbc005a48fd49e5a7028c940c3be055` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:21.863725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c95faa4f-917a-4914-8707-b3f733827320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf4667c093943fcae433495b7c84d24', 'request_id': 'req-c95faa4f-917a-4914-8707-b3f733827320'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:21.867046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd39eed-1b71-46d1-bbac-78b7a0397be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcbc005a48fd49e5a7028c940c3be055)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:21.869575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd39eed-1b71-46d1-bbac-78b7a0397be6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:21.890360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c95faa4f-917a-4914-8707-b3f733827320 admin admin] The token cache is being invalidate because project 9cf4667c093943fcae433495b7c84d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:32:21.890654 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c95faa4f-917a-4914-8707-b3f733827320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:21.892354 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c95faa4f-917a-4914-8707-b3f733827320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:21.894317 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 860/1707] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:21 2022] DELETE /identity/v3/projects/9cf4667c093943fcae433495b7c84d24 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:21.899259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c398ff-f785-4241-9ac3-eb243e1c1480 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:21.899736 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c398ff-f785-4241-9ac3-eb243e1c1480 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:21.899903 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c398ff-f785-4241-9ac3-eb243e1c1480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:21.958764 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d9c398ff-f785-4241-9ac3-eb243e1c1480 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:21.959009 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d9c398ff-f785-4241-9ac3-eb243e1c1480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:21.994032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 861/1708] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:32:22.010108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b612c4-4b47-462a-bd75-e40ca9f33a09 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:22.010108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b612c4-4b47-462a-bd75-e40ca9f33a09 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:22.010108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b612c4-4b47-462a-bd75-e40ca9f33a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:22.062033 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bd39eed-1b71-46d1-bbac-78b7a0397be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcbc005a48fd49e5a7028c940c3be055', 'request_id': 'req-3bd39eed-1b71-46d1-bbac-78b7a0397be6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:22.071701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-40b612c4-4b47-462a-bd75-e40ca9f33a09 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:22.076744 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-40b612c4-4b47-462a-bd75-e40ca9f33a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:22.174867 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bd39eed-1b71-46d1-bbac-78b7a0397be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcbc005a48fd49e5a7028c940c3be055', 'request_id': 'req-3bd39eed-1b71-46d1-bbac-78b7a0397be6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:22.177441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:22.186681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bd39eed-1b71-46d1-bbac-78b7a0397be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcbc005a48fd49e5a7028c940c3be055', 'request_id': 'req-3bd39eed-1b71-46d1-bbac-78b7a0397be6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:22.225241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bd39eed-1b71-46d1-bbac-78b7a0397be6 admin admin] The token cache is being invalidate because project dcbc005a48fd49e5a7028c940c3be055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:32:22.225617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bd39eed-1b71-46d1-bbac-78b7a0397be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:22.233323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bd39eed-1b71-46d1-bbac-78b7a0397be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:22.235170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 848/1709] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:21 2022] DELETE /identity/v3/projects/dcbc005a48fd49e5a7028c940c3be055 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:22.240484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5594d30-db5b-42ea-990e-7c902717861b None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:22.240484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5594d30-db5b-42ea-990e-7c902717861b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:22.240484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5594d30-db5b-42ea-990e-7c902717861b None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:22.240484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 849/1710] 10.222.0.82 () {54 vars in 912 bytes} [Fri Sep 23 15:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:32:22.240484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786ba58-5c55-403c-ba51-173350bdd79e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:22.240850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786ba58-5c55-403c-ba51-173350bdd79e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:22.241060 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786ba58-5c55-403c-ba51-173350bdd79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:22.273817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 862/1711] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:22.280452 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2170b-09cf-4569-842b-d6256fabdded None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:22.280855 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2170b-09cf-4569-842b-d6256fabdded None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:22.281139 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2170b-09cf-4569-842b-d6256fabdded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:22.282434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8786ba58-5c55-403c-ba51-173350bdd79e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:22.283734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8786ba58-5c55-403c-ba51-173350bdd79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:22.312068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 850/1712] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:22.312068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786ba58-5c55-403c-ba51-173350bdd79e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:22.326981 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786ba58-5c55-403c-ba51-173350bdd79e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:22.343403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990eff12-a6af-4d31-b105-abb69e68893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:22.345200 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990eff12-a6af-4d31-b105-abb69e68893f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:22.345200 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990eff12-a6af-4d31-b105-abb69e68893f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:22.345200 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990eff12-a6af-4d31-b105-abb69e68893f admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:22.345200 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990eff12-a6af-4d31-b105-abb69e68893f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:32:22.345578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990eff12-a6af-4d31-b105-abb69e68893f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:22.347305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990eff12-a6af-4d31-b105-abb69e68893f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:22.357446 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6fa2170b-09cf-4569-842b-d6256fabdded None None] MFA Rules not processed for user `defbff3e8f934dab9c800c7207c1d539`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:22.360297 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6fa2170b-09cf-4569-842b-d6256fabdded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:22.381339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 851/1713] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:32:22.381339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baac63b-7d15-4974-9c08-145a7c06abca None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:22.381339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baac63b-7d15-4974-9c08-145a7c06abca None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:22.381339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baac63b-7d15-4974-9c08-145a7c06abca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:22.420351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6baac63b-7d15-4974-9c08-145a7c06abca None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:22.421593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6baac63b-7d15-4974-9c08-145a7c06abca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:22.444595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 852/1714] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:22.444595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c0c36-2cc4-4d0b-850b-59ae237e1aea None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:22.444595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c0c36-2cc4-4d0b-850b-59ae237e1aea None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:22.444595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c0c36-2cc4-4d0b-850b-59ae237e1aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:22.458052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 863/1715] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Sep 23 15:32:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:22.465675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2170b-09cf-4569-842b-d6256fabdded None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:22.487009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3d0c0c36-2cc4-4d0b-850b-59ae237e1aea None None] MFA Rules not processed for user `916f85e42444497ca4d4993f233d63c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:22.487250 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2170b-09cf-4569-842b-d6256fabdded None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:22.488252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3d0c0c36-2cc4-4d0b-850b-59ae237e1aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:22.501789 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7987d-ce62-44c1-ac0e-9edf80a6f871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:22.502429 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7987d-ce62-44c1-ac0e-9edf80a6f871 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:22.502707 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7987d-ce62-44c1-ac0e-9edf80a6f871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:22.502980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7987d-ce62-44c1-ac0e-9edf80a6f871 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:22.503623 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7987d-ce62-44c1-ac0e-9edf80a6f871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:22.505587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7987d-ce62-44c1-ac0e-9edf80a6f871 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:22.597525 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 853/1716] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:22.604242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c0c36-2cc4-4d0b-850b-59ae237e1aea None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:22.647468 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 864/1717] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:32:22 2022] POST /identity/v3/projects => generated 355 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:22.648613 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7987d-ce62-44c1-ac0e-9edf80a6f871 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:22.650690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c0c36-2cc4-4d0b-850b-59ae237e1aea None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:22.656135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-adc7987d-ce62-44c1-ac0e-9edf80a6f871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:22.872913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7987d-ce62-44c1-ac0e-9edf80a6f871 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:22.881516 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c844145-537d-4cbe-96e8-892bb1999da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:22.882535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c844145-537d-4cbe-96e8-892bb1999da2 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:22.882535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c844145-537d-4cbe-96e8-892bb1999da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:22.882708 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c844145-537d-4cbe-96e8-892bb1999da2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:22.888130 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c844145-537d-4cbe-96e8-892bb1999da2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:32:22.889035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c844145-537d-4cbe-96e8-892bb1999da2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:22.893934 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c844145-537d-4cbe-96e8-892bb1999da2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:22.895430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af29e35-c9d6-4db0-9d6c-8b67cbe5640d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:22.903495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29e35-c9d6-4db0-9d6c-8b67cbe5640d service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:22.913236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29e35-c9d6-4db0-9d6c-8b67cbe5640d service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:22.914412 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29e35-c9d6-4db0-9d6c-8b67cbe5640d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:22.939532 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 854/1718] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:32:22.940573 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c844145-537d-4cbe-96e8-892bb1999da2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:22.940680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af29e35-c9d6-4db0-9d6c-8b67cbe5640d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:22.942115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af29e35-c9d6-4db0-9d6c-8b67cbe5640d service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:22.960539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 865/1719] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:22.961528 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af29e35-c9d6-4db0-9d6c-8b67cbe5640d service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:22.975074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c844145-537d-4cbe-96e8-892bb1999da2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:22.980505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb487b3d-32c3-48de-b105-b482ba0e5e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:22.981130 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb487b3d-32c3-48de-b105-b482ba0e5e1e admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:22.981598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb487b3d-32c3-48de-b105-b482ba0e5e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:22.982042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb487b3d-32c3-48de-b105-b482ba0e5e1e admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:22.982681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb487b3d-32c3-48de-b105-b482ba0e5e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:22.984602 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb487b3d-32c3-48de-b105-b482ba0e5e1e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:22.988254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af29e35-c9d6-4db0-9d6c-8b67cbe5640d service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:22.998550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7a69f-6812-42bd-be6c-278450ad23a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:22.999178 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7a69f-6812-42bd-be6c-278450ad23a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:22.999459 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7a69f-6812-42bd-be6c-278450ad23a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:22.999734 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7a69f-6812-42bd-be6c-278450ad23a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:23.000379 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7a69f-6812-42bd-be6c-278450ad23a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:23.002624 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7a69f-6812-42bd-be6c-278450ad23a2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:23.133049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 855/1720] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:32:22 2022] POST /identity/v3/users => generated 278 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:23.137758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb487b3d-32c3-48de-b105-b482ba0e5e1e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:23.165027 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 866/1721] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:32:22 2022] POST /identity/v3/projects => generated 369 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:23.170453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7a69f-6812-42bd-be6c-278450ad23a2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:23.186416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb487b3d-32c3-48de-b105-b482ba0e5e1e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:23.351204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7a69f-6812-42bd-be6c-278450ad23a2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:23.358950 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684702a-0aed-479b-9f63-47297189ee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:23.361515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684702a-0aed-479b-9f63-47297189ee96 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:23.361982 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684702a-0aed-479b-9f63-47297189ee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:23.362939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684702a-0aed-479b-9f63-47297189ee96 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:23.365209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684702a-0aed-479b-9f63-47297189ee96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:23.376377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684702a-0aed-479b-9f63-47297189ee96 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:23.399922 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754798b0-0cd1-46f0-8f2a-6a8d4f01ab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:23.400553 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754798b0-0cd1-46f0-8f2a-6a8d4f01ab78 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:23.400828 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754798b0-0cd1-46f0-8f2a-6a8d4f01ab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:23.401095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754798b0-0cd1-46f0-8f2a-6a8d4f01ab78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:23.401757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754798b0-0cd1-46f0-8f2a-6a8d4f01ab78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:23.404680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:23.406589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754798b0-0cd1-46f0-8f2a-6a8d4f01ab78 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:23.450939 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 856/1722] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:23.454211 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754798b0-0cd1-46f0-8f2a-6a8d4f01ab78 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:23.477794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 867/1723] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:32:23 2022] POST /identity/v3/users => generated 285 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:23.478925 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684702a-0aed-479b-9f63-47297189ee96 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:23.485563 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754798b0-0cd1-46f0-8f2a-6a8d4f01ab78 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:23.504199 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684702a-0aed-479b-9f63-47297189ee96 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:23.507294 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238feeb-4502-4778-9ea1-e3ba8fa1ea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:23.508072 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238feeb-4502-4778-9ea1-e3ba8fa1ea7b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:23.508683 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238feeb-4502-4778-9ea1-e3ba8fa1ea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:23.509102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238feeb-4502-4778-9ea1-e3ba8fa1ea7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:23.510076 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238feeb-4502-4778-9ea1-e3ba8fa1ea7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:23.512195 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238feeb-4502-4778-9ea1-e3ba8fa1ea7b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:23.520630 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7507881-0f2f-4d70-8708-0edd1582f0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:23.522272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7507881-0f2f-4d70-8708-0edd1582f0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:23.522623 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7507881-0f2f-4d70-8708-0edd1582f0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:23.523374 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7507881-0f2f-4d70-8708-0edd1582f0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:23.524267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7507881-0f2f-4d70-8708-0edd1582f0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:23.526441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7507881-0f2f-4d70-8708-0edd1582f0e0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:23.535677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 857/1724] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:23.540230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238feeb-4502-4778-9ea1-e3ba8fa1ea7b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:23.540792 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 868/1725] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:23.544390 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7507881-0f2f-4d70-8708-0edd1582f0e0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:23.558058 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7507881-0f2f-4d70-8708-0edd1582f0e0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:23.563787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028769b-a0d1-44ff-aebc-dc03b8cd4e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:23.564155 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238feeb-4502-4778-9ea1-e3ba8fa1ea7b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:23.564636 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028769b-a0d1-44ff-aebc-dc03b8cd4e98 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:23.565011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028769b-a0d1-44ff-aebc-dc03b8cd4e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:23.565381 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028769b-a0d1-44ff-aebc-dc03b8cd4e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:23.566245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028769b-a0d1-44ff-aebc-dc03b8cd4e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:23.568349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028769b-a0d1-44ff-aebc-dc03b8cd4e98 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:23.575709 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058c3f6-683c-4459-94f0-ed93b63d44b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:23.576609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058c3f6-683c-4459-94f0-ed93b63d44b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:23.579933 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058c3f6-683c-4459-94f0-ed93b63d44b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:23.579933 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058c3f6-683c-4459-94f0-ed93b63d44b2 admin admin] PATH_INFO: `/v3/projects/d10b1ba101ca467c8ad052e422b9b548/users/aafa846d0f7c48bc9d71d46f42b39600/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:23.584878 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 869/1726] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:32:23.589032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028769b-a0d1-44ff-aebc-dc03b8cd4e98 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:23.595659 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058c3f6-683c-4459-94f0-ed93b63d44b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10b1ba101ca467c8ad052e422b9b548, user_id=aafa846d0f7c48bc9d71d46f42b39600, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:23.598503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058c3f6-683c-4459-94f0-ed93b63d44b2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:23.603939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028769b-a0d1-44ff-aebc-dc03b8cd4e98 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:23.610606 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75312b3e-274d-4578-8379-b64693220150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:23.611318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312b3e-274d-4578-8379-b64693220150 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:23.611602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312b3e-274d-4578-8379-b64693220150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:23.611878 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312b3e-274d-4578-8379-b64693220150 admin admin] PATH_INFO: `/v3/projects/894b0cce9f414626a23388c23638c408/users/6517385534af4447bb2f6db97cf36e5a/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:23.631571 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75312b3e-274d-4578-8379-b64693220150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=894b0cce9f414626a23388c23638c408, user_id=6517385534af4447bb2f6db97cf36e5a, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:23.634365 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75312b3e-274d-4578-8379-b64693220150 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:23.760439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 858/1727] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:23 2022] PUT /identity/v3/projects/d10b1ba101ca467c8ad052e422b9b548/users/aafa846d0f7c48bc9d71d46f42b39600/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:32:23.771217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e13203-2995-4e6b-ae44-aaa62ae05c05 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:23.771516 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e13203-2995-4e6b-ae44-aaa62ae05c05 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:23.771801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e13203-2995-4e6b-ae44-aaa62ae05c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:23.807036 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 870/1728] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:23 2022] PUT /identity/v3/projects/894b0cce9f414626a23388c23638c408/users/6517385534af4447bb2f6db97cf36e5a/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:32:23.818080 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-19e13203-2995-4e6b-ae44-aaa62ae05c05 None None] MFA Rules not processed for user `aafa846d0f7c48bc9d71d46f42b39600`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:23.818966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f453cdb-6ad8-4b9f-97fc-b2f9ef693b19 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:23.819257 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f453cdb-6ad8-4b9f-97fc-b2f9ef693b19 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:23.819539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f453cdb-6ad8-4b9f-97fc-b2f9ef693b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:23.820448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-19e13203-2995-4e6b-ae44-aaa62ae05c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:23.895947 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6f453cdb-6ad8-4b9f-97fc-b2f9ef693b19 None None] MFA Rules not processed for user `6517385534af4447bb2f6db97cf36e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:23.898097 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6f453cdb-6ad8-4b9f-97fc-b2f9ef693b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:23.989784 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 859/1729] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:32:23.994161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e13203-2995-4e6b-ae44-aaa62ae05c05 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:24.179035 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 871/1730] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:24.181346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f453cdb-6ad8-4b9f-97fc-b2f9ef693b19 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:24.229539 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e13203-2995-4e6b-ae44-aaa62ae05c05 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:24.242667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327ad66-fc13-484d-9855-1342f60904e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:24.243676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327ad66-fc13-484d-9855-1342f60904e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:24.244112 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327ad66-fc13-484d-9855-1342f60904e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:24.244517 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327ad66-fc13-484d-9855-1342f60904e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:24.245314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327ad66-fc13-484d-9855-1342f60904e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:24.252033 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327ad66-fc13-484d-9855-1342f60904e5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:24.356682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f453cdb-6ad8-4b9f-97fc-b2f9ef693b19 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:24.362115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01f3e5-7cdc-48c3-bdc1-29619b106932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:24.362896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01f3e5-7cdc-48c3-bdc1-29619b106932 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:24.363530 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01f3e5-7cdc-48c3-bdc1-29619b106932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:24.363938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01f3e5-7cdc-48c3-bdc1-29619b106932 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:24.364688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01f3e5-7cdc-48c3-bdc1-29619b106932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:24.366863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01f3e5-7cdc-48c3-bdc1-29619b106932 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:24.453161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 860/1731] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:32:23 2022] POST /identity/v3/projects => generated 355 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:24.458352 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327ad66-fc13-484d-9855-1342f60904e5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:24.517428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 872/1732] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:32:24 2022] POST /identity/v3/projects => generated 367 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:24.524104 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01f3e5-7cdc-48c3-bdc1-29619b106932 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:24.716435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327ad66-fc13-484d-9855-1342f60904e5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:24.733762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01f3e5-7cdc-48c3-bdc1-29619b106932 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:24.735427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15705d9a-6616-4ad8-a48c-73e9f0c0428c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:24.736395 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15705d9a-6616-4ad8-a48c-73e9f0c0428c admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:24.736840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15705d9a-6616-4ad8-a48c-73e9f0c0428c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:24.737270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15705d9a-6616-4ad8-a48c-73e9f0c0428c admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:24.738883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1545b-2eb5-49ef-aea9-e6fad8292e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:24.740927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1545b-2eb5-49ef-aea9-e6fad8292e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:24.741035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15705d9a-6616-4ad8-a48c-73e9f0c0428c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:24.741141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1545b-2eb5-49ef-aea9-e6fad8292e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:24.741141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1545b-2eb5-49ef-aea9-e6fad8292e67 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:24.741141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1545b-2eb5-49ef-aea9-e6fad8292e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:24.743788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1545b-2eb5-49ef-aea9-e6fad8292e67 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:24.746428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15705d9a-6616-4ad8-a48c-73e9f0c0428c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:24.869583 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 873/1733] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:32:24 2022] POST /identity/v3/users => generated 290 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:24.873718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a2ffb-c684-48d9-8ab7-4a7b80b2e68b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:24.876554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a2ffb-c684-48d9-8ab7-4a7b80b2e68b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:24.876851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a2ffb-c684-48d9-8ab7-4a7b80b2e68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:24.891475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 861/1734] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:32:24 2022] POST /identity/v3/users => generated 284 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:24.895666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1492cf-b24b-49a8-b988-9aaf54a6d3b5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:24.895666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1492cf-b24b-49a8-b988-9aaf54a6d3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:24.895666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1492cf-b24b-49a8-b988-9aaf54a6d3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:24.931457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-df4a2ffb-c684-48d9-8ab7-4a7b80b2e68b None None] MFA Rules not processed for user `2ff41052ee8747cb8039347a41f4e3f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:24.943324 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ee1492cf-b24b-49a8-b988-9aaf54a6d3b5 None None] MFA Rules not processed for user `b84dc5da6ae0443f92daf141837057d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:24.944766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ee1492cf-b24b-49a8-b988-9aaf54a6d3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:24.945975 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-df4a2ffb-c684-48d9-8ab7-4a7b80b2e68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:25.017990 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:25.075207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 862/1735] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:25.076691 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1492cf-b24b-49a8-b988-9aaf54a6d3b5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:25.110456 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1492cf-b24b-49a8-b988-9aaf54a6d3b5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:25.116432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 874/1736] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:25.117639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a2ffb-c684-48d9-8ab7-4a7b80b2e68b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:25.123353 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ee2f7-022a-42f8-95bb-13c42e39b6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:25.124060 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ee2f7-022a-42f8-95bb-13c42e39b6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:25.125609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ee2f7-022a-42f8-95bb-13c42e39b6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:25.125918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ee2f7-022a-42f8-95bb-13c42e39b6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:25.127811 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ee2f7-022a-42f8-95bb-13c42e39b6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:25.129470 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ee2f7-022a-42f8-95bb-13c42e39b6bc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:25.165787 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 863/1737] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:25.165936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a2ffb-c684-48d9-8ab7-4a7b80b2e68b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:25.177239 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ee2f7-022a-42f8-95bb-13c42e39b6bc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:25.182660 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7bec6-b907-4578-b094-b3bc70c60628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:25.183728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7bec6-b907-4578-b094-b3bc70c60628 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:25.184102 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7bec6-b907-4578-b094-b3bc70c60628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:25.184486 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7bec6-b907-4578-b094-b3bc70c60628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:25.186344 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7bec6-b907-4578-b094-b3bc70c60628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:25.191349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7bec6-b907-4578-b094-b3bc70c60628 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:25.222992 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 875/1738] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:25.224262 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7bec6-b907-4578-b094-b3bc70c60628 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:25.229063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ee2f7-022a-42f8-95bb-13c42e39b6bc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:25.233806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4d4a0-542b-41ad-a550-cecd2edeb087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:25.234686 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4d4a0-542b-41ad-a550-cecd2edeb087 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:25.235103 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4d4a0-542b-41ad-a550-cecd2edeb087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:25.235521 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4d4a0-542b-41ad-a550-cecd2edeb087 admin admin] PATH_INFO: `/v3/projects/be1fc0afb5744c6a9e171b2d04714cf0/users/7e218f955246426594d9d274242dcd9d/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:25.256099 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4d4a0-542b-41ad-a550-cecd2edeb087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1fc0afb5744c6a9e171b2d04714cf0, user_id=7e218f955246426594d9d274242dcd9d, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:25.259831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7bec6-b907-4578-b094-b3bc70c60628 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:25.263539 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4d4a0-542b-41ad-a550-cecd2edeb087 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:25.266820 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c2b44-99f4-4796-a26e-703687ce4656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:25.270727 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c2b44-99f4-4796-a26e-703687ce4656 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:25.271192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c2b44-99f4-4796-a26e-703687ce4656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:25.271594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c2b44-99f4-4796-a26e-703687ce4656 admin admin] PATH_INFO: `/v3/projects/06a1bb9bf1864708847142af635aa22a/users/e03ee8bc96324e65b5dfeb39ab0d6536/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:25.311208 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c2b44-99f4-4796-a26e-703687ce4656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a1bb9bf1864708847142af635aa22a, user_id=e03ee8bc96324e65b5dfeb39ab0d6536, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:25.315313 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c2b44-99f4-4796-a26e-703687ce4656 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:25.375992 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 864/1739] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:25 2022] PUT /identity/v3/projects/be1fc0afb5744c6a9e171b2d04714cf0/users/7e218f955246426594d9d274242dcd9d/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:25.379911 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4d4a0-542b-41ad-a550-cecd2edeb087 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:25.433888 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 876/1740] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:25 2022] PUT /identity/v3/projects/06a1bb9bf1864708847142af635aa22a/users/e03ee8bc96324e65b5dfeb39ab0d6536/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:25.435554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c2b44-99f4-4796-a26e-703687ce4656 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:25.553265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4d4a0-542b-41ad-a550-cecd2edeb087 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:25.634771 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c2b44-99f4-4796-a26e-703687ce4656 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:25.660612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c634bf1-ccd5-4ac3-ab11-84b8a2952923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:25.661236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c634bf1-ccd5-4ac3-ab11-84b8a2952923 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:25.661510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c634bf1-ccd5-4ac3-ab11-84b8a2952923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:25.661799 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c634bf1-ccd5-4ac3-ab11-84b8a2952923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:25.662446 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c634bf1-ccd5-4ac3-ab11-84b8a2952923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:25.666807 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c634bf1-ccd5-4ac3-ab11-84b8a2952923 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:25.694491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 877/1741] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:25.701436 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c634bf1-ccd5-4ac3-ab11-84b8a2952923 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:25.723127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c634bf1-ccd5-4ac3-ab11-84b8a2952923 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:25.729996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74469cf4-d365-4c65-828a-964c7fdb56d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:25.731282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74469cf4-d365-4c65-828a-964c7fdb56d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:25.731570 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74469cf4-d365-4c65-828a-964c7fdb56d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:25.737266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74469cf4-d365-4c65-828a-964c7fdb56d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:25.737266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74469cf4-d365-4c65-828a-964c7fdb56d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:25.737266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74469cf4-d365-4c65-828a-964c7fdb56d1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:25.740045 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fbbba-9fcb-4e1f-abcc-2e55c334d448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:25.740827 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fbbba-9fcb-4e1f-abcc-2e55c334d448 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:25.741166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fbbba-9fcb-4e1f-abcc-2e55c334d448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:25.741495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fbbba-9fcb-4e1f-abcc-2e55c334d448 admin admin] PATH_INFO: `/v3/projects/06a1bb9bf1864708847142af635aa22a/users/e03ee8bc96324e65b5dfeb39ab0d6536/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:25.745093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fbbba-9fcb-4e1f-abcc-2e55c334d448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a1bb9bf1864708847142af635aa22a, user_id=e03ee8bc96324e65b5dfeb39ab0d6536, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:25.747877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fbbba-9fcb-4e1f-abcc-2e55c334d448 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:25.762884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 865/1742] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:25.765923 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74469cf4-d365-4c65-828a-964c7fdb56d1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:25.779704 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 878/1743] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:25 2022] PUT /identity/v3/projects/06a1bb9bf1864708847142af635aa22a/users/e03ee8bc96324e65b5dfeb39ab0d6536/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:25.793545 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59b14f-6111-4148-a380-bc107c3b5353 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:25.794086 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59b14f-6111-4148-a380-bc107c3b5353 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:25.794367 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59b14f-6111-4148-a380-bc107c3b5353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:25.808101 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74469cf4-d365-4c65-828a-964c7fdb56d1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:25.884276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:25.892629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3c59b14f-6111-4148-a380-bc107c3b5353 None None] MFA Rules not processed for user `e03ee8bc96324e65b5dfeb39ab0d6536`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:25.894050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3c59b14f-6111-4148-a380-bc107c3b5353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:25.897605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8981f54-e529-4a3c-b888-9c38d1ae54ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:25.898695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8981f54-e529-4a3c-b888-9c38d1ae54ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:25.899555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8981f54-e529-4a3c-b888-9c38d1ae54ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:25.899996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8981f54-e529-4a3c-b888-9c38d1ae54ba admin admin] PATH_INFO: `/v3/projects/be1fc0afb5744c6a9e171b2d04714cf0/users/7e218f955246426594d9d274242dcd9d/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:25.902360 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8981f54-e529-4a3c-b888-9c38d1ae54ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1fc0afb5744c6a9e171b2d04714cf0, user_id=7e218f955246426594d9d274242dcd9d, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:25.905684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8981f54-e529-4a3c-b888-9c38d1ae54ba admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:25.928858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 866/1744] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:25 2022] PUT /identity/v3/projects/be1fc0afb5744c6a9e171b2d04714cf0/users/7e218f955246426594d9d274242dcd9d/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:25.945883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce43f10-8050-4a7f-8293-27681b41650e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:25.945883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce43f10-8050-4a7f-8293-27681b41650e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:25.945883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce43f10-8050-4a7f-8293-27681b41650e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:26.020643 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 879/1745] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:26.027724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:26.034109 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59b14f-6111-4148-a380-bc107c3b5353 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:26.036017 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3c59b14f-6111-4148-a380-bc107c3b5353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:26.114417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-dce43f10-8050-4a7f-8293-27681b41650e None None] MFA Rules not processed for user `7e218f955246426594d9d274242dcd9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:26.117300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dce43f10-8050-4a7f-8293-27681b41650e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:26.216535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59b14f-6111-4148-a380-bc107c3b5353 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:26.309485 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647234c-e39a-4f29-b6dd-014c87783448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:26.310214 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647234c-e39a-4f29-b6dd-014c87783448 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:26.310493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647234c-e39a-4f29-b6dd-014c87783448 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:26.311172 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647234c-e39a-4f29-b6dd-014c87783448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:26.354096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 867/1746] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:26.382273 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce43f10-8050-4a7f-8293-27681b41650e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:26.384803 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dce43f10-8050-4a7f-8293-27681b41650e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:26.400039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce43f10-8050-4a7f-8293-27681b41650e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:26.405459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb8f91-7bc1-4b35-aead-8c1012ed9aa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:26.406420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb8f91-7bc1-4b35-aead-8c1012ed9aa0 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:26.406774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb8f91-7bc1-4b35-aead-8c1012ed9aa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:26.407117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb8f91-7bc1-4b35-aead-8c1012ed9aa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:26.419106 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb8f91-7bc1-4b35-aead-8c1012ed9aa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:26.421612 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb8f91-7bc1-4b35-aead-8c1012ed9aa0 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:26.445405 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 868/1747] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:32:26.472631 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647234c-e39a-4f29-b6dd-014c87783448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:26.475848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647234c-e39a-4f29-b6dd-014c87783448 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:26.487903 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 880/1748] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:26 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:26.706053 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb8f91-7bc1-4b35-aead-8c1012ed9aa0 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:26.717160 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb8f91-7bc1-4b35-aead-8c1012ed9aa0 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:26.734511 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a84ad-471f-4d07-97f6-4ab2803ae577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:26.735041 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a84ad-471f-4d07-97f6-4ab2803ae577 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:26.735323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a84ad-471f-4d07-97f6-4ab2803ae577 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:26.735596 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a84ad-471f-4d07-97f6-4ab2803ae577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:26.958865 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a84ad-471f-4d07-97f6-4ab2803ae577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:26.960483 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a84ad-471f-4d07-97f6-4ab2803ae577 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:26.990324 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 869/1749] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:27.663597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647234c-e39a-4f29-b6dd-014c87783448 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:27.675877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647234c-e39a-4f29-b6dd-014c87783448 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:27.684368 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fef50-bc08-42ff-9320-1b90e5f1f504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:27.685075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fef50-bc08-42ff-9320-1b90e5f1f504 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:27.685347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fef50-bc08-42ff-9320-1b90e5f1f504 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:27.686262 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fef50-bc08-42ff-9320-1b90e5f1f504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:27.816809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fef50-bc08-42ff-9320-1b90e5f1f504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:27.818615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fef50-bc08-42ff-9320-1b90e5f1f504 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:27.832580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 881/1750] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:27.865405 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5569eb-6c1c-4c15-8d5e-214c838984d8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:27.865875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5569eb-6c1c-4c15-8d5e-214c838984d8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:27.865962 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5569eb-6c1c-4c15-8d5e-214c838984d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:27.980100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4c5569eb-6c1c-4c15-8d5e-214c838984d8 None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:27.981136 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4c5569eb-6c1c-4c15-8d5e-214c838984d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:28.147158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a725095-4470-4ca6-a658-7d55f27f0e6c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:28.148578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a725095-4470-4ca6-a658-7d55f27f0e6c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:28.148578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a725095-4470-4ca6-a658-7d55f27f0e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:28.184399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 870/1751] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Sep 23 15:32:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:28.189644 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6a725095-4470-4ca6-a658-7d55f27f0e6c None None] MFA Rules not processed for user `65e23f2d5c78471b87eb64d7a9c07b86`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:28.191026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6a725095-4470-4ca6-a658-7d55f27f0e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:28.394341 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 882/1752] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:32:28.432674 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:28.846338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5569eb-6c1c-4c15-8d5e-214c838984d8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:28.848294 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4c5569eb-6c1c-4c15-8d5e-214c838984d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:28.947723 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:29.213931 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5569eb-6c1c-4c15-8d5e-214c838984d8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:29.248128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ee561-4ff7-4595-89fc-7d22cfb99ccf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:29.249067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ee561-4ff7-4595-89fc-7d22cfb99ccf service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:29.249492 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ee561-4ff7-4595-89fc-7d22cfb99ccf service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:29.249950 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ee561-4ff7-4595-89fc-7d22cfb99ccf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:29.272387 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ee561-4ff7-4595-89fc-7d22cfb99ccf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:29.274542 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ee561-4ff7-4595-89fc-7d22cfb99ccf service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:29.294465 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 871/1753] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:32:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 15:32:31.252237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac513078-365b-41d2-97e9-b65fbe0e7e83 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:31.252237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac513078-365b-41d2-97e9-b65fbe0e7e83 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:31.252237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac513078-365b-41d2-97e9-b65fbe0e7e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:31.319307 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ac513078-365b-41d2-97e9-b65fbe0e7e83 None None] MFA Rules not processed for user `defbff3e8f934dab9c800c7207c1d539`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:31.323402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ac513078-365b-41d2-97e9-b65fbe0e7e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:31.443303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:31.499822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 883/1754] 10.222.0.91 () {58 vars in 1015 bytes} [Fri Sep 23 15:32:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:32:31.897644 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ee561-4ff7-4595-89fc-7d22cfb99ccf service swift] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:31.918341 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ee561-4ff7-4595-89fc-7d22cfb99ccf service swift] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:31.933293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b571be1-3e0a-4810-a117-78d5d1d26873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:31.933946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571be1-3e0a-4810-a117-78d5d1d26873 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:31.939030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571be1-3e0a-4810-a117-78d5d1d26873 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:31.939355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571be1-3e0a-4810-a117-78d5d1d26873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:31.982490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b571be1-3e0a-4810-a117-78d5d1d26873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:31.984067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b571be1-3e0a-4810-a117-78d5d1d26873 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:32.009097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 872/1755] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:32.016688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:34.211332 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:34.590477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966a07c-66c7-4fe2-b094-123d2296c9a9 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:34.590963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966a07c-66c7-4fe2-b094-123d2296c9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:34.591124 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966a07c-66c7-4fe2-b094-123d2296c9a9 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:34.592433 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 884/1756] 10.222.0.82 () {54 vars in 921 bytes} [Fri Sep 23 15:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:32:34.622008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce7a69-893b-4700-965f-81f95866b0b2 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:34.622673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce7a69-893b-4700-965f-81f95866b0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:34.623097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce7a69-893b-4700-965f-81f95866b0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:34.677586 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bbce7a69-893b-4700-965f-81f95866b0b2 None None] MFA Rules not processed for user `6dbf682960cc447099c11862afa3206b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:34.679444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bbce7a69-893b-4700-965f-81f95866b0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:34.714241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:34.837346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 873/1757] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Sep 23 15:32:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:35.549562 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966a07c-66c7-4fe2-b094-123d2296c9a9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:35.549562 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5966a07c-66c7-4fe2-b094-123d2296c9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:35.592581 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966a07c-66c7-4fe2-b094-123d2296c9a9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:35.613894 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c150e71-7018-457c-ac0e-a2ed50fe2b87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:35.614515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c150e71-7018-457c-ac0e-a2ed50fe2b87 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:35.614982 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c150e71-7018-457c-ac0e-a2ed50fe2b87 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:35.615408 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c150e71-7018-457c-ac0e-a2ed50fe2b87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:35.651842 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c150e71-7018-457c-ac0e-a2ed50fe2b87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:35.653903 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c150e71-7018-457c-ac0e-a2ed50fe2b87 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:35.673617 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 885/1758] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:36.178632 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce7a69-893b-4700-965f-81f95866b0b2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:36.375173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce7a69-893b-4700-965f-81f95866b0b2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:36.382868 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:36.392764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31976f0-1a49-49d9-8212-d1254a0e83b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:36.396575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31976f0-1a49-49d9-8212-d1254a0e83b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:36.396575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31976f0-1a49-49d9-8212-d1254a0e83b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:36.396575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31976f0-1a49-49d9-8212-d1254a0e83b5 admin admin] PATH_INFO: `/v3/users/6517385534af4447bb2f6db97cf36e5a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:36.398919 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31976f0-1a49-49d9-8212-d1254a0e83b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6517385534af4447bb2f6db97cf36e5a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:36.401495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31976f0-1a49-49d9-8212-d1254a0e83b5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:36.786543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f31976f0-1a49-49d9-8212-d1254a0e83b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6517385534af4447bb2f6db97cf36e5a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:36.847868 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f31976f0-1a49-49d9-8212-d1254a0e83b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6517385534af4447bb2f6db97cf36e5a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:36.922096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f31976f0-1a49-49d9-8212-d1254a0e83b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6517385534af4447bb2f6db97cf36e5a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:36.943444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f31976f0-1a49-49d9-8212-d1254a0e83b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6517385534af4447bb2f6db97cf36e5a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:37.181848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f31976f0-1a49-49d9-8212-d1254a0e83b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6517385534af4447bb2f6db97cf36e5a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:37.204403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 874/1759] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:36 2022] DELETE /identity/v3/users/6517385534af4447bb2f6db97cf36e5a => generated 0 bytes in 1026 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:37.209301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7cdd8-4b60-4ee7-8c3a-883d0f3a0896 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:37.216439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7cdd8-4b60-4ee7-8c3a-883d0f3a0896 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:37.216439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7cdd8-4b60-4ee7-8c3a-883d0f3a0896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:37.271141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-97b7cdd8-4b60-4ee7-8c3a-883d0f3a0896 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:37.272531 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-97b7cdd8-4b60-4ee7-8c3a-883d0f3a0896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:37.383024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:37.459473 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 886/1760] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:37.552499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31976f0-1a49-49d9-8212-d1254a0e83b5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:37.554356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f31976f0-1a49-49d9-8212-d1254a0e83b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:37.688382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31976f0-1a49-49d9-8212-d1254a0e83b5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:37.705673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a0662-4761-4632-b23d-9da59c1141e1 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:37.706007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a0662-4761-4632-b23d-9da59c1141e1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:37.706383 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a0662-4761-4632-b23d-9da59c1141e1 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:37.707038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40d9a4-3dfe-4d0a-a586-626ecc7f4578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:37.707676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40d9a4-3dfe-4d0a-a586-626ecc7f4578 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:37.707952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40d9a4-3dfe-4d0a-a586-626ecc7f4578 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:37.708265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 887/1761] 10.222.0.82 () {54 vars in 921 bytes} [Fri Sep 23 15:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:32:37.712100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40d9a4-3dfe-4d0a-a586-626ecc7f4578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:37.735423 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1141e-97e7-411d-9006-c86bd86f3338 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:37.736024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1141e-97e7-411d-9006-c86bd86f3338 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:37.736652 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1141e-97e7-411d-9006-c86bd86f3338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:37.755458 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40d9a4-3dfe-4d0a-a586-626ecc7f4578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:37.758334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40d9a4-3dfe-4d0a-a586-626ecc7f4578 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:37.788192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5ae1141e-97e7-411d-9006-c86bd86f3338 None None] MFA Rules not processed for user `6dbf682960cc447099c11862afa3206b`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:37.792623 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5ae1141e-97e7-411d-9006-c86bd86f3338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:37.801030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 875/1762] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:37.884904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:37.930092 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 888/1763] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Sep 23 15:32:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:38.288135 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40d9a4-3dfe-4d0a-a586-626ecc7f4578 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:38.291443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2d40d9a4-3dfe-4d0a-a586-626ecc7f4578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:38.319768 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40d9a4-3dfe-4d0a-a586-626ecc7f4578 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:38.330163 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f45a-0bee-4069-95f0-eb6b42b5d293 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:38.331526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f45a-0bee-4069-95f0-eb6b42b5d293 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:38.332368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f45a-0bee-4069-95f0-eb6b42b5d293 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:38.332514 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f45a-0bee-4069-95f0-eb6b42b5d293 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:38.361685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0f45a-0bee-4069-95f0-eb6b42b5d293 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:38.361685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0f45a-0bee-4069-95f0-eb6b42b5d293 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:38.402182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 876/1764] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:39.818952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1141e-97e7-411d-9006-c86bd86f3338 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:39.821183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5ae1141e-97e7-411d-9006-c86bd86f3338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:39.845515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1141e-97e7-411d-9006-c86bd86f3338 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:39.855823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5d265-a78f-41d7-94f9-2a7ca6837eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:39.857166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5d265-a78f-41d7-94f9-2a7ca6837eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:39.857769 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5d265-a78f-41d7-94f9-2a7ca6837eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:39.858683 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5d265-a78f-41d7-94f9-2a7ca6837eb2 admin admin] PATH_INFO: `/v3/users/f21150d591e94569afdfcc7bf2662079` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:39.860622 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5d265-a78f-41d7-94f9-2a7ca6837eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21150d591e94569afdfcc7bf2662079)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:39.862861 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5d265-a78f-41d7-94f9-2a7ca6837eb2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:39.919366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:40.194927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-91b5d265-a78f-41d7-94f9-2a7ca6837eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21150d591e94569afdfcc7bf2662079'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:40.258737 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-91b5d265-a78f-41d7-94f9-2a7ca6837eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21150d591e94569afdfcc7bf2662079'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:40.279096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-91b5d265-a78f-41d7-94f9-2a7ca6837eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21150d591e94569afdfcc7bf2662079'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:40.280513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-91b5d265-a78f-41d7-94f9-2a7ca6837eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21150d591e94569afdfcc7bf2662079'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:40.371211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-91b5d265-a78f-41d7-94f9-2a7ca6837eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21150d591e94569afdfcc7bf2662079'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:40.382625 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f45a-0bee-4069-95f0-eb6b42b5d293 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:40.384472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 889/1765] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:39 2022] DELETE /identity/v3/users/f21150d591e94569afdfcc7bf2662079 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:40.384819 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dfb0f45a-0bee-4069-95f0-eb6b42b5d293 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:40.389584 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092f91c-5e69-425b-a71d-dd716c6b7e2f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:40.390014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092f91c-5e69-425b-a71d-dd716c6b7e2f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:40.390383 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092f91c-5e69-425b-a71d-dd716c6b7e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:40.410026 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f45a-0bee-4069-95f0-eb6b42b5d293 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:40.438616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e092f91c-5e69-425b-a71d-dd716c6b7e2f None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:40.440284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e092f91c-5e69-425b-a71d-dd716c6b7e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:40.556050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 890/1766] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:40.572094 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b981ba-1fa4-4cad-834f-ecc4aabec229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:40.572840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b981ba-1fa4-4cad-834f-ecc4aabec229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:40.573525 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b981ba-1fa4-4cad-834f-ecc4aabec229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:40.573879 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b981ba-1fa4-4cad-834f-ecc4aabec229 admin admin] PATH_INFO: `/v3/projects/894b0cce9f414626a23388c23638c408` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:40.578197 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b981ba-1fa4-4cad-834f-ecc4aabec229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=894b0cce9f414626a23388c23638c408)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:40.578197 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b981ba-1fa4-4cad-834f-ecc4aabec229 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:40.588552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092f91c-5e69-425b-a71d-dd716c6b7e2f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:40.590070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e092f91c-5e69-425b-a71d-dd716c6b7e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:40.596848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:40.682090 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092f91c-5e69-425b-a71d-dd716c6b7e2f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:40.698927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6915d3-a80a-4d63-9a92-e6cef29e70fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:40.700433 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6915d3-a80a-4d63-9a92-e6cef29e70fa service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:40.700904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6915d3-a80a-4d63-9a92-e6cef29e70fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:40.701412 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6915d3-a80a-4d63-9a92-e6cef29e70fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:40.714110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6915d3-a80a-4d63-9a92-e6cef29e70fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:40.715969 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6915d3-a80a-4d63-9a92-e6cef29e70fa service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:40.730476 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-45b981ba-1fa4-4cad-834f-ecc4aabec229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '894b0cce9f414626a23388c23638c408', 'request_id': 'req-45b981ba-1fa4-4cad-834f-ecc4aabec229'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:40.748959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 891/1767] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:40.803094 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-45b981ba-1fa4-4cad-834f-ecc4aabec229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '894b0cce9f414626a23388c23638c408', 'request_id': 'req-45b981ba-1fa4-4cad-834f-ecc4aabec229'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:40.815494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-45b981ba-1fa4-4cad-834f-ecc4aabec229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '894b0cce9f414626a23388c23638c408', 'request_id': 'req-45b981ba-1fa4-4cad-834f-ecc4aabec229'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:40.846995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-45b981ba-1fa4-4cad-834f-ecc4aabec229 admin admin] The token cache is being invalidate because project 894b0cce9f414626a23388c23638c408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:32:40.853502 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-45b981ba-1fa4-4cad-834f-ecc4aabec229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:40.857125 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-45b981ba-1fa4-4cad-834f-ecc4aabec229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:40.860068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 877/1768] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:40 2022] DELETE /identity/v3/projects/894b0cce9f414626a23388c23638c408 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:32:40.864354 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6915d3-a80a-4d63-9a92-e6cef29e70fa service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:40.867333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5e6915d3-a80a-4d63-9a92-e6cef29e70fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:40.916742 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6915d3-a80a-4d63-9a92-e6cef29e70fa service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:41.151690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e3362-03ac-4259-84c9-bc1b3ce1e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:41.152779 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e3362-03ac-4259-84c9-bc1b3ce1e8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:41.153336 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e3362-03ac-4259-84c9-bc1b3ce1e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:41.154065 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e3362-03ac-4259-84c9-bc1b3ce1e8d5 admin admin] PATH_INFO: `/v3/users/7e218f955246426594d9d274242dcd9d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:41.155650 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e3362-03ac-4259-84c9-bc1b3ce1e8d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e218f955246426594d9d274242dcd9d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:41.158261 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e3362-03ac-4259-84c9-bc1b3ce1e8d5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:41.477424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5d6e3362-03ac-4259-84c9-bc1b3ce1e8d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e218f955246426594d9d274242dcd9d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:41.524230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5d6e3362-03ac-4259-84c9-bc1b3ce1e8d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e218f955246426594d9d274242dcd9d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:41.560440 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5d6e3362-03ac-4259-84c9-bc1b3ce1e8d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e218f955246426594d9d274242dcd9d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:41.565816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5d6e3362-03ac-4259-84c9-bc1b3ce1e8d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e218f955246426594d9d274242dcd9d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:41.613998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:41.666941 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5d6e3362-03ac-4259-84c9-bc1b3ce1e8d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e218f955246426594d9d274242dcd9d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:41.674646 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b981ba-1fa4-4cad-834f-ecc4aabec229 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:41.676952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-45b981ba-1fa4-4cad-834f-ecc4aabec229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:41.684498 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 892/1769] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:40 2022] DELETE /identity/v3/users/7e218f955246426594d9d274242dcd9d => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:41.712057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b981ba-1fa4-4cad-834f-ecc4aabec229 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:41.850422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c97c5-c921-42c5-bb89-6c34e52c164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:41.853264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c97c5-c921-42c5-bb89-6c34e52c164d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:41.853612 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c97c5-c921-42c5-bb89-6c34e52c164d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:41.854318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c97c5-c921-42c5-bb89-6c34e52c164d admin admin] PATH_INFO: `/v3/projects/2abcd595f2e540c79d1c557dd00a6f8d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:41.856064 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c97c5-c921-42c5-bb89-6c34e52c164d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2abcd595f2e540c79d1c557dd00a6f8d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:41.858332 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c97c5-c921-42c5-bb89-6c34e52c164d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:42.045148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c61c97c5-c921-42c5-bb89-6c34e52c164d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2abcd595f2e540c79d1c557dd00a6f8d', 'request_id': 'req-c61c97c5-c921-42c5-bb89-6c34e52c164d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:42.124655 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c61c97c5-c921-42c5-bb89-6c34e52c164d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2abcd595f2e540c79d1c557dd00a6f8d', 'request_id': 'req-c61c97c5-c921-42c5-bb89-6c34e52c164d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:42.136128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c61c97c5-c921-42c5-bb89-6c34e52c164d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2abcd595f2e540c79d1c557dd00a6f8d', 'request_id': 'req-c61c97c5-c921-42c5-bb89-6c34e52c164d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:42.194754 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c61c97c5-c921-42c5-bb89-6c34e52c164d admin admin] The token cache is being invalidate because project 2abcd595f2e540c79d1c557dd00a6f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:32:42.195814 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c61c97c5-c921-42c5-bb89-6c34e52c164d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:42.198384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c61c97c5-c921-42c5-bb89-6c34e52c164d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:42.203965 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 878/1770] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:41 2022] DELETE /identity/v3/projects/2abcd595f2e540c79d1c557dd00a6f8d => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:42.204405 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e3362-03ac-4259-84c9-bc1b3ce1e8d5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:42.206741 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5d6e3362-03ac-4259-84c9-bc1b3ce1e8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:42.240024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e3362-03ac-4259-84c9-bc1b3ce1e8d5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:42.356778 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48bed7-63a0-4bf5-9f9d-1bb935343d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:42.357448 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48bed7-63a0-4bf5-9f9d-1bb935343d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:42.357726 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48bed7-63a0-4bf5-9f9d-1bb935343d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:42.358060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48bed7-63a0-4bf5-9f9d-1bb935343d5c admin admin] PATH_INFO: `/v3/users/aec8e4886d4444ccba8d9f5002a4829c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:42.359229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48bed7-63a0-4bf5-9f9d-1bb935343d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec8e4886d4444ccba8d9f5002a4829c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:42.361497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48bed7-63a0-4bf5-9f9d-1bb935343d5c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:42.739745 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8b48bed7-63a0-4bf5-9f9d-1bb935343d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec8e4886d4444ccba8d9f5002a4829c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:42.765049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8b48bed7-63a0-4bf5-9f9d-1bb935343d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec8e4886d4444ccba8d9f5002a4829c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:42.773602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8b48bed7-63a0-4bf5-9f9d-1bb935343d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec8e4886d4444ccba8d9f5002a4829c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:42.774753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8b48bed7-63a0-4bf5-9f9d-1bb935343d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec8e4886d4444ccba8d9f5002a4829c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:42.852919 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c97c5-c921-42c5-bb89-6c34e52c164d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:42.856472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c61c97c5-c921-42c5-bb89-6c34e52c164d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:42.866111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8b48bed7-63a0-4bf5-9f9d-1bb935343d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec8e4886d4444ccba8d9f5002a4829c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:42.877144 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c97c5-c921-42c5-bb89-6c34e52c164d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:42.884597 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec9437-480d-443b-9135-95fb58c2ce8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:42.888561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 893/1771] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:42 2022] DELETE /identity/v3/users/aec8e4886d4444ccba8d9f5002a4829c => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:42.889618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec9437-480d-443b-9135-95fb58c2ce8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:42.890507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec9437-480d-443b-9135-95fb58c2ce8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:42.890991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec9437-480d-443b-9135-95fb58c2ce8b admin admin] PATH_INFO: `/v3/projects/be1fc0afb5744c6a9e171b2d04714cf0` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:42.893865 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec9437-480d-443b-9135-95fb58c2ce8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1fc0afb5744c6a9e171b2d04714cf0)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:42.898133 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec9437-480d-443b-9135-95fb58c2ce8b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:43.476241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1aec9437-480d-443b-9135-95fb58c2ce8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1fc0afb5744c6a9e171b2d04714cf0', 'request_id': 'req-1aec9437-480d-443b-9135-95fb58c2ce8b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:43.660960 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1aec9437-480d-443b-9135-95fb58c2ce8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1fc0afb5744c6a9e171b2d04714cf0', 'request_id': 'req-1aec9437-480d-443b-9135-95fb58c2ce8b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:43.667100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1aec9437-480d-443b-9135-95fb58c2ce8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1fc0afb5744c6a9e171b2d04714cf0', 'request_id': 'req-1aec9437-480d-443b-9135-95fb58c2ce8b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:43.679408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1aec9437-480d-443b-9135-95fb58c2ce8b admin admin] The token cache is being invalidate because project be1fc0afb5744c6a9e171b2d04714cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:32:43.679806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1aec9437-480d-443b-9135-95fb58c2ce8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:43.680567 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1aec9437-480d-443b-9135-95fb58c2ce8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:43.685764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 879/1772] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:42 2022] DELETE /identity/v3/projects/be1fc0afb5744c6a9e171b2d04714cf0 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:43.687343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c3750-27c0-4d7e-9917-d4dc4f1d1817 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:43.687838 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c3750-27c0-4d7e-9917-d4dc4f1d1817 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:43.688032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c3750-27c0-4d7e-9917-d4dc4f1d1817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:43.717676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c54c3750-27c0-4d7e-9917-d4dc4f1d1817 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:43.717676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c54c3750-27c0-4d7e-9917-d4dc4f1d1817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:43.778041 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 894/1773] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:43.785950 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54312d-73b9-4095-80a8-6e66f7a3f6db None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:43.786245 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54312d-73b9-4095-80a8-6e66f7a3f6db None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:43.786528 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54312d-73b9-4095-80a8-6e66f7a3f6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:43.807363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3c54312d-73b9-4095-80a8-6e66f7a3f6db None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:43.815146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3c54312d-73b9-4095-80a8-6e66f7a3f6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:43.817096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 880/1774] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:43.822073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c3750-27c0-4d7e-9917-d4dc4f1d1817 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:43.831741 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c3750-27c0-4d7e-9917-d4dc4f1d1817 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:43.837450 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209171ae-3ebf-4ff2-8231-f219ac403215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:43.843757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209171ae-3ebf-4ff2-8231-f219ac403215 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:43.843757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209171ae-3ebf-4ff2-8231-f219ac403215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:43.843757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209171ae-3ebf-4ff2-8231-f219ac403215 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:43.843757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209171ae-3ebf-4ff2-8231-f219ac403215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:32:43.843757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209171ae-3ebf-4ff2-8231-f219ac403215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:43.843757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209171ae-3ebf-4ff2-8231-f219ac403215 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:43.853328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 895/1775] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:32:43.857673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54312d-73b9-4095-80a8-6e66f7a3f6db None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:43.867461 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54312d-73b9-4095-80a8-6e66f7a3f6db None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:43.872232 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49378ea-580b-4c82-a37f-389164c380aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:43.872938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49378ea-580b-4c82-a37f-389164c380aa admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:43.873282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49378ea-580b-4c82-a37f-389164c380aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:43.873623 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49378ea-580b-4c82-a37f-389164c380aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:43.874371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49378ea-580b-4c82-a37f-389164c380aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:43.876337 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49378ea-580b-4c82-a37f-389164c380aa admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:44.024592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 881/1776] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:32:43 2022] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:32:44.028946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209171ae-3ebf-4ff2-8231-f219ac403215 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:44.040046 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209171ae-3ebf-4ff2-8231-f219ac403215 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:44.101244 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df60ae6-e8e5-4d5d-b894-2da7a78a5f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:44.101898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60ae6-e8e5-4d5d-b894-2da7a78a5f54 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:44.102178 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60ae6-e8e5-4d5d-b894-2da7a78a5f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:44.106554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60ae6-e8e5-4d5d-b894-2da7a78a5f54 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:44.106554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df60ae6-e8e5-4d5d-b894-2da7a78a5f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:44.106554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df60ae6-e8e5-4d5d-b894-2da7a78a5f54 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:44.132018 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49378ea-580b-4c82-a37f-389164c380aa admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:44.135478 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:44.137788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b49378ea-580b-4c82-a37f-389164c380aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:44.153305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49378ea-580b-4c82-a37f-389164c380aa admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:44.168211 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db3113-4bca-441b-89dc-a13da2e4d18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:44.168879 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db3113-4bca-441b-89dc-a13da2e4d18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:44.169214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db3113-4bca-441b-89dc-a13da2e4d18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:44.169974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db3113-4bca-441b-89dc-a13da2e4d18e admin admin] PATH_INFO: `/v3/projects/187695620ec74843bf4b2064169f8cda` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:44.171376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db3113-4bca-441b-89dc-a13da2e4d18e admin admin] RBAC: Authorizing `identity:delete_project(project_id=187695620ec74843bf4b2064169f8cda)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:44.177870 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db3113-4bca-441b-89dc-a13da2e4d18e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:44.183301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 896/1777] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:32:44 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:44.187508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df60ae6-e8e5-4d5d-b894-2da7a78a5f54 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:44.210585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df60ae6-e8e5-4d5d-b894-2da7a78a5f54 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:44.231217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b0ec3-f079-462e-9834-bd0844c71aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:44.232009 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b0ec3-f079-462e-9834-bd0844c71aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:44.232461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b0ec3-f079-462e-9834-bd0844c71aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:44.233225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b0ec3-f079-462e-9834-bd0844c71aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:44.233952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b0ec3-f079-462e-9834-bd0844c71aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:44.235733 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b0ec3-f079-462e-9834-bd0844c71aa5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:44.249760 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 897/1778] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:44.253843 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b0ec3-f079-462e-9834-bd0844c71aa5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:44.264952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b0ec3-f079-462e-9834-bd0844c71aa5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:44.269565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b70eb-c512-4189-8a04-04b37e401a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:44.270211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b70eb-c512-4189-8a04-04b37e401a75 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:44.277039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b70eb-c512-4189-8a04-04b37e401a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:44.277039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b70eb-c512-4189-8a04-04b37e401a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:44.277039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b70eb-c512-4189-8a04-04b37e401a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:44.277039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b70eb-c512-4189-8a04-04b37e401a75 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:44.283569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 898/1779] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:32:44.287696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b70eb-c512-4189-8a04-04b37e401a75 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:44.302007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b70eb-c512-4189-8a04-04b37e401a75 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:44.332634 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-92db3113-4bca-441b-89dc-a13da2e4d18e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187695620ec74843bf4b2064169f8cda', 'request_id': 'req-92db3113-4bca-441b-89dc-a13da2e4d18e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:44.389314 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fc41d-58b6-4b10-aafb-279854b4c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:44.390036 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fc41d-58b6-4b10-aafb-279854b4c0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:44.390440 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fc41d-58b6-4b10-aafb-279854b4c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:44.391115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fc41d-58b6-4b10-aafb-279854b4c0bd admin admin] PATH_INFO: `/v3/projects/4fa53746a8af49e5ac69473e7cbdaa40/users/f3ca079587df4a329bb6b0ab0be3678f/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:44.407067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fc41d-58b6-4b10-aafb-279854b4c0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa53746a8af49e5ac69473e7cbdaa40, user_id=f3ca079587df4a329bb6b0ab0be3678f, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:44.409837 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fc41d-58b6-4b10-aafb-279854b4c0bd admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:44.426346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-92db3113-4bca-441b-89dc-a13da2e4d18e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187695620ec74843bf4b2064169f8cda', 'request_id': 'req-92db3113-4bca-441b-89dc-a13da2e4d18e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:44.433142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-92db3113-4bca-441b-89dc-a13da2e4d18e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187695620ec74843bf4b2064169f8cda', 'request_id': 'req-92db3113-4bca-441b-89dc-a13da2e4d18e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:44.445153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-92db3113-4bca-441b-89dc-a13da2e4d18e admin admin] The token cache is being invalidate because project 187695620ec74843bf4b2064169f8cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:32:44.445445 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-92db3113-4bca-441b-89dc-a13da2e4d18e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:44.446156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-92db3113-4bca-441b-89dc-a13da2e4d18e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:44.447977 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 882/1780] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:44 2022] DELETE /identity/v3/projects/187695620ec74843bf4b2064169f8cda => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:32:44.452813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb84c7-2d28-4422-b522-43640fc7980e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:44.453101 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb84c7-2d28-4422-b522-43640fc7980e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:44.453541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb84c7-2d28-4422-b522-43640fc7980e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:44.475171 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-27bb84c7-2d28-4422-b522-43640fc7980e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:44.476890 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-27bb84c7-2d28-4422-b522-43640fc7980e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:44.484890 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 883/1781] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:44.493299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e368427-6c43-49f7-91bf-276d027da655 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:44.493583 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e368427-6c43-49f7-91bf-276d027da655 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:44.493894 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e368427-6c43-49f7-91bf-276d027da655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:44.516292 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0e368427-6c43-49f7-91bf-276d027da655 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:44.517567 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0e368427-6c43-49f7-91bf-276d027da655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:44.529712 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 884/1782] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:32:44.530610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e368427-6c43-49f7-91bf-276d027da655 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:44.541392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e368427-6c43-49f7-91bf-276d027da655 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:44.555852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74b509-5aad-44ab-8fa7-aa830ae3f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:44.555852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74b509-5aad-44ab-8fa7-aa830ae3f9bb admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:44.555852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74b509-5aad-44ab-8fa7-aa830ae3f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:44.555852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74b509-5aad-44ab-8fa7-aa830ae3f9bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:44.556215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74b509-5aad-44ab-8fa7-aa830ae3f9bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:32:44.556215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74b509-5aad-44ab-8fa7-aa830ae3f9bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:44.556215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74b509-5aad-44ab-8fa7-aa830ae3f9bb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:44.566968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 899/1783] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:44 2022] PUT /identity/v3/projects/4fa53746a8af49e5ac69473e7cbdaa40/users/f3ca079587df4a329bb6b0ab0be3678f/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:32:44.567481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 885/1784] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:32:44.568580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7ef84-4f04-4fd2-a078-d365d592fa0b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:44.568874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7ef84-4f04-4fd2-a078-d365d592fa0b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:44.569153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7ef84-4f04-4fd2-a078-d365d592fa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:44.571519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74b509-5aad-44ab-8fa7-aa830ae3f9bb admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:44.592380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74b509-5aad-44ab-8fa7-aa830ae3f9bb admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:44.627151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-57b7ef84-4f04-4fd2-a078-d365d592fa0b None None] MFA Rules not processed for user `f3ca079587df4a329bb6b0ab0be3678f`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:44.628813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-57b7ef84-4f04-4fd2-a078-d365d592fa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:44.688319 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d8ad9-7c1e-411a-ae8d-2b13091e3419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:44.692858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d8ad9-7c1e-411a-ae8d-2b13091e3419 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:44.692858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d8ad9-7c1e-411a-ae8d-2b13091e3419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:44.692858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d8ad9-7c1e-411a-ae8d-2b13091e3419 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:44.692858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d8ad9-7c1e-411a-ae8d-2b13091e3419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:44.693395 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d8ad9-7c1e-411a-ae8d-2b13091e3419 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:44.784086 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 900/1785] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:32:44.789567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7ef84-4f04-4fd2-a078-d365d592fa0b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:44.791706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-57b7ef84-4f04-4fd2-a078-d365d592fa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:44.816949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7ef84-4f04-4fd2-a078-d365d592fa0b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:44.822634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee54c76-fab0-4a90-ab95-0ca412a15f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:44.823470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee54c76-fab0-4a90-ab95-0ca412a15f16 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:44.823867 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee54c76-fab0-4a90-ab95-0ca412a15f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:44.824555 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee54c76-fab0-4a90-ab95-0ca412a15f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:44.825020 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee54c76-fab0-4a90-ab95-0ca412a15f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:44.827156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee54c76-fab0-4a90-ab95-0ca412a15f16 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:44.842498 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 886/1786] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:32:44 2022] POST /identity/v3/projects => generated 377 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:44.847396 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d8ad9-7c1e-411a-ae8d-2b13091e3419 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:44.904288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 901/1787] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:32:44 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:44.909912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee54c76-fab0-4a90-ab95-0ca412a15f16 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:44.925687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d8ad9-7c1e-411a-ae8d-2b13091e3419 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:44.985950 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee54c76-fab0-4a90-ab95-0ca412a15f16 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:44.986305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905fcbd-3525-4b02-9847-b074265203ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:44.986927 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905fcbd-3525-4b02-9847-b074265203ef admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:44.987208 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905fcbd-3525-4b02-9847-b074265203ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:44.987486 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905fcbd-3525-4b02-9847-b074265203ef admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:44.988123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905fcbd-3525-4b02-9847-b074265203ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:44.990100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905fcbd-3525-4b02-9847-b074265203ef admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:44.991210 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac5ebf-ea56-4af5-ae01-4567796142e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:44.991998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac5ebf-ea56-4af5-ae01-4567796142e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:44.992284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac5ebf-ea56-4af5-ae01-4567796142e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:44.992557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac5ebf-ea56-4af5-ae01-4567796142e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:44.993395 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac5ebf-ea56-4af5-ae01-4567796142e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:44.995525 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac5ebf-ea56-4af5-ae01-4567796142e8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:45.088213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 887/1788] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:32:44 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:45.092312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905fcbd-3525-4b02-9847-b074265203ef admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:45.101852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905fcbd-3525-4b02-9847-b074265203ef admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:45.112400 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00c9ac-75b9-459e-a917-74b31ff89d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:45.112400 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00c9ac-75b9-459e-a917-74b31ff89d0f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:45.112400 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00c9ac-75b9-459e-a917-74b31ff89d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:45.112400 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00c9ac-75b9-459e-a917-74b31ff89d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:45.112704 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00c9ac-75b9-459e-a917-74b31ff89d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:45.112953 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00c9ac-75b9-459e-a917-74b31ff89d0f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:45.114694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 902/1789] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:32:44 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:32:45.115687 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac5ebf-ea56-4af5-ae01-4567796142e8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:45.126544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac5ebf-ea56-4af5-ae01-4567796142e8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:45.128064 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 888/1790] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:32:45.131673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c28d1-368c-4cf2-9b8f-853a5b73d869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:45.132038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00c9ac-75b9-459e-a917-74b31ff89d0f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:45.133171 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c28d1-368c-4cf2-9b8f-853a5b73d869 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:45.133461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c28d1-368c-4cf2-9b8f-853a5b73d869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:45.133744 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c28d1-368c-4cf2-9b8f-853a5b73d869 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:45.134406 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c28d1-368c-4cf2-9b8f-853a5b73d869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:45.136024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c28d1-368c-4cf2-9b8f-853a5b73d869 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:45.142697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00c9ac-75b9-459e-a917-74b31ff89d0f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:45.151281 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 903/1791] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:45.151458 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc55783-09ea-4c4b-a31e-658923abc7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:45.152165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c28d1-368c-4cf2-9b8f-853a5b73d869 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:45.152297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55783-09ea-4c4b-a31e-658923abc7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:45.152562 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55783-09ea-4c4b-a31e-658923abc7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:45.152844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55783-09ea-4c4b-a31e-658923abc7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:45.153483 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc55783-09ea-4c4b-a31e-658923abc7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:45.155327 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc55783-09ea-4c4b-a31e-658923abc7c1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:45.162280 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c28d1-368c-4cf2-9b8f-853a5b73d869 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:45.174988 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 889/1792] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:32:45.175324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a5d6a-d613-414b-8109-261eb0b8d631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:45.175324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a5d6a-d613-414b-8109-261eb0b8d631 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:45.175324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a5d6a-d613-414b-8109-261eb0b8d631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:45.175324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a5d6a-d613-414b-8109-261eb0b8d631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:45.175676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a5d6a-d613-414b-8109-261eb0b8d631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:45.175676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a5d6a-d613-414b-8109-261eb0b8d631 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:45.178017 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc55783-09ea-4c4b-a31e-658923abc7c1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:45.184242 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 904/1793] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:45.185331 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a5d6a-d613-414b-8109-261eb0b8d631 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:45.188343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc55783-09ea-4c4b-a31e-658923abc7c1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:45.193838 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e76d30-11d3-4f46-b2d7-b2e27263a1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:45.194591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e76d30-11d3-4f46-b2d7-b2e27263a1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:45.195524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e76d30-11d3-4f46-b2d7-b2e27263a1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:45.195891 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e76d30-11d3-4f46-b2d7-b2e27263a1ca admin admin] PATH_INFO: `/v3/projects/a299b105df8b49ceaea02363db0c7b27/users/31b22f32c54f4f039c1cfec9f8888960/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:45.196731 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a5d6a-d613-414b-8109-261eb0b8d631 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:45.202150 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a55d6-6bcc-4aea-b1a4-34d1ee098ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:45.202933 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a55d6-6bcc-4aea-b1a4-34d1ee098ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:45.203213 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a55d6-6bcc-4aea-b1a4-34d1ee098ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:45.203475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a55d6-6bcc-4aea-b1a4-34d1ee098ee9 admin admin] PATH_INFO: `/v3/projects/03a0aa17f06342e0a7ecc7563d3780b4/users/059f418343a348e1aeeec4d451814846/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:45.214690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e76d30-11d3-4f46-b2d7-b2e27263a1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a299b105df8b49ceaea02363db0c7b27, user_id=31b22f32c54f4f039c1cfec9f8888960, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:45.217426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e76d30-11d3-4f46-b2d7-b2e27263a1ca admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:45.219100 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a55d6-6bcc-4aea-b1a4-34d1ee098ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a0aa17f06342e0a7ecc7563d3780b4, user_id=059f418343a348e1aeeec4d451814846, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:45.221787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a55d6-6bcc-4aea-b1a4-34d1ee098ee9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:45.325089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 890/1794] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:45 2022] PUT /identity/v3/projects/a299b105df8b49ceaea02363db0c7b27/users/31b22f32c54f4f039c1cfec9f8888960/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:45.332816 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29772475-b62c-4915-8f09-13e044859797 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:45.333126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29772475-b62c-4915-8f09-13e044859797 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:45.333401 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29772475-b62c-4915-8f09-13e044859797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:45.359089 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 905/1795] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:45 2022] PUT /identity/v3/projects/03a0aa17f06342e0a7ecc7563d3780b4/users/059f418343a348e1aeeec4d451814846/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:45.370904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dce389-ae31-4449-92c3-d03535c46cb7 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:45.370904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dce389-ae31-4449-92c3-d03535c46cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:45.371097 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dce389-ae31-4449-92c3-d03535c46cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:45.372084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-29772475-b62c-4915-8f09-13e044859797 None None] MFA Rules not processed for user `31b22f32c54f4f039c1cfec9f8888960`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:45.373651 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-29772475-b62c-4915-8f09-13e044859797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:45.405690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c6dce389-ae31-4449-92c3-d03535c46cb7 None None] MFA Rules not processed for user `059f418343a348e1aeeec4d451814846`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:45.407170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c6dce389-ae31-4449-92c3-d03535c46cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:45.459932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 891/1796] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:32:45.465617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29772475-b62c-4915-8f09-13e044859797 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:45.502667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 906/1797] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:45.506649 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dce389-ae31-4449-92c3-d03535c46cb7 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:45.534732 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29772475-b62c-4915-8f09-13e044859797 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:45.539325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c53c7-6878-4d87-9cf0-9230e5a22362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:45.539930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c53c7-6878-4d87-9cf0-9230e5a22362 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:45.540206 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c53c7-6878-4d87-9cf0-9230e5a22362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:45.540477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c53c7-6878-4d87-9cf0-9230e5a22362 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:45.541102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c53c7-6878-4d87-9cf0-9230e5a22362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:45.543018 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c53c7-6878-4d87-9cf0-9230e5a22362 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:45.573665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dce389-ae31-4449-92c3-d03535c46cb7 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:45.578194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a087390-38b7-41a6-b6fe-7058032fb374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:45.578791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a087390-38b7-41a6-b6fe-7058032fb374 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:45.579064 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a087390-38b7-41a6-b6fe-7058032fb374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:45.579360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a087390-38b7-41a6-b6fe-7058032fb374 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:45.579988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a087390-38b7-41a6-b6fe-7058032fb374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:45.581906 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a087390-38b7-41a6-b6fe-7058032fb374 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:45.801900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 892/1798] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:32:45 2022] POST /identity/v3/projects => generated 377 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:32:45.802829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c53c7-6878-4d87-9cf0-9230e5a22362 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:45.872007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 907/1799] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:32:45 2022] POST /identity/v3/projects => generated 379 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:32:45.876714 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a087390-38b7-41a6-b6fe-7058032fb374 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:45.876839 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c53c7-6878-4d87-9cf0-9230e5a22362 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:45.946349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a224e2b-94f8-4aa2-9d28-d22708ada8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:45.946951 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a224e2b-94f8-4aa2-9d28-d22708ada8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:45.947223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a224e2b-94f8-4aa2-9d28-d22708ada8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:45.947491 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a224e2b-94f8-4aa2-9d28-d22708ada8c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:45.948128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a224e2b-94f8-4aa2-9d28-d22708ada8c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:45.950567 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a224e2b-94f8-4aa2-9d28-d22708ada8c2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:45.975741 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a087390-38b7-41a6-b6fe-7058032fb374 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:45.981961 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca8d31-bbc4-4da6-8de3-c1a1f4b8fe90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:45.982783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca8d31-bbc4-4da6-8de3-c1a1f4b8fe90 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:45.983216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca8d31-bbc4-4da6-8de3-c1a1f4b8fe90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:45.983652 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca8d31-bbc4-4da6-8de3-c1a1f4b8fe90 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:45.984453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca8d31-bbc4-4da6-8de3-c1a1f4b8fe90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:45.986659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca8d31-bbc4-4da6-8de3-c1a1f4b8fe90 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:46.044240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:46.053828 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 893/1800] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:32:45 2022] POST /identity/v3/users => generated 295 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:32:46.055083 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a224e2b-94f8-4aa2-9d28-d22708ada8c2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:46.067966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a224e2b-94f8-4aa2-9d28-d22708ada8c2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:46.075490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7456c-1398-4440-b552-d5ef2f1c72e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:46.075921 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7456c-1398-4440-b552-d5ef2f1c72e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:46.076210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7456c-1398-4440-b552-d5ef2f1c72e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:46.076484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7456c-1398-4440-b552-d5ef2f1c72e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:46.077265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7456c-1398-4440-b552-d5ef2f1c72e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:46.080504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7456c-1398-4440-b552-d5ef2f1c72e5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:46.096265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 894/1801] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:32:46.102506 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7456c-1398-4440-b552-d5ef2f1c72e5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:46.103682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 908/1802] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:32:45 2022] POST /identity/v3/users => generated 296 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:46.107899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca8d31-bbc4-4da6-8de3-c1a1f4b8fe90 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:46.110791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7456c-1398-4440-b552-d5ef2f1c72e5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:46.116215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e2b13-c4ca-49ee-8571-6da55943428d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:46.116992 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e2b13-c4ca-49ee-8571-6da55943428d admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:46.117343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e2b13-c4ca-49ee-8571-6da55943428d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:46.117686 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e2b13-c4ca-49ee-8571-6da55943428d admin admin] PATH_INFO: `/v3/projects/b720b4665ed847da8ead27374a50ad22/users/f4ce37ffbfd0456cbe1fa52bc899a549/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:46.134514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca8d31-bbc4-4da6-8de3-c1a1f4b8fe90 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:46.147864 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e2b13-c4ca-49ee-8571-6da55943428d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b720b4665ed847da8ead27374a50ad22, user_id=f4ce37ffbfd0456cbe1fa52bc899a549, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:46.149292 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070af0e-4e51-4298-a845-e7f238c97902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:46.150730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070af0e-4e51-4298-a845-e7f238c97902 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:46.151307 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070af0e-4e51-4298-a845-e7f238c97902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:46.153058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e2b13-c4ca-49ee-8571-6da55943428d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:46.153174 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070af0e-4e51-4298-a845-e7f238c97902 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:46.153174 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070af0e-4e51-4298-a845-e7f238c97902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:46.154624 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070af0e-4e51-4298-a845-e7f238c97902 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:46.165722 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 909/1803] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:46.169617 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070af0e-4e51-4298-a845-e7f238c97902 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:46.180361 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070af0e-4e51-4298-a845-e7f238c97902 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:46.185469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe88ff8-149d-46c7-b53d-bcc54828e5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:46.190232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe88ff8-149d-46c7-b53d-bcc54828e5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:46.190232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe88ff8-149d-46c7-b53d-bcc54828e5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:46.190232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe88ff8-149d-46c7-b53d-bcc54828e5ab admin admin] PATH_INFO: `/v3/projects/892ee3e1bf294642bb12ccc723243f87/users/b6d231c02b32440bbfac59631c895e39/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:46.203996 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe88ff8-149d-46c7-b53d-bcc54828e5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=892ee3e1bf294642bb12ccc723243f87, user_id=b6d231c02b32440bbfac59631c895e39, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:46.206786 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe88ff8-149d-46c7-b53d-bcc54828e5ab admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:46.246964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 895/1804] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:46 2022] PUT /identity/v3/projects/b720b4665ed847da8ead27374a50ad22/users/f4ce37ffbfd0456cbe1fa52bc899a549/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:32:46.248277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e2b13-c4ca-49ee-8571-6da55943428d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:46.279763 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 910/1805] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:46 2022] PUT /identity/v3/projects/892ee3e1bf294642bb12ccc723243f87/users/b6d231c02b32440bbfac59631c895e39/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:32:46.284439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe88ff8-149d-46c7-b53d-bcc54828e5ab admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:46.334106 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e2b13-c4ca-49ee-8571-6da55943428d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:46.359207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe88ff8-149d-46c7-b53d-bcc54828e5ab admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:46.364680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f1b28-1340-466b-a8e1-34fa57bce3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:46.365113 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f1b28-1340-466b-a8e1-34fa57bce3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:46.365596 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f1b28-1340-466b-a8e1-34fa57bce3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:46.366065 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f1b28-1340-466b-a8e1-34fa57bce3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:46.367275 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f1b28-1340-466b-a8e1-34fa57bce3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:46.369006 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f1b28-1340-466b-a8e1-34fa57bce3d3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:46.380736 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 911/1806] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:46.386631 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f1b28-1340-466b-a8e1-34fa57bce3d3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:46.402410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f1b28-1340-466b-a8e1-34fa57bce3d3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:46.409963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38347919-1ff2-475d-8cf6-4604dd88013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:46.410883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38347919-1ff2-475d-8cf6-4604dd88013d admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:46.411321 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38347919-1ff2-475d-8cf6-4604dd88013d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:46.413846 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38347919-1ff2-475d-8cf6-4604dd88013d admin admin] PATH_INFO: `/v3/projects/892ee3e1bf294642bb12ccc723243f87/users/b6d231c02b32440bbfac59631c895e39/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:46.413955 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e88026-ad4a-4b3e-8324-4368ab32d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:46.413955 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e88026-ad4a-4b3e-8324-4368ab32d095 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:46.413955 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e88026-ad4a-4b3e-8324-4368ab32d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:46.413955 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e88026-ad4a-4b3e-8324-4368ab32d095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:46.414631 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38347919-1ff2-475d-8cf6-4604dd88013d admin admin] RBAC: Authorizing `identity:create_grant(project_id=892ee3e1bf294642bb12ccc723243f87, user_id=b6d231c02b32440bbfac59631c895e39, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:46.414938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e88026-ad4a-4b3e-8324-4368ab32d095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:46.416876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e88026-ad4a-4b3e-8324-4368ab32d095 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:46.418086 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38347919-1ff2-475d-8cf6-4604dd88013d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:46.429787 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 896/1807] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:46.433416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e88026-ad4a-4b3e-8324-4368ab32d095 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:46.441680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 912/1808] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:46 2022] PUT /identity/v3/projects/892ee3e1bf294642bb12ccc723243f87/users/b6d231c02b32440bbfac59631c895e39/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:46.448743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e88026-ad4a-4b3e-8324-4368ab32d095 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:46.457856 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed22a7-1392-42e3-bd43-023675bd4bf2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:46.458366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed22a7-1392-42e3-bd43-023675bd4bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:46.458819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed22a7-1392-42e3-bd43-023675bd4bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:46.487941 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1bed22a7-1392-42e3-bd43-023675bd4bf2 None None] MFA Rules not processed for user `b6d231c02b32440bbfac59631c895e39`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:46.489572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1bed22a7-1392-42e3-bd43-023675bd4bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:46.507031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e698f4-a7d4-4270-89d6-4a1ab9561bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:46.508430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e698f4-a7d4-4270-89d6-4a1ab9561bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:46.508768 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e698f4-a7d4-4270-89d6-4a1ab9561bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:46.509111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e698f4-a7d4-4270-89d6-4a1ab9561bd8 admin admin] PATH_INFO: `/v3/projects/b720b4665ed847da8ead27374a50ad22/users/f4ce37ffbfd0456cbe1fa52bc899a549/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:46.511146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e698f4-a7d4-4270-89d6-4a1ab9561bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b720b4665ed847da8ead27374a50ad22, user_id=f4ce37ffbfd0456cbe1fa52bc899a549, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:46.513875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e698f4-a7d4-4270-89d6-4a1ab9561bd8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:46.525881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 897/1809] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:46 2022] PUT /identity/v3/projects/b720b4665ed847da8ead27374a50ad22/users/f4ce37ffbfd0456cbe1fa52bc899a549/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:46.537139 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6041b2-7216-4465-865d-c5127ebeb9ba None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:46.537420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6041b2-7216-4465-865d-c5127ebeb9ba None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:46.537699 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6041b2-7216-4465-865d-c5127ebeb9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:46.575979 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2e6041b2-7216-4465-865d-c5127ebeb9ba None None] MFA Rules not processed for user `f4ce37ffbfd0456cbe1fa52bc899a549`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:46.580795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2e6041b2-7216-4465-865d-c5127ebeb9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:46.592572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 913/1810] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:32:46.611092 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed22a7-1392-42e3-bd43-023675bd4bf2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:46.615290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1bed22a7-1392-42e3-bd43-023675bd4bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:46.684036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 898/1811] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:32:46.692632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed22a7-1392-42e3-bd43-023675bd4bf2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:46.699746 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6041b2-7216-4465-865d-c5127ebeb9ba None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:46.705385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2e6041b2-7216-4465-865d-c5127ebeb9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:46.768703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4e088-9446-456c-a42d-65406fc0a95a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:46.769322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4e088-9446-456c-a42d-65406fc0a95a service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:46.769601 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4e088-9446-456c-a42d-65406fc0a95a service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:46.769923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4e088-9446-456c-a42d-65406fc0a95a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:46.801929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6041b2-7216-4465-865d-c5127ebeb9ba None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:46.807023 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc60dac-44b1-4d2a-bf61-43026c3ffc34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:46.808032 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc60dac-44b1-4d2a-bf61-43026c3ffc34 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:46.808568 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc60dac-44b1-4d2a-bf61-43026c3ffc34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:46.811060 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc60dac-44b1-4d2a-bf61-43026c3ffc34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:46.853969 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4e088-9446-456c-a42d-65406fc0a95a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:46.853969 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4e088-9446-456c-a42d-65406fc0a95a service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:46.863855 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 914/1812] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:32:46.894380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc60dac-44b1-4d2a-bf61-43026c3ffc34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:46.900355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc60dac-44b1-4d2a-bf61-43026c3ffc34 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:46.906646 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 899/1813] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:46.977682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4e088-9446-456c-a42d-65406fc0a95a service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:46.986226 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4e088-9446-456c-a42d-65406fc0a95a service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:46.991643 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081d3e0-1928-4bf0-9676-24e42bb235c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:46.992320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081d3e0-1928-4bf0-9676-24e42bb235c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:46.992603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081d3e0-1928-4bf0-9676-24e42bb235c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:46.992930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081d3e0-1928-4bf0-9676-24e42bb235c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:47.059615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081d3e0-1928-4bf0-9676-24e42bb235c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:47.061068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081d3e0-1928-4bf0-9676-24e42bb235c2 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:47.071930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 915/1814] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:47.798820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:49.961461 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc60dac-44b1-4d2a-bf61-43026c3ffc34 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:49.970760 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc60dac-44b1-4d2a-bf61-43026c3ffc34 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:49.974371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb98265-cc32-446c-8f36-1fd4f426d2f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:49.975336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb98265-cc32-446c-8f36-1fd4f426d2f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:49.975336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb98265-cc32-446c-8f36-1fd4f426d2f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:49.975600 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb98265-cc32-446c-8f36-1fd4f426d2f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:49.984875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb98265-cc32-446c-8f36-1fd4f426d2f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:49.986400 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb98265-cc32-446c-8f36-1fd4f426d2f5 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:49.996361 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 900/1815] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:50.270938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcf74c-750b-4772-8213-c71a4b54d282 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:50.271491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcf74c-750b-4772-8213-c71a4b54d282 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:50.271491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcf74c-750b-4772-8213-c71a4b54d282 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:50.273259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 916/1816] 10.222.0.82 () {54 vars in 921 bytes} [Fri Sep 23 15:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:32:50.295095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e996-1c5d-4277-84ab-541d3013bc68 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:50.295465 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e996-1c5d-4277-84ab-541d3013bc68 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:50.295810 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e996-1c5d-4277-84ab-541d3013bc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:50.318887 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6178e996-1c5d-4277-84ab-541d3013bc68 None None] MFA Rules not processed for user `6dbf682960cc447099c11862afa3206b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:50.323395 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6178e996-1c5d-4277-84ab-541d3013bc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:50.404504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 901/1817] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Sep 23 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:50.431052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcf74c-750b-4772-8213-c71a4b54d282 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:50.432654 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-57fcf74c-750b-4772-8213-c71a4b54d282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:50.455644 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcf74c-750b-4772-8213-c71a4b54d282 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:50.462627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e8004-9ba6-47b4-9452-b65283936370 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:50.464998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e8004-9ba6-47b4-9452-b65283936370 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:50.464998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e8004-9ba6-47b4-9452-b65283936370 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:50.464998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e8004-9ba6-47b4-9452-b65283936370 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:50.473856 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e8004-9ba6-47b4-9452-b65283936370 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:50.475466 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e8004-9ba6-47b4-9452-b65283936370 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:50.486785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 917/1818] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:50.530211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:53.084752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178e996-1c5d-4277-84ab-541d3013bc68 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:53.167999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178e996-1c5d-4277-84ab-541d3013bc68 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:53.175910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16c2ef-5525-4358-aeed-3e85c0366f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:53.176703 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16c2ef-5525-4358-aeed-3e85c0366f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:53.177026 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16c2ef-5525-4358-aeed-3e85c0366f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:53.177305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16c2ef-5525-4358-aeed-3e85c0366f35 admin admin] PATH_INFO: `/v3/users/f3ca079587df4a329bb6b0ab0be3678f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:53.178914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16c2ef-5525-4358-aeed-3e85c0366f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ca079587df4a329bb6b0ab0be3678f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:53.183636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16c2ef-5525-4358-aeed-3e85c0366f35 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:53.351845 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:53.502800 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fc16c2ef-5525-4358-aeed-3e85c0366f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ca079587df4a329bb6b0ab0be3678f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:53.530877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fc16c2ef-5525-4358-aeed-3e85c0366f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ca079587df4a329bb6b0ab0be3678f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:53.539871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fc16c2ef-5525-4358-aeed-3e85c0366f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ca079587df4a329bb6b0ab0be3678f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:53.540961 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fc16c2ef-5525-4358-aeed-3e85c0366f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ca079587df4a329bb6b0ab0be3678f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:53.704179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fc16c2ef-5525-4358-aeed-3e85c0366f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ca079587df4a329bb6b0ab0be3678f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:53.716240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 902/1819] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:53 2022] DELETE /identity/v3/users/f3ca079587df4a329bb6b0ab0be3678f => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:53.720968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c93af-5c45-470f-a50d-685b617e5f88 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:53.721428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c93af-5c45-470f-a50d-685b617e5f88 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:53.721528 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c93af-5c45-470f-a50d-685b617e5f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:53.740819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c74c93af-5c45-470f-a50d-685b617e5f88 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:53.744034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c74c93af-5c45-470f-a50d-685b617e5f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:53.802026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 918/1820] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:53.812275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16c2ef-5525-4358-aeed-3e85c0366f35 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:53.813812 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fc16c2ef-5525-4358-aeed-3e85c0366f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:53.871892 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16c2ef-5525-4358-aeed-3e85c0366f35 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:53.876081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49916645-6b03-4ec5-a6c7-c758823d9343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:53.876654 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49916645-6b03-4ec5-a6c7-c758823d9343 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:53.876959 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49916645-6b03-4ec5-a6c7-c758823d9343 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:53.877225 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49916645-6b03-4ec5-a6c7-c758823d9343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:53.887104 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49916645-6b03-4ec5-a6c7-c758823d9343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:53.888535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49916645-6b03-4ec5-a6c7-c758823d9343 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:53.898146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 903/1821] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:54.475299 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c93af-5c45-470f-a50d-685b617e5f88 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:54.477532 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c74c93af-5c45-470f-a50d-685b617e5f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:54.494034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c93af-5c45-470f-a50d-685b617e5f88 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:54.530531 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:54.531410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:54.535614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:54.536064 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a admin admin] PATH_INFO: `/v3/projects/4fa53746a8af49e5ac69473e7cbdaa40` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:54.539276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fa53746a8af49e5ac69473e7cbdaa40)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:54.542325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:54.755234 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fa53746a8af49e5ac69473e7cbdaa40', 'request_id': 'req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:54.883760 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fa53746a8af49e5ac69473e7cbdaa40', 'request_id': 'req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:54.891738 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fa53746a8af49e5ac69473e7cbdaa40', 'request_id': 'req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:54.903491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a admin admin] The token cache is being invalidate because project 4fa53746a8af49e5ac69473e7cbdaa40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:32:54.903872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:54.904578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:54.906281 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 919/1822] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:54 2022] DELETE /identity/v3/projects/4fa53746a8af49e5ac69473e7cbdaa40 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:54.910294 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49916645-6b03-4ec5-a6c7-c758823d9343 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:54.921693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49916645-6b03-4ec5-a6c7-c758823d9343 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:54.979687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1866c9-2ba0-498f-9df2-b882e7b182e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:54.980348 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1866c9-2ba0-498f-9df2-b882e7b182e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:54.980625 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1866c9-2ba0-498f-9df2-b882e7b182e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:54.980893 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1866c9-2ba0-498f-9df2-b882e7b182e0 admin admin] PATH_INFO: `/v3/users/059f418343a348e1aeeec4d451814846` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:54.982055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1866c9-2ba0-498f-9df2-b882e7b182e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=059f418343a348e1aeeec4d451814846)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:54.984171 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1866c9-2ba0-498f-9df2-b882e7b182e0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:55.189232 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3b1866c9-2ba0-498f-9df2-b882e7b182e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059f418343a348e1aeeec4d451814846'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:55.201140 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3b1866c9-2ba0-498f-9df2-b882e7b182e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059f418343a348e1aeeec4d451814846'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:55.208043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3b1866c9-2ba0-498f-9df2-b882e7b182e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059f418343a348e1aeeec4d451814846'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:55.208747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3b1866c9-2ba0-498f-9df2-b882e7b182e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059f418343a348e1aeeec4d451814846'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:55.255107 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:55.289560 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3b1866c9-2ba0-498f-9df2-b882e7b182e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059f418343a348e1aeeec4d451814846'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:55.296031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 904/1823] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:54 2022] DELETE /identity/v3/users/059f418343a348e1aeeec4d451814846 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:56.122094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:56.132755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:56.159823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e9b11-b9d3-467b-8f45-2b9f3edbbf5a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:56.177529 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1866c9-2ba0-498f-9df2-b882e7b182e0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:56.179257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3b1866c9-2ba0-498f-9df2-b882e7b182e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:56.233015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b0247-f8fd-429b-9e14-e7ed14e037f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:56.233662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b0247-f8fd-429b-9e14-e7ed14e037f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:56.233969 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b0247-f8fd-429b-9e14-e7ed14e037f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:56.234240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b0247-f8fd-429b-9e14-e7ed14e037f2 admin admin] PATH_INFO: `/v3/users/31b22f32c54f4f039c1cfec9f8888960` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:56.235427 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b0247-f8fd-429b-9e14-e7ed14e037f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b22f32c54f4f039c1cfec9f8888960)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:56.238157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b0247-f8fd-429b-9e14-e7ed14e037f2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:56.252459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1866c9-2ba0-498f-9df2-b882e7b182e0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:56.258181 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:56.259399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:56.260102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:56.260472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f admin admin] PATH_INFO: `/v3/projects/03a0aa17f06342e0a7ecc7563d3780b4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:56.262100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a0aa17f06342e0a7ecc7563d3780b4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:56.264377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:56.294933 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:56.414540 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6a4b0247-f8fd-429b-9e14-e7ed14e037f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b22f32c54f4f039c1cfec9f8888960'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:56.414952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a0aa17f06342e0a7ecc7563d3780b4', 'request_id': 'req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:56.426610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6a4b0247-f8fd-429b-9e14-e7ed14e037f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b22f32c54f4f039c1cfec9f8888960'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:56.433613 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6a4b0247-f8fd-429b-9e14-e7ed14e037f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b22f32c54f4f039c1cfec9f8888960'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:56.434377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6a4b0247-f8fd-429b-9e14-e7ed14e037f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b22f32c54f4f039c1cfec9f8888960'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:56.488360 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a0aa17f06342e0a7ecc7563d3780b4', 'request_id': 'req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:56.494379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a0aa17f06342e0a7ecc7563d3780b4', 'request_id': 'req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:56.505907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f admin admin] The token cache is being invalidate because project 03a0aa17f06342e0a7ecc7563d3780b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:32:56.506202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:56.507344 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:56.508839 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 905/1824] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:56 2022] DELETE /identity/v3/projects/03a0aa17f06342e0a7ecc7563d3780b4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:32:56.509710 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:56.511053 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:56.562960 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6a4b0247-f8fd-429b-9e14-e7ed14e037f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b22f32c54f4f039c1cfec9f8888960'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:56.570013 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 920/1825] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:56 2022] DELETE /identity/v3/users/31b22f32c54f4f039c1cfec9f8888960 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:56.570980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b0247-f8fd-429b-9e14-e7ed14e037f2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:56.572316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6a4b0247-f8fd-429b-9e14-e7ed14e037f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:56.576033 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda2807-4fe9-4782-8b77-d3fd00a48b9f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:56.633590 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dd0ee-b688-47ad-bbe3-c39616f0f618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:56.634353 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dd0ee-b688-47ad-bbe3-c39616f0f618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:56.634637 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dd0ee-b688-47ad-bbe3-c39616f0f618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:56.634907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dd0ee-b688-47ad-bbe3-c39616f0f618 admin admin] PATH_INFO: `/v3/users/aafa846d0f7c48bc9d71d46f42b39600` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:56.636424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dd0ee-b688-47ad-bbe3-c39616f0f618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aafa846d0f7c48bc9d71d46f42b39600)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:56.638272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b0247-f8fd-429b-9e14-e7ed14e037f2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:56.638525 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dd0ee-b688-47ad-bbe3-c39616f0f618 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:56.643248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cb5a3-e528-43f8-954e-6e847440ab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:56.643952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cb5a3-e528-43f8-954e-6e847440ab8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:56.644391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cb5a3-e528-43f8-954e-6e847440ab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:56.644675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cb5a3-e528-43f8-954e-6e847440ab8d admin admin] PATH_INFO: `/v3/users/b6d231c02b32440bbfac59631c895e39` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:56.646041 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cb5a3-e528-43f8-954e-6e847440ab8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d231c02b32440bbfac59631c895e39)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:56.648912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cb5a3-e528-43f8-954e-6e847440ab8d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:56.860889 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-243dd0ee-b688-47ad-bbe3-c39616f0f618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aafa846d0f7c48bc9d71d46f42b39600'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:56.873234 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-243dd0ee-b688-47ad-bbe3-c39616f0f618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aafa846d0f7c48bc9d71d46f42b39600'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:56.880472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-243dd0ee-b688-47ad-bbe3-c39616f0f618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aafa846d0f7c48bc9d71d46f42b39600'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:56.881181 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-243dd0ee-b688-47ad-bbe3-c39616f0f618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aafa846d0f7c48bc9d71d46f42b39600'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:56.975772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9f8cb5a3-e528-43f8-954e-6e847440ab8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d231c02b32440bbfac59631c895e39'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:56.994895 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9f8cb5a3-e528-43f8-954e-6e847440ab8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d231c02b32440bbfac59631c895e39'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:57.004263 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9f8cb5a3-e528-43f8-954e-6e847440ab8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d231c02b32440bbfac59631c895e39'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:57.005462 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9f8cb5a3-e528-43f8-954e-6e847440ab8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d231c02b32440bbfac59631c895e39'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:57.010278 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-243dd0ee-b688-47ad-bbe3-c39616f0f618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aafa846d0f7c48bc9d71d46f42b39600'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:57.015079 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 906/1826] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:56 2022] DELETE /identity/v3/users/aafa846d0f7c48bc9d71d46f42b39600 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:57.016513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f7f36-bc98-4f42-bc6f-8da4722b1a3f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:57.016891 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f7f36-bc98-4f42-bc6f-8da4722b1a3f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:57.017260 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f7f36-bc98-4f42-bc6f-8da4722b1a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:57.050385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-833f7f36-bc98-4f42-bc6f-8da4722b1a3f None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:57.052375 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-833f7f36-bc98-4f42-bc6f-8da4722b1a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:57.088601 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9f8cb5a3-e528-43f8-954e-6e847440ab8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d231c02b32440bbfac59631c895e39'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:57.096959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 921/1827] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:56 2022] DELETE /identity/v3/users/b6d231c02b32440bbfac59631c895e39 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:57.099105 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919b7f4-1cef-4726-be3a-5490a0bfeed1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:57.099857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919b7f4-1cef-4726-be3a-5490a0bfeed1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:57.100995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919b7f4-1cef-4726-be3a-5490a0bfeed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:57.139356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 907/1828] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:57.143566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7919b7f4-1cef-4726-be3a-5490a0bfeed1 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:57.144841 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7919b7f4-1cef-4726-be3a-5490a0bfeed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:57.159390 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f7f36-bc98-4f42-bc6f-8da4722b1a3f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:57.160929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-833f7f36-bc98-4f42-bc6f-8da4722b1a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:57.282916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 922/1829] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:57.286808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f7f36-bc98-4f42-bc6f-8da4722b1a3f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:57.301585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919b7f4-1cef-4726-be3a-5490a0bfeed1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:57.364113 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:57.376945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34d325-ad1a-43a2-8398-0f0e464698de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:57.378737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34d325-ad1a-43a2-8398-0f0e464698de service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:57.379021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34d325-ad1a-43a2-8398-0f0e464698de service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:57.379300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34d325-ad1a-43a2-8398-0f0e464698de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:57.406581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34d325-ad1a-43a2-8398-0f0e464698de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:57.409029 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34d325-ad1a-43a2-8398-0f0e464698de service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:57.422185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 908/1830] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:57.474363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919b7f4-1cef-4726-be3a-5490a0bfeed1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:57.482024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45411bf-f461-4f2d-b38f-8cb43f62b437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:57.483300 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45411bf-f461-4f2d-b38f-8cb43f62b437 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:57.483906 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45411bf-f461-4f2d-b38f-8cb43f62b437 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:57.484190 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45411bf-f461-4f2d-b38f-8cb43f62b437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:57.498724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45411bf-f461-4f2d-b38f-8cb43f62b437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:57.500264 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45411bf-f461-4f2d-b38f-8cb43f62b437 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:57.517381 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 923/1831] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:32:57.892546 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34d325-ad1a-43a2-8398-0f0e464698de service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:57.894313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9b34d325-ad1a-43a2-8398-0f0e464698de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:57.909504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34d325-ad1a-43a2-8398-0f0e464698de service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:57.916155 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d94cb1-b818-4aa2-a232-b6402398962a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:57.916952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94cb1-b818-4aa2-a232-b6402398962a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:57.917308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94cb1-b818-4aa2-a232-b6402398962a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:57.917727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94cb1-b818-4aa2-a232-b6402398962a admin admin] PATH_INFO: `/v3/projects/892ee3e1bf294642bb12ccc723243f87` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:57.919051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d94cb1-b818-4aa2-a232-b6402398962a admin admin] RBAC: Authorizing `identity:delete_project(project_id=892ee3e1bf294642bb12ccc723243f87)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:57.921432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d94cb1-b818-4aa2-a232-b6402398962a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:58.054994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-15d94cb1-b818-4aa2-a232-b6402398962a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '892ee3e1bf294642bb12ccc723243f87', 'request_id': 'req-15d94cb1-b818-4aa2-a232-b6402398962a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.137907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45411bf-f461-4f2d-b38f-8cb43f62b437 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:58.138942 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b45411bf-f461-4f2d-b38f-8cb43f62b437 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:58.154406 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45411bf-f461-4f2d-b38f-8cb43f62b437 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:58.158456 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-15d94cb1-b818-4aa2-a232-b6402398962a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '892ee3e1bf294642bb12ccc723243f87', 'request_id': 'req-15d94cb1-b818-4aa2-a232-b6402398962a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.183109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-15d94cb1-b818-4aa2-a232-b6402398962a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '892ee3e1bf294642bb12ccc723243f87', 'request_id': 'req-15d94cb1-b818-4aa2-a232-b6402398962a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.209230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-15d94cb1-b818-4aa2-a232-b6402398962a admin admin] The token cache is being invalidate because project 892ee3e1bf294642bb12ccc723243f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:32:58.209598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-15d94cb1-b818-4aa2-a232-b6402398962a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.211486 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-15d94cb1-b818-4aa2-a232-b6402398962a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.221025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 909/1832] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:57 2022] DELETE /identity/v3/projects/892ee3e1bf294642bb12ccc723243f87 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:58.222434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d94cb1-b818-4aa2-a232-b6402398962a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:58.225470 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-15d94cb1-b818-4aa2-a232-b6402398962a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:58.262339 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287116c-0b97-41c7-8ee5-c723f6463385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:58.263062 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287116c-0b97-41c7-8ee5-c723f6463385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:58.263567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287116c-0b97-41c7-8ee5-c723f6463385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:58.263955 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287116c-0b97-41c7-8ee5-c723f6463385 admin admin] PATH_INFO: `/v3/projects/a299b105df8b49ceaea02363db0c7b27` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:58.265248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287116c-0b97-41c7-8ee5-c723f6463385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a299b105df8b49ceaea02363db0c7b27)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:58.267391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287116c-0b97-41c7-8ee5-c723f6463385 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:58.304568 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:58.308075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d94cb1-b818-4aa2-a232-b6402398962a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:58.312973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1813b-00ef-4325-8c34-d40f2e471939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:58.313677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1813b-00ef-4325-8c34-d40f2e471939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:58.313990 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1813b-00ef-4325-8c34-d40f2e471939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:58.314265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1813b-00ef-4325-8c34-d40f2e471939 admin admin] PATH_INFO: `/v3/projects/d10b1ba101ca467c8ad052e422b9b548` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:58.315424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1813b-00ef-4325-8c34-d40f2e471939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d10b1ba101ca467c8ad052e422b9b548)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:58.317930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1813b-00ef-4325-8c34-d40f2e471939 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:58.431766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e287116c-0b97-41c7-8ee5-c723f6463385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a299b105df8b49ceaea02363db0c7b27', 'request_id': 'req-e287116c-0b97-41c7-8ee5-c723f6463385'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.470777 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0ad1813b-00ef-4325-8c34-d40f2e471939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd10b1ba101ca467c8ad052e422b9b548', 'request_id': 'req-0ad1813b-00ef-4325-8c34-d40f2e471939'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.518067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e287116c-0b97-41c7-8ee5-c723f6463385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a299b105df8b49ceaea02363db0c7b27', 'request_id': 'req-e287116c-0b97-41c7-8ee5-c723f6463385'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.524759 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e287116c-0b97-41c7-8ee5-c723f6463385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a299b105df8b49ceaea02363db0c7b27', 'request_id': 'req-e287116c-0b97-41c7-8ee5-c723f6463385'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.535385 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e287116c-0b97-41c7-8ee5-c723f6463385 admin admin] The token cache is being invalidate because project a299b105df8b49ceaea02363db0c7b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:32:58.537268 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e287116c-0b97-41c7-8ee5-c723f6463385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.537268 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e287116c-0b97-41c7-8ee5-c723f6463385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.538583 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 924/1833] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:58 2022] DELETE /identity/v3/projects/a299b105df8b49ceaea02363db0c7b27 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:58.542580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d035ba-cbb0-4a00-a51d-f498013a063e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:58.542864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d035ba-cbb0-4a00-a51d-f498013a063e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:58.543141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d035ba-cbb0-4a00-a51d-f498013a063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:58.563397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d9d035ba-cbb0-4a00-a51d-f498013a063e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:58.564608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d9d035ba-cbb0-4a00-a51d-f498013a063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:58.603178 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0ad1813b-00ef-4325-8c34-d40f2e471939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd10b1ba101ca467c8ad052e422b9b548', 'request_id': 'req-0ad1813b-00ef-4325-8c34-d40f2e471939'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.614000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0ad1813b-00ef-4325-8c34-d40f2e471939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd10b1ba101ca467c8ad052e422b9b548', 'request_id': 'req-0ad1813b-00ef-4325-8c34-d40f2e471939'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.633349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0ad1813b-00ef-4325-8c34-d40f2e471939 admin admin] The token cache is being invalidate because project d10b1ba101ca467c8ad052e422b9b548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:32:58.633538 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0ad1813b-00ef-4325-8c34-d40f2e471939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.634109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0ad1813b-00ef-4325-8c34-d40f2e471939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.645290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 910/1834] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:58 2022] DELETE /identity/v3/projects/d10b1ba101ca467c8ad052e422b9b548 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:58.645560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 925/1835] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:58.653385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1813b-00ef-4325-8c34-d40f2e471939 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:58.654701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d035ba-cbb0-4a00-a51d-f498013a063e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:58.655233 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0ad1813b-00ef-4325-8c34-d40f2e471939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:58.657123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d9d035ba-cbb0-4a00-a51d-f498013a063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:58.669462 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1813b-00ef-4325-8c34-d40f2e471939 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:58.670418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d035ba-cbb0-4a00-a51d-f498013a063e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:58.674355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a798f-bbea-4e0d-9ae8-65b75ccd74e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:58.675037 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a798f-bbea-4e0d-9ae8-65b75ccd74e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:58.680591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a798f-bbea-4e0d-9ae8-65b75ccd74e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:58.680729 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bace808-1fbb-4b5e-aa56-c6bd4b5b4d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:58.680837 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a798f-bbea-4e0d-9ae8-65b75ccd74e5 admin admin] PATH_INFO: `/v3/users/f4ce37ffbfd0456cbe1fa52bc899a549` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:58.680923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bace808-1fbb-4b5e-aa56-c6bd4b5b4d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:58.680923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bace808-1fbb-4b5e-aa56-c6bd4b5b4d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:58.681080 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a798f-bbea-4e0d-9ae8-65b75ccd74e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4ce37ffbfd0456cbe1fa52bc899a549)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:58.681162 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bace808-1fbb-4b5e-aa56-c6bd4b5b4d63 admin admin] PATH_INFO: `/v3/users/e03ee8bc96324e65b5dfeb39ab0d6536` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:58.681162 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bace808-1fbb-4b5e-aa56-c6bd4b5b4d63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e03ee8bc96324e65b5dfeb39ab0d6536)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:58.681334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a798f-bbea-4e0d-9ae8-65b75ccd74e5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:58.681415 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bace808-1fbb-4b5e-aa56-c6bd4b5b4d63 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:58.874204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2bace808-1fbb-4b5e-aa56-c6bd4b5b4d63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e03ee8bc96324e65b5dfeb39ab0d6536'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.886656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2bace808-1fbb-4b5e-aa56-c6bd4b5b4d63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e03ee8bc96324e65b5dfeb39ab0d6536'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.893404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2bace808-1fbb-4b5e-aa56-c6bd4b5b4d63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e03ee8bc96324e65b5dfeb39ab0d6536'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.894123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2bace808-1fbb-4b5e-aa56-c6bd4b5b4d63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e03ee8bc96324e65b5dfeb39ab0d6536'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.981066 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-611a798f-bbea-4e0d-9ae8-65b75ccd74e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4ce37ffbfd0456cbe1fa52bc899a549'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.985844 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2bace808-1fbb-4b5e-aa56-c6bd4b5b4d63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e03ee8bc96324e65b5dfeb39ab0d6536'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:58.996545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-611a798f-bbea-4e0d-9ae8-65b75ccd74e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4ce37ffbfd0456cbe1fa52bc899a549'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:59.003459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-611a798f-bbea-4e0d-9ae8-65b75ccd74e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4ce37ffbfd0456cbe1fa52bc899a549'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:59.004219 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-611a798f-bbea-4e0d-9ae8-65b75ccd74e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4ce37ffbfd0456cbe1fa52bc899a549'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:59.005239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 926/1836] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:58 2022] DELETE /identity/v3/users/e03ee8bc96324e65b5dfeb39ab0d6536 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:59.009018 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbf0e9-d425-4148-aa72-a7772edc493b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:59.009018 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbf0e9-d425-4148-aa72-a7772edc493b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:59.009018 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbf0e9-d425-4148-aa72-a7772edc493b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:59.036712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-48cbf0e9-d425-4148-aa72-a7772edc493b None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:32:59.038031 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-48cbf0e9-d425-4148-aa72-a7772edc493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:59.105510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 927/1837] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:32:59.109807 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbf0e9-d425-4148-aa72-a7772edc493b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:59.120056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbf0e9-d425-4148-aa72-a7772edc493b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:59.122682 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-611a798f-bbea-4e0d-9ae8-65b75ccd74e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4ce37ffbfd0456cbe1fa52bc899a549'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:32:59.125368 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ee978-11a7-4e2e-9857-22e126140642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:59.125917 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ee978-11a7-4e2e-9857-22e126140642 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:59.126202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ee978-11a7-4e2e-9857-22e126140642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:59.126614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ee978-11a7-4e2e-9857-22e126140642 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:59.127271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ee978-11a7-4e2e-9857-22e126140642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:32:59.127557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ee978-11a7-4e2e-9857-22e126140642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:59.129193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ee978-11a7-4e2e-9857-22e126140642 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:59.133487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 911/1838] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:32:58 2022] DELETE /identity/v3/users/f4ce37ffbfd0456cbe1fa52bc899a549 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:59.145917 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 928/1839] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:32:59.148186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a798f-bbea-4e0d-9ae8-65b75ccd74e5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:59.241708 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a798f-bbea-4e0d-9ae8-65b75ccd74e5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:59.247536 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ed57a-97a0-40f7-b7aa-c356b4b759b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:59.247536 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ed57a-97a0-40f7-b7aa-c356b4b759b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:59.247536 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ed57a-97a0-40f7-b7aa-c356b4b759b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:59.247536 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ed57a-97a0-40f7-b7aa-c356b4b759b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:59.248230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ed57a-97a0-40f7-b7aa-c356b4b759b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:59.250160 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ed57a-97a0-40f7-b7aa-c356b4b759b2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:59.430097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 912/1840] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:32:59 2022] POST /identity/v3/projects => generated 385 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:32:59.433711 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ee978-11a7-4e2e-9857-22e126140642 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:59.454011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ee978-11a7-4e2e-9857-22e126140642 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:59.529298 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd797685-e48f-45d8-a830-216278253e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:59.530155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd797685-e48f-45d8-a830-216278253e50 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:59.530497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd797685-e48f-45d8-a830-216278253e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:59.530839 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd797685-e48f-45d8-a830-216278253e50 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:59.531727 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd797685-e48f-45d8-a830-216278253e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:59.533965 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd797685-e48f-45d8-a830-216278253e50 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:59.646582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 929/1841] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:32:59 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:32:59.648082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ed57a-97a0-40f7-b7aa-c356b4b759b2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:59.659376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ed57a-97a0-40f7-b7aa-c356b4b759b2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:59.665241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf1de8-84d5-4ad3-8c72-6f46e61f3b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:59.665550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf1de8-84d5-4ad3-8c72-6f46e61f3b08 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:59.665929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf1de8-84d5-4ad3-8c72-6f46e61f3b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:59.666268 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf1de8-84d5-4ad3-8c72-6f46e61f3b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:59.666981 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf1de8-84d5-4ad3-8c72-6f46e61f3b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:59.668636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf1de8-84d5-4ad3-8c72-6f46e61f3b08 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:59.680569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 913/1842] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:59.689646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd797685-e48f-45d8-a830-216278253e50 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:59.699706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd797685-e48f-45d8-a830-216278253e50 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:59.704385 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c840c5c-1253-436e-9ad4-fea3fae2406e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:59.704977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c840c5c-1253-436e-9ad4-fea3fae2406e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:59.705255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c840c5c-1253-436e-9ad4-fea3fae2406e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:59.705530 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c840c5c-1253-436e-9ad4-fea3fae2406e admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:59.706208 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c840c5c-1253-436e-9ad4-fea3fae2406e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:59.707810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c840c5c-1253-436e-9ad4-fea3fae2406e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:59.722238 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 930/1843] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:32:59.724337 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf1de8-84d5-4ad3-8c72-6f46e61f3b08 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:59.725224 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c840c5c-1253-436e-9ad4-fea3fae2406e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:59.726751 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6caf1de8-84d5-4ad3-8c72-6f46e61f3b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:59.740036 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c840c5c-1253-436e-9ad4-fea3fae2406e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:59.740144 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf1de8-84d5-4ad3-8c72-6f46e61f3b08 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:32:59.746076 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff90c4-5905-4224-aad9-e3215dfe7ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:59.746989 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff90c4-5905-4224-aad9-e3215dfe7ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:59.747227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff90c4-5905-4224-aad9-e3215dfe7ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:59.747596 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff90c4-5905-4224-aad9-e3215dfe7ccf admin admin] PATH_INFO: `/v3/projects/06a1bb9bf1864708847142af635aa22a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:59.748176 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a02af-13cb-4884-90e1-467e98316eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:32:59.749809 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff90c4-5905-4224-aad9-e3215dfe7ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a1bb9bf1864708847142af635aa22a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:59.749925 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a02af-13cb-4884-90e1-467e98316eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:32:59.751885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff90c4-5905-4224-aad9-e3215dfe7ccf admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:59.754065 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a02af-13cb-4884-90e1-467e98316eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:32:59.754870 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a02af-13cb-4884-90e1-467e98316eb2 admin admin] PATH_INFO: `/v3/projects/5f2276f332064d208836ccc889f66ee2/users/8ae3592c0bb9481a8fe4d00c6988b124/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:32:59.781854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a02af-13cb-4884-90e1-467e98316eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2276f332064d208836ccc889f66ee2, user_id=8ae3592c0bb9481a8fe4d00c6988b124, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:32:59.784840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a02af-13cb-4884-90e1-467e98316eb2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:32:59.945527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:32:59.953027 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 931/1844] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:32:59 2022] PUT /identity/v3/projects/5f2276f332064d208836ccc889f66ee2/users/8ae3592c0bb9481a8fe4d00c6988b124/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:32:59.953859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a02af-13cb-4884-90e1-467e98316eb2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:32:59.955424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-442a02af-13cb-4884-90e1-467e98316eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:32:59.978555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6cff90c4-5905-4224-aad9-e3215dfe7ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a1bb9bf1864708847142af635aa22a', 'request_id': 'req-6cff90c4-5905-4224-aad9-e3215dfe7ccf'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:00.029237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a02af-13cb-4884-90e1-467e98316eb2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:00.083796 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73026d-57bc-4864-97e3-ce28a3e42925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:00.084431 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73026d-57bc-4864-97e3-ce28a3e42925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:00.084794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73026d-57bc-4864-97e3-ce28a3e42925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:00.085603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73026d-57bc-4864-97e3-ce28a3e42925 admin admin] PATH_INFO: `/v3/projects/b720b4665ed847da8ead27374a50ad22` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:00.086726 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73026d-57bc-4864-97e3-ce28a3e42925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b720b4665ed847da8ead27374a50ad22)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:00.088656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73026d-57bc-4864-97e3-ce28a3e42925 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:00.098848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6cff90c4-5905-4224-aad9-e3215dfe7ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a1bb9bf1864708847142af635aa22a', 'request_id': 'req-6cff90c4-5905-4224-aad9-e3215dfe7ccf'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:00.107863 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6cff90c4-5905-4224-aad9-e3215dfe7ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a1bb9bf1864708847142af635aa22a', 'request_id': 'req-6cff90c4-5905-4224-aad9-e3215dfe7ccf'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:00.125335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6cff90c4-5905-4224-aad9-e3215dfe7ccf admin admin] The token cache is being invalidate because project 06a1bb9bf1864708847142af635aa22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:00.125694 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6cff90c4-5905-4224-aad9-e3215dfe7ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:00.126442 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6cff90c4-5905-4224-aad9-e3215dfe7ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:00.128106 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 914/1845] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:59 2022] DELETE /identity/v3/projects/06a1bb9bf1864708847142af635aa22a => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:00.129354 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50101c21-81e2-4365-a1e5-9836bb25c2d5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:00.129690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50101c21-81e2-4365-a1e5-9836bb25c2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:00.130078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50101c21-81e2-4365-a1e5-9836bb25c2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:00.164069 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-50101c21-81e2-4365-a1e5-9836bb25c2d5 None None] MFA Rules not processed for user `8ae3592c0bb9481a8fe4d00c6988b124`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:00.164069 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-50101c21-81e2-4365-a1e5-9836bb25c2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:00.229898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 915/1846] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:00.231403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad38a3-fbd0-4982-99b5-3fa053caea77 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:00.231830 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad38a3-fbd0-4982-99b5-3fa053caea77 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:00.232445 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad38a3-fbd0-4982-99b5-3fa053caea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:00.238589 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cd73026d-57bc-4864-97e3-ce28a3e42925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b720b4665ed847da8ead27374a50ad22', 'request_id': 'req-cd73026d-57bc-4864-97e3-ce28a3e42925'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:00.255609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d6ad38a3-fbd0-4982-99b5-3fa053caea77 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:00.257374 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d6ad38a3-fbd0-4982-99b5-3fa053caea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:00.316880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cd73026d-57bc-4864-97e3-ce28a3e42925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b720b4665ed847da8ead27374a50ad22', 'request_id': 'req-cd73026d-57bc-4864-97e3-ce28a3e42925'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:00.318476 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 916/1847] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:00.319620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad38a3-fbd0-4982-99b5-3fa053caea77 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:00.321456 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d6ad38a3-fbd0-4982-99b5-3fa053caea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:00.327259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cd73026d-57bc-4864-97e3-ce28a3e42925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b720b4665ed847da8ead27374a50ad22', 'request_id': 'req-cd73026d-57bc-4864-97e3-ce28a3e42925'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:00.343146 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cd73026d-57bc-4864-97e3-ce28a3e42925 admin admin] The token cache is being invalidate because project b720b4665ed847da8ead27374a50ad22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:00.343441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cd73026d-57bc-4864-97e3-ce28a3e42925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:00.344358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cd73026d-57bc-4864-97e3-ce28a3e42925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:00.346154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 932/1848] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:32:59 2022] DELETE /identity/v3/projects/b720b4665ed847da8ead27374a50ad22 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:00.348025 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc6346-2068-4364-990a-f20a46545858 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:00.348309 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc6346-2068-4364-990a-f20a46545858 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:00.348585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc6346-2068-4364-990a-f20a46545858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:00.383265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f5dc6346-2068-4364-990a-f20a46545858 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:00.384563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f5dc6346-2068-4364-990a-f20a46545858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:00.389477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad38a3-fbd0-4982-99b5-3fa053caea77 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:00.396601 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 933/1849] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:00.396779 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ea0f1-354e-41f8-a112-9c1df9bb1f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:00.396779 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ea0f1-354e-41f8-a112-9c1df9bb1f4b service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:00.396779 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ea0f1-354e-41f8-a112-9c1df9bb1f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:00.397041 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606221e-82fa-48af-9606-0885376f005e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:00.397137 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ea0f1-354e-41f8-a112-9c1df9bb1f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:00.397245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606221e-82fa-48af-9606-0885376f005e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:00.397245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606221e-82fa-48af-9606-0885376f005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:00.401606 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cd1ea0f1-354e-41f8-a112-9c1df9bb1f4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:00.435427 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4606221e-82fa-48af-9606-0885376f005e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:00.436568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4606221e-82fa-48af-9606-0885376f005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:00.452889 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 934/1850] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:00.452889 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606221e-82fa-48af-9606-0885376f005e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:00.458463 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606221e-82fa-48af-9606-0885376f005e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:00.465011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124e816-2e35-4847-903c-1da2c39167a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:00.465631 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e816-2e35-4847-903c-1da2c39167a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:00.465939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e816-2e35-4847-903c-1da2c39167a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:00.466214 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e816-2e35-4847-903c-1da2c39167a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:00.466855 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124e816-2e35-4847-903c-1da2c39167a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:33:00.467151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124e816-2e35-4847-903c-1da2c39167a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:00.468758 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124e816-2e35-4847-903c-1da2c39167a5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:00.486234 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 935/1851] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:33:00.488485 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02156e2f-bc9d-4d10-b6ee-8a15ef024fb4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:00.488485 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02156e2f-bc9d-4d10-b6ee-8a15ef024fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:00.488485 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02156e2f-bc9d-4d10-b6ee-8a15ef024fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:00.507931 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ea0f1-354e-41f8-a112-9c1df9bb1f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:00.515921 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ea0f1-354e-41f8-a112-9c1df9bb1f4b service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:00.516008 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-02156e2f-bc9d-4d10-b6ee-8a15ef024fb4 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:00.516008 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-02156e2f-bc9d-4d10-b6ee-8a15ef024fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:00.529123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 936/1852] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:00.529123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02156e2f-bc9d-4d10-b6ee-8a15ef024fb4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:00.536267 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 917/1853] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:00.537674 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ea0f1-354e-41f8-a112-9c1df9bb1f4b service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:00.541349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02156e2f-bc9d-4d10-b6ee-8a15ef024fb4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:00.550295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6b601-3aa0-4866-8ad4-c0502a6d9213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:00.550680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6b601-3aa0-4866-8ad4-c0502a6d9213 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:00.550932 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6b601-3aa0-4866-8ad4-c0502a6d9213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:00.551279 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6b601-3aa0-4866-8ad4-c0502a6d9213 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:00.552230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6b601-3aa0-4866-8ad4-c0502a6d9213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:00.554862 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6b601-3aa0-4866-8ad4-c0502a6d9213 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:00.579594 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ea0f1-354e-41f8-a112-9c1df9bb1f4b service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:00.589293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db3e48-89e9-4e62-a780-adeeda9ffd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:00.591406 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db3e48-89e9-4e62-a780-adeeda9ffd4c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:00.591406 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db3e48-89e9-4e62-a780-adeeda9ffd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:00.591406 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db3e48-89e9-4e62-a780-adeeda9ffd4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:00.591406 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db3e48-89e9-4e62-a780-adeeda9ffd4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:33:00.602543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db3e48-89e9-4e62-a780-adeeda9ffd4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:00.604270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db3e48-89e9-4e62-a780-adeeda9ffd4c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:00.622753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 918/1854] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:33:00.635066 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db3e48-89e9-4e62-a780-adeeda9ffd4c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:00.654737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db3e48-89e9-4e62-a780-adeeda9ffd4c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:00.678968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e619b-4314-4ccc-969d-eaf85bde0897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:00.678968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e619b-4314-4ccc-969d-eaf85bde0897 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:00.678968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e619b-4314-4ccc-969d-eaf85bde0897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:00.678968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e619b-4314-4ccc-969d-eaf85bde0897 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:00.679494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e619b-4314-4ccc-969d-eaf85bde0897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:00.681708 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e619b-4314-4ccc-969d-eaf85bde0897 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:00.721987 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 937/1855] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:00 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:00.726698 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6b601-3aa0-4866-8ad4-c0502a6d9213 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:00.830716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 919/1856] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:00 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:00.837011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e619b-4314-4ccc-969d-eaf85bde0897 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:00.847201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6b601-3aa0-4866-8ad4-c0502a6d9213 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:00.853903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:00.926684 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757511a-afc9-4716-aad3-870a4b9d4b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:00.927903 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757511a-afc9-4716-aad3-870a4b9d4b78 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:00.928185 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757511a-afc9-4716-aad3-870a4b9d4b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:00.929056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757511a-afc9-4716-aad3-870a4b9d4b78 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:00.929876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757511a-afc9-4716-aad3-870a4b9d4b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:00.931869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757511a-afc9-4716-aad3-870a4b9d4b78 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:00.941203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e619b-4314-4ccc-969d-eaf85bde0897 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:00.947008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e5477-5fe3-4935-86d5-e6d73c7b38e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:00.947717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e5477-5fe3-4935-86d5-e6d73c7b38e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:00.948065 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e5477-5fe3-4935-86d5-e6d73c7b38e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:00.948643 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e5477-5fe3-4935-86d5-e6d73c7b38e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:00.949376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e5477-5fe3-4935-86d5-e6d73c7b38e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:00.951503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e5477-5fe3-4935-86d5-e6d73c7b38e2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:01.127704 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 938/1857] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:00 2022] POST /identity/v3/users => generated 294 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:01.129204 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 920/1858] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:00 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:01.133035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e5477-5fe3-4935-86d5-e6d73c7b38e2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:01.134265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757511a-afc9-4716-aad3-870a4b9d4b78 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:01.145524 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757511a-afc9-4716-aad3-870a4b9d4b78 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:01.146446 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e5477-5fe3-4935-86d5-e6d73c7b38e2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:01.152757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a373e-5138-428e-ac87-b119291e2d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:01.152952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28d09b-5c3c-47e2-b465-261f5461c13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:01.153123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a373e-5138-428e-ac87-b119291e2d25 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:01.153123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a373e-5138-428e-ac87-b119291e2d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:01.153368 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28d09b-5c3c-47e2-b465-261f5461c13d admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:01.153493 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a373e-5138-428e-ac87-b119291e2d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:01.153650 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28d09b-5c3c-47e2-b465-261f5461c13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:01.154025 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28d09b-5c3c-47e2-b465-261f5461c13d admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:01.154181 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a373e-5138-428e-ac87-b119291e2d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:01.154747 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28d09b-5c3c-47e2-b465-261f5461c13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:01.155630 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a373e-5138-428e-ac87-b119291e2d25 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:01.156563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28d09b-5c3c-47e2-b465-261f5461c13d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:01.168349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 921/1859] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:01.172679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a373e-5138-428e-ac87-b119291e2d25 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:01.173138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 939/1860] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:01.177611 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28d09b-5c3c-47e2-b465-261f5461c13d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:01.186102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a373e-5138-428e-ac87-b119291e2d25 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:01.191695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30742c2b-b73f-4049-bb8b-b61d76b8a241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:01.192308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30742c2b-b73f-4049-bb8b-b61d76b8a241 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:01.192639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30742c2b-b73f-4049-bb8b-b61d76b8a241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:01.193176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30742c2b-b73f-4049-bb8b-b61d76b8a241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:01.193982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30742c2b-b73f-4049-bb8b-b61d76b8a241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:01.194773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28d09b-5c3c-47e2-b465-261f5461c13d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:01.195706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30742c2b-b73f-4049-bb8b-b61d76b8a241 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:01.202370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d658f8a-b69a-4352-a72f-c2328e0e6060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:01.203313 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d658f8a-b69a-4352-a72f-c2328e0e6060 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:01.203765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d658f8a-b69a-4352-a72f-c2328e0e6060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:01.204207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d658f8a-b69a-4352-a72f-c2328e0e6060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:01.205226 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d658f8a-b69a-4352-a72f-c2328e0e6060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:01.208137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d658f8a-b69a-4352-a72f-c2328e0e6060 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:01.215040 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 922/1861] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:01.216167 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30742c2b-b73f-4049-bb8b-b61d76b8a241 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:01.227823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30742c2b-b73f-4049-bb8b-b61d76b8a241 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:01.231866 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 940/1862] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:01.232792 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d658f8a-b69a-4352-a72f-c2328e0e6060 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:01.236193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779cef6-9eb4-4181-98e6-f6bd18482522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:01.236926 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779cef6-9eb4-4181-98e6-f6bd18482522 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:01.237207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779cef6-9eb4-4181-98e6-f6bd18482522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:01.237476 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779cef6-9eb4-4181-98e6-f6bd18482522 admin admin] PATH_INFO: `/v3/projects/5fd17ef226804d65afd01061a9fa80d4/users/5fb501c6417d4a1192c679392c2f40d7/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:01.243616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d658f8a-b69a-4352-a72f-c2328e0e6060 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:01.249205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af75c0a-975c-4a50-9582-717c0826c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:01.249991 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af75c0a-975c-4a50-9582-717c0826c498 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:01.250273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af75c0a-975c-4a50-9582-717c0826c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:01.250553 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af75c0a-975c-4a50-9582-717c0826c498 admin admin] PATH_INFO: `/v3/projects/23f3d125a3094e4a891988c93f284609/users/cd628d464c3a48109351ef43f506c049/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:01.265271 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779cef6-9eb4-4181-98e6-f6bd18482522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd17ef226804d65afd01061a9fa80d4, user_id=5fb501c6417d4a1192c679392c2f40d7, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:01.268997 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779cef6-9eb4-4181-98e6-f6bd18482522 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:01.270125 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af75c0a-975c-4a50-9582-717c0826c498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f3d125a3094e4a891988c93f284609, user_id=cd628d464c3a48109351ef43f506c049, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:01.275342 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af75c0a-975c-4a50-9582-717c0826c498 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:01.386893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 941/1863] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:01 2022] PUT /identity/v3/projects/23f3d125a3094e4a891988c93f284609/users/cd628d464c3a48109351ef43f506c049/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:01.398020 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 923/1864] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:01 2022] PUT /identity/v3/projects/5fd17ef226804d65afd01061a9fa80d4/users/5fb501c6417d4a1192c679392c2f40d7/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:01.411017 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360bcae-84b6-4792-b2bc-fc6c7ad7ab1c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:01.411345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360bcae-84b6-4792-b2bc-fc6c7ad7ab1c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:01.411585 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360bcae-84b6-4792-b2bc-fc6c7ad7ab1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:01.412057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0360d3-6978-4847-a892-7f0db2e51723 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:01.412372 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0360d3-6978-4847-a892-7f0db2e51723 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:01.412651 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0360d3-6978-4847-a892-7f0db2e51723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:01.441930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1f0360d3-6978-4847-a892-7f0db2e51723 None None] MFA Rules not processed for user `cd628d464c3a48109351ef43f506c049`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:01.443076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1f0360d3-6978-4847-a892-7f0db2e51723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:01.446189 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0360bcae-84b6-4792-b2bc-fc6c7ad7ab1c None None] MFA Rules not processed for user `5fb501c6417d4a1192c679392c2f40d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:01.447534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0360bcae-84b6-4792-b2bc-fc6c7ad7ab1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:01.524966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 942/1865] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:01.529515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0360d3-6978-4847-a892-7f0db2e51723 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:01.548715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 924/1866] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:01.550122 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360bcae-84b6-4792-b2bc-fc6c7ad7ab1c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:01.634092 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0360d3-6978-4847-a892-7f0db2e51723 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:01.639208 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac981807-5cea-4dd5-956f-ebf16187cb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:01.640017 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac981807-5cea-4dd5-956f-ebf16187cb93 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:01.640396 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac981807-5cea-4dd5-956f-ebf16187cb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:01.640763 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac981807-5cea-4dd5-956f-ebf16187cb93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:01.641925 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac981807-5cea-4dd5-956f-ebf16187cb93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:01.644193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac981807-5cea-4dd5-956f-ebf16187cb93 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:01.668441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360bcae-84b6-4792-b2bc-fc6c7ad7ab1c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:01.674745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c98f8-9839-48af-9681-62306792575f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:01.675393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c98f8-9839-48af-9681-62306792575f admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:01.675883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c98f8-9839-48af-9681-62306792575f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:01.676164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c98f8-9839-48af-9681-62306792575f admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:01.676887 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c98f8-9839-48af-9681-62306792575f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:01.679186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c98f8-9839-48af-9681-62306792575f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:01.842017 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 925/1867] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:01 2022] POST /identity/v3/projects => generated 387 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:01.843072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 943/1868] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:01 2022] POST /identity/v3/projects => generated 387 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:01.847879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac981807-5cea-4dd5-956f-ebf16187cb93 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:01.848306 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c98f8-9839-48af-9681-62306792575f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:01.929505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac981807-5cea-4dd5-956f-ebf16187cb93 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:01.934631 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a53b7-e5f1-4591-b6d4-eb4724ff73dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:01.935433 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a53b7-e5f1-4591-b6d4-eb4724ff73dc admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:01.935544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a53b7-e5f1-4591-b6d4-eb4724ff73dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:01.935769 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a53b7-e5f1-4591-b6d4-eb4724ff73dc admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:01.936766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a53b7-e5f1-4591-b6d4-eb4724ff73dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:01.938555 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a53b7-e5f1-4591-b6d4-eb4724ff73dc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:01.958826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c98f8-9839-48af-9681-62306792575f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:01.979043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7271c13-f875-4870-941c-82fdcbf246d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:01.979677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7271c13-f875-4870-941c-82fdcbf246d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:01.979996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7271c13-f875-4870-941c-82fdcbf246d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:01.980357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7271c13-f875-4870-941c-82fdcbf246d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:01.981026 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7271c13-f875-4870-941c-82fdcbf246d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:01.983127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7271c13-f875-4870-941c-82fdcbf246d2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:02.048701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 944/1869] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:01 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:02.052610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a53b7-e5f1-4591-b6d4-eb4724ff73dc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:02.065279 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a53b7-e5f1-4591-b6d4-eb4724ff73dc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:02.071208 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66f27c-c0c8-4f92-9afa-a9d0d5f1e01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:02.072122 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66f27c-c0c8-4f92-9afa-a9d0d5f1e01c admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:02.072400 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66f27c-c0c8-4f92-9afa-a9d0d5f1e01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:02.072667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66f27c-c0c8-4f92-9afa-a9d0d5f1e01c admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:02.085637 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 926/1870] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:01 2022] POST /identity/v3/users => generated 300 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:02.087147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66f27c-c0c8-4f92-9afa-a9d0d5f1e01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:02.087147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66f27c-c0c8-4f92-9afa-a9d0d5f1e01c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:02.093054 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7271c13-f875-4870-941c-82fdcbf246d2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:02.104480 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 945/1871] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:02.119898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7271c13-f875-4870-941c-82fdcbf246d2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:02.120150 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66f27c-c0c8-4f92-9afa-a9d0d5f1e01c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:02.121523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dac185-e458-4c67-8d09-901bf46fc97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:02.124159 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dac185-e458-4c67-8d09-901bf46fc97d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:02.124454 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dac185-e458-4c67-8d09-901bf46fc97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:02.124737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dac185-e458-4c67-8d09-901bf46fc97d admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:02.125406 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dac185-e458-4c67-8d09-901bf46fc97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:02.127293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66f27c-c0c8-4f92-9afa-a9d0d5f1e01c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:02.129533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dac185-e458-4c67-8d09-901bf46fc97d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:02.132862 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb93e0-0e5b-47ee-8717-02932b396a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:02.133915 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb93e0-0e5b-47ee-8717-02932b396a26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:02.134297 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb93e0-0e5b-47ee-8717-02932b396a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:02.134685 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb93e0-0e5b-47ee-8717-02932b396a26 admin admin] PATH_INFO: `/v3/projects/d856fabe47914b148a54cf14e76c910e/users/a8a087b17dbb48adae9a14a2836ac486/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:02.151790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb93e0-0e5b-47ee-8717-02932b396a26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d856fabe47914b148a54cf14e76c910e, user_id=a8a087b17dbb48adae9a14a2836ac486, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:02.154969 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb93e0-0e5b-47ee-8717-02932b396a26 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:02.157214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 927/1872] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:02.161515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dac185-e458-4c67-8d09-901bf46fc97d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:02.178632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:02.182679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dac185-e458-4c67-8d09-901bf46fc97d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:02.196938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0b081-7b24-45db-87ec-d2cc21a0e3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:02.197680 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0b081-7b24-45db-87ec-d2cc21a0e3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:02.197991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0b081-7b24-45db-87ec-d2cc21a0e3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:02.198269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0b081-7b24-45db-87ec-d2cc21a0e3c8 admin admin] PATH_INFO: `/v3/projects/e667b6006480444d91a5974c6b950471/users/8bfb67607801479fb17eaf37043f15c9/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:02.227350 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0b081-7b24-45db-87ec-d2cc21a0e3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e667b6006480444d91a5974c6b950471, user_id=8bfb67607801479fb17eaf37043f15c9, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:02.230216 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0b081-7b24-45db-87ec-d2cc21a0e3c8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:02.243108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 946/1873] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:02 2022] PUT /identity/v3/projects/d856fabe47914b148a54cf14e76c910e/users/a8a087b17dbb48adae9a14a2836ac486/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:02.243108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb93e0-0e5b-47ee-8717-02932b396a26 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:02.326499 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb93e0-0e5b-47ee-8717-02932b396a26 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:02.333287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669db779-1a13-4ffb-a344-120b2b4170fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:02.334243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669db779-1a13-4ffb-a344-120b2b4170fa admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:02.338358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669db779-1a13-4ffb-a344-120b2b4170fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:02.338358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669db779-1a13-4ffb-a344-120b2b4170fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:02.338358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669db779-1a13-4ffb-a344-120b2b4170fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:02.338933 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669db779-1a13-4ffb-a344-120b2b4170fa admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:02.354658 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 947/1874] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:02.359310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669db779-1a13-4ffb-a344-120b2b4170fa admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:02.372425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669db779-1a13-4ffb-a344-120b2b4170fa admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:02.378450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 928/1875] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:02 2022] PUT /identity/v3/projects/e667b6006480444d91a5974c6b950471/users/8bfb67607801479fb17eaf37043f15c9/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:02.382330 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0b081-7b24-45db-87ec-d2cc21a0e3c8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:02.436671 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac588b5b-dbd9-4c8d-9e68-3fa8c10524c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:02.437340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac588b5b-dbd9-4c8d-9e68-3fa8c10524c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:02.437618 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac588b5b-dbd9-4c8d-9e68-3fa8c10524c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:02.437918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac588b5b-dbd9-4c8d-9e68-3fa8c10524c0 admin admin] PATH_INFO: `/v3/projects/d856fabe47914b148a54cf14e76c910e/users/a8a087b17dbb48adae9a14a2836ac486/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:02.440543 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac588b5b-dbd9-4c8d-9e68-3fa8c10524c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d856fabe47914b148a54cf14e76c910e, user_id=a8a087b17dbb48adae9a14a2836ac486, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:02.443281 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac588b5b-dbd9-4c8d-9e68-3fa8c10524c0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:02.458097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0b081-7b24-45db-87ec-d2cc21a0e3c8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:02.464177 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 948/1876] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:02 2022] PUT /identity/v3/projects/d856fabe47914b148a54cf14e76c910e/users/a8a087b17dbb48adae9a14a2836ac486/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:02.465720 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248973d-f328-4ee1-8195-1e9c3ccf8bf1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:02.466082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248973d-f328-4ee1-8195-1e9c3ccf8bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:02.466360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248973d-f328-4ee1-8195-1e9c3ccf8bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:02.501281 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f248973d-f328-4ee1-8195-1e9c3ccf8bf1 None None] MFA Rules not processed for user `a8a087b17dbb48adae9a14a2836ac486`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:02.502460 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f248973d-f328-4ee1-8195-1e9c3ccf8bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:02.537156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09fcde-8e89-425f-a9e6-781f4e41745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:02.538193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09fcde-8e89-425f-a9e6-781f4e41745e admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:02.545002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09fcde-8e89-425f-a9e6-781f4e41745e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:02.545002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09fcde-8e89-425f-a9e6-781f4e41745e admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:02.545002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09fcde-8e89-425f-a9e6-781f4e41745e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:02.545002 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09fcde-8e89-425f-a9e6-781f4e41745e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:02.553782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 929/1877] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:02.557980 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09fcde-8e89-425f-a9e6-781f4e41745e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:02.573429 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09fcde-8e89-425f-a9e6-781f4e41745e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:02.581919 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727d13f-6e57-4e45-8cb6-e680c6ef2210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:02.582766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727d13f-6e57-4e45-8cb6-e680c6ef2210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:02.583266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727d13f-6e57-4e45-8cb6-e680c6ef2210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:02.583615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727d13f-6e57-4e45-8cb6-e680c6ef2210 admin admin] PATH_INFO: `/v3/projects/e667b6006480444d91a5974c6b950471/users/8bfb67607801479fb17eaf37043f15c9/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:02.585856 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727d13f-6e57-4e45-8cb6-e680c6ef2210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e667b6006480444d91a5974c6b950471, user_id=8bfb67607801479fb17eaf37043f15c9, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:02.588984 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727d13f-6e57-4e45-8cb6-e680c6ef2210 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:02.612656 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 930/1878] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:02 2022] PUT /identity/v3/projects/e667b6006480444d91a5974c6b950471/users/8bfb67607801479fb17eaf37043f15c9/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:02.612937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 949/1879] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:02.615009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57499c6f-165b-453d-a856-5cdbaf415389 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:02.615485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57499c6f-165b-453d-a856-5cdbaf415389 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:02.622491 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57499c6f-165b-453d-a856-5cdbaf415389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:02.626350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248973d-f328-4ee1-8195-1e9c3ccf8bf1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:02.632021 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f248973d-f328-4ee1-8195-1e9c3ccf8bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:02.691079 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-57499c6f-165b-453d-a856-5cdbaf415389 None None] MFA Rules not processed for user `8bfb67607801479fb17eaf37043f15c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:02.691899 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-57499c6f-165b-453d-a856-5cdbaf415389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:02.730803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248973d-f328-4ee1-8195-1e9c3ccf8bf1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:02.800791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5404fe-ca46-4a27-8e0a-471d320f8008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:02.807053 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 931/1880] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:02.807791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5404fe-ca46-4a27-8e0a-471d320f8008 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:02.808306 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5404fe-ca46-4a27-8e0a-471d320f8008 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:02.808972 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5404fe-ca46-4a27-8e0a-471d320f8008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:02.815589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57499c6f-165b-453d-a856-5cdbaf415389 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:02.816932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-57499c6f-165b-453d-a856-5cdbaf415389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:02.835292 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57499c6f-165b-453d-a856-5cdbaf415389 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:02.840274 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92b749-25d4-4c0e-abca-42d0655a6d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:02.841228 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92b749-25d4-4c0e-abca-42d0655a6d1e service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:02.841576 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92b749-25d4-4c0e-abca-42d0655a6d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:02.841987 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92b749-25d4-4c0e-abca-42d0655a6d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:02.862122 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92b749-25d4-4c0e-abca-42d0655a6d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:02.867551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92b749-25d4-4c0e-abca-42d0655a6d1e service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:02.892117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 932/1881] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:02.900297 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5404fe-ca46-4a27-8e0a-471d320f8008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:02.902118 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5404fe-ca46-4a27-8e0a-471d320f8008 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:02.909724 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:02.914316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 950/1882] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:33:02.952558 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92b749-25d4-4c0e-abca-42d0655a6d1e service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:03.072871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92b749-25d4-4c0e-abca-42d0655a6d1e service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:03.081203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ea8e6-a6cc-4a16-8dbf-1cd37e067c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:03.082115 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ea8e6-a6cc-4a16-8dbf-1cd37e067c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:03.082328 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ea8e6-a6cc-4a16-8dbf-1cd37e067c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:03.082685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ea8e6-a6cc-4a16-8dbf-1cd37e067c72 admin admin] PATH_INFO: `/v3/users/cd628d464c3a48109351ef43f506c049` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:03.085091 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ea8e6-a6cc-4a16-8dbf-1cd37e067c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd628d464c3a48109351ef43f506c049)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:03.091737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ea8e6-a6cc-4a16-8dbf-1cd37e067c72 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:03.157429 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:03.378660 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8a1ea8e6-a6cc-4a16-8dbf-1cd37e067c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd628d464c3a48109351ef43f506c049'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:03.394475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8a1ea8e6-a6cc-4a16-8dbf-1cd37e067c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd628d464c3a48109351ef43f506c049'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:03.402797 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8a1ea8e6-a6cc-4a16-8dbf-1cd37e067c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd628d464c3a48109351ef43f506c049'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:03.403554 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8a1ea8e6-a6cc-4a16-8dbf-1cd37e067c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd628d464c3a48109351ef43f506c049'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:03.489376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8a1ea8e6-a6cc-4a16-8dbf-1cd37e067c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd628d464c3a48109351ef43f506c049'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:03.499823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 933/1883] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:02 2022] DELETE /identity/v3/users/cd628d464c3a48109351ef43f506c049 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:03.505149 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a344e-0e2f-4aa3-8608-7e0c5efe714c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:03.505611 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a344e-0e2f-4aa3-8608-7e0c5efe714c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:03.505702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a344e-0e2f-4aa3-8608-7e0c5efe714c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:03.527820 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-965a344e-0e2f-4aa3-8608-7e0c5efe714c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:03.529712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-965a344e-0e2f-4aa3-8608-7e0c5efe714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:03.653823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 951/1884] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:03.664648 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ea8e6-a6cc-4a16-8dbf-1cd37e067c72 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:03.666213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8a1ea8e6-a6cc-4a16-8dbf-1cd37e067c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:03.752119 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ea8e6-a6cc-4a16-8dbf-1cd37e067c72 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:03.761595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df922c3c-d0cc-4086-bc70-af40e88ab9b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:03.762452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df922c3c-d0cc-4086-bc70-af40e88ab9b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:03.763093 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df922c3c-d0cc-4086-bc70-af40e88ab9b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:03.763536 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df922c3c-d0cc-4086-bc70-af40e88ab9b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:03.778481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df922c3c-d0cc-4086-bc70-af40e88ab9b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:03.780264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df922c3c-d0cc-4086-bc70-af40e88ab9b0 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:03.800529 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 934/1885] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:04.747392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a344e-0e2f-4aa3-8608-7e0c5efe714c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:04.750616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-965a344e-0e2f-4aa3-8608-7e0c5efe714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:04.766343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a344e-0e2f-4aa3-8608-7e0c5efe714c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:04.773981 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51a9a4-4127-4775-aa73-38ab38529075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:04.774640 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51a9a4-4127-4775-aa73-38ab38529075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:04.774922 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51a9a4-4127-4775-aa73-38ab38529075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:04.775187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51a9a4-4127-4775-aa73-38ab38529075 admin admin] PATH_INFO: `/v3/users/5fb501c6417d4a1192c679392c2f40d7` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:04.776362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51a9a4-4127-4775-aa73-38ab38529075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb501c6417d4a1192c679392c2f40d7)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:04.778534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51a9a4-4127-4775-aa73-38ab38529075 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:04.978661 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cb51a9a4-4127-4775-aa73-38ab38529075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb501c6417d4a1192c679392c2f40d7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:04.995902 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cb51a9a4-4127-4775-aa73-38ab38529075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb501c6417d4a1192c679392c2f40d7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.010183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cb51a9a4-4127-4775-aa73-38ab38529075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb501c6417d4a1192c679392c2f40d7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.011578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cb51a9a4-4127-4775-aa73-38ab38529075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb501c6417d4a1192c679392c2f40d7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.103993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cb51a9a4-4127-4775-aa73-38ab38529075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb501c6417d4a1192c679392c2f40d7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.111506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 952/1886] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:04 2022] DELETE /identity/v3/users/5fb501c6417d4a1192c679392c2f40d7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:05.116677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb74da-124a-4521-aa27-a44cfe028f31 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:05.117224 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb74da-124a-4521-aa27-a44cfe028f31 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:05.117224 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb74da-124a-4521-aa27-a44cfe028f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:05.136807 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8ccb74da-124a-4521-aa27-a44cfe028f31 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:05.137861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8ccb74da-124a-4521-aa27-a44cfe028f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:05.197722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 935/1887] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:05.207449 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51a9a4-4127-4775-aa73-38ab38529075 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:05.208940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cb51a9a4-4127-4775-aa73-38ab38529075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:05.248411 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb74da-124a-4521-aa27-a44cfe028f31 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:05.250308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8ccb74da-124a-4521-aa27-a44cfe028f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:05.266730 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb74da-124a-4521-aa27-a44cfe028f31 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:05.268439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51a9a4-4127-4775-aa73-38ab38529075 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:05.272815 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c43d30-328d-459a-b007-e099f75f9891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:05.278452 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c43d30-328d-459a-b007-e099f75f9891 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:05.278452 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c43d30-328d-459a-b007-e099f75f9891 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:05.278679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78fb69-97cf-40a4-a302-00eebf5dc973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:05.278786 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c43d30-328d-459a-b007-e099f75f9891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:05.278875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78fb69-97cf-40a4-a302-00eebf5dc973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:05.278875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78fb69-97cf-40a4-a302-00eebf5dc973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:05.278875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78fb69-97cf-40a4-a302-00eebf5dc973 admin admin] PATH_INFO: `/v3/projects/23f3d125a3094e4a891988c93f284609` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:05.278875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78fb69-97cf-40a4-a302-00eebf5dc973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f3d125a3094e4a891988c93f284609)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:05.280093 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78fb69-97cf-40a4-a302-00eebf5dc973 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:05.294704 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c43d30-328d-459a-b007-e099f75f9891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:05.300707 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c43d30-328d-459a-b007-e099f75f9891 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:05.314181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 953/1888] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:05.352055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c43d30-328d-459a-b007-e099f75f9891 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:05.354011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c9c43d30-328d-459a-b007-e099f75f9891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:05.373551 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c43d30-328d-459a-b007-e099f75f9891 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:05.378591 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d26137-4eb6-4a4a-bfcb-92f924ac5a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:05.379439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d26137-4eb6-4a4a-bfcb-92f924ac5a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:05.379823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d26137-4eb6-4a4a-bfcb-92f924ac5a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:05.379971 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d26137-4eb6-4a4a-bfcb-92f924ac5a3b admin admin] PATH_INFO: `/v3/users/8ae3592c0bb9481a8fe4d00c6988b124` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:05.381233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d26137-4eb6-4a4a-bfcb-92f924ac5a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae3592c0bb9481a8fe4d00c6988b124)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:05.384355 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d26137-4eb6-4a4a-bfcb-92f924ac5a3b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:05.467961 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2f78fb69-97cf-40a4-a302-00eebf5dc973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f3d125a3094e4a891988c93f284609', 'request_id': 'req-2f78fb69-97cf-40a4-a302-00eebf5dc973'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.606717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2f78fb69-97cf-40a4-a302-00eebf5dc973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f3d125a3094e4a891988c93f284609', 'request_id': 'req-2f78fb69-97cf-40a4-a302-00eebf5dc973'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.613276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2f78fb69-97cf-40a4-a302-00eebf5dc973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f3d125a3094e4a891988c93f284609', 'request_id': 'req-2f78fb69-97cf-40a4-a302-00eebf5dc973'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.625140 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2f78fb69-97cf-40a4-a302-00eebf5dc973 admin admin] The token cache is being invalidate because project 23f3d125a3094e4a891988c93f284609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:05.625496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2f78fb69-97cf-40a4-a302-00eebf5dc973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.626301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2f78fb69-97cf-40a4-a302-00eebf5dc973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.627835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 936/1889] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:05 2022] DELETE /identity/v3/projects/23f3d125a3094e4a891988c93f284609 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:05.631690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78fb69-97cf-40a4-a302-00eebf5dc973 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:05.633028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2f78fb69-97cf-40a4-a302-00eebf5dc973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:05.651001 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-54d26137-4eb6-4a4a-bfcb-92f924ac5a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae3592c0bb9481a8fe4d00c6988b124'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.664378 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-54d26137-4eb6-4a4a-bfcb-92f924ac5a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae3592c0bb9481a8fe4d00c6988b124'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.672169 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-54d26137-4eb6-4a4a-bfcb-92f924ac5a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae3592c0bb9481a8fe4d00c6988b124'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.673070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-54d26137-4eb6-4a4a-bfcb-92f924ac5a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae3592c0bb9481a8fe4d00c6988b124'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.700059 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78fb69-97cf-40a4-a302-00eebf5dc973 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:05.704881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7d6ca-949e-4426-b74b-a3884cb93957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:05.705453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7d6ca-949e-4426-b74b-a3884cb93957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:05.705757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7d6ca-949e-4426-b74b-a3884cb93957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:05.706045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7d6ca-949e-4426-b74b-a3884cb93957 admin admin] PATH_INFO: `/v3/users/a8a087b17dbb48adae9a14a2836ac486` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:05.707187 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7d6ca-949e-4426-b74b-a3884cb93957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a087b17dbb48adae9a14a2836ac486)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:05.709102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7d6ca-949e-4426-b74b-a3884cb93957 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:05.809715 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-54d26137-4eb6-4a4a-bfcb-92f924ac5a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae3592c0bb9481a8fe4d00c6988b124'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.825928 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 954/1890] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:05 2022] DELETE /identity/v3/users/8ae3592c0bb9481a8fe4d00c6988b124 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:05.829517 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39687033-97d5-46da-ad0a-cc323399ed9a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:05.830456 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39687033-97d5-46da-ad0a-cc323399ed9a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:05.830735 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39687033-97d5-46da-ad0a-cc323399ed9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:05.867133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-39687033-97d5-46da-ad0a-cc323399ed9a None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:05.868347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-39687033-97d5-46da-ad0a-cc323399ed9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:05.934377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 955/1891] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:05.940725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39687033-97d5-46da-ad0a-cc323399ed9a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:05.941524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-72d7d6ca-949e-4426-b74b-a3884cb93957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a087b17dbb48adae9a14a2836ac486'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.944983 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-39687033-97d5-46da-ad0a-cc323399ed9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:05.956325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-72d7d6ca-949e-4426-b74b-a3884cb93957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a087b17dbb48adae9a14a2836ac486'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.972072 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-72d7d6ca-949e-4426-b74b-a3884cb93957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a087b17dbb48adae9a14a2836ac486'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:05.972933 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-72d7d6ca-949e-4426-b74b-a3884cb93957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a087b17dbb48adae9a14a2836ac486'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:06.054687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:06.056553 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39687033-97d5-46da-ad0a-cc323399ed9a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:06.060443 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8df3a-97f8-4e12-a79d-2c94ba34ef9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:06.065086 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8df3a-97f8-4e12-a79d-2c94ba34ef9b service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:06.065086 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8df3a-97f8-4e12-a79d-2c94ba34ef9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:06.065086 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8df3a-97f8-4e12-a79d-2c94ba34ef9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:06.065086 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6ba8df3a-97f8-4e12-a79d-2c94ba34ef9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:06.077080 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8df3a-97f8-4e12-a79d-2c94ba34ef9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:06.078562 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8df3a-97f8-4e12-a79d-2c94ba34ef9b service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:06.088308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-72d7d6ca-949e-4426-b74b-a3884cb93957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a087b17dbb48adae9a14a2836ac486'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:06.098269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 956/1892] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:06.098575 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8df3a-97f8-4e12-a79d-2c94ba34ef9b service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:06.103649 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6ba8df3a-97f8-4e12-a79d-2c94ba34ef9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:06.110392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 937/1893] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:05 2022] DELETE /identity/v3/users/a8a087b17dbb48adae9a14a2836ac486 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:06.123774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8df3a-97f8-4e12-a79d-2c94ba34ef9b service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:06.210219 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0193688-0b98-42e6-b82b-c00ccb4d2368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:06.210797 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0193688-0b98-42e6-b82b-c00ccb4d2368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:06.211071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0193688-0b98-42e6-b82b-c00ccb4d2368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:06.211348 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0193688-0b98-42e6-b82b-c00ccb4d2368 admin admin] PATH_INFO: `/v3/projects/5fd17ef226804d65afd01061a9fa80d4` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:06.212484 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0193688-0b98-42e6-b82b-c00ccb4d2368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fd17ef226804d65afd01061a9fa80d4)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:06.214652 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0193688-0b98-42e6-b82b-c00ccb4d2368 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:06.407112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0193688-0b98-42e6-b82b-c00ccb4d2368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fd17ef226804d65afd01061a9fa80d4', 'request_id': 'req-f0193688-0b98-42e6-b82b-c00ccb4d2368'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:06.437609 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:06.574267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0193688-0b98-42e6-b82b-c00ccb4d2368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fd17ef226804d65afd01061a9fa80d4', 'request_id': 'req-f0193688-0b98-42e6-b82b-c00ccb4d2368'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:06.582328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0193688-0b98-42e6-b82b-c00ccb4d2368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fd17ef226804d65afd01061a9fa80d4', 'request_id': 'req-f0193688-0b98-42e6-b82b-c00ccb4d2368'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:06.638544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0193688-0b98-42e6-b82b-c00ccb4d2368 admin admin] The token cache is being invalidate because project 5fd17ef226804d65afd01061a9fa80d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:06.642004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0193688-0b98-42e6-b82b-c00ccb4d2368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:06.652325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0193688-0b98-42e6-b82b-c00ccb4d2368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:06.652325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 957/1894] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:06 2022] DELETE /identity/v3/projects/5fd17ef226804d65afd01061a9fa80d4 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:06.656214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7d6ca-949e-4426-b74b-a3884cb93957 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:06.674148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7d6ca-949e-4426-b74b-a3884cb93957 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:06.794593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638b798-fcb8-43cc-8d34-24b1c2874656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:06.795405 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638b798-fcb8-43cc-8d34-24b1c2874656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:06.795645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638b798-fcb8-43cc-8d34-24b1c2874656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:06.796006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638b798-fcb8-43cc-8d34-24b1c2874656 admin admin] PATH_INFO: `/v3/users/8bfb67607801479fb17eaf37043f15c9` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:06.797231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638b798-fcb8-43cc-8d34-24b1c2874656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bfb67607801479fb17eaf37043f15c9)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:06.799549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638b798-fcb8-43cc-8d34-24b1c2874656 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:07.000271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0193688-0b98-42e6-b82b-c00ccb4d2368 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:07.002441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f0193688-0b98-42e6-b82b-c00ccb4d2368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:07.032812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0193688-0b98-42e6-b82b-c00ccb4d2368 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:07.043131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38118dc1-f5e2-4c75-8afd-80fb4c3110a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:07.043825 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38118dc1-f5e2-4c75-8afd-80fb4c3110a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:07.044104 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38118dc1-f5e2-4c75-8afd-80fb4c3110a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:07.044376 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38118dc1-f5e2-4c75-8afd-80fb4c3110a8 admin admin] PATH_INFO: `/v3/projects/5f2276f332064d208836ccc889f66ee2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:07.045631 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38118dc1-f5e2-4c75-8afd-80fb4c3110a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f2276f332064d208836ccc889f66ee2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:07.047618 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38118dc1-f5e2-4c75-8afd-80fb4c3110a8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:07.142543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2638b798-fcb8-43cc-8d34-24b1c2874656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bfb67607801479fb17eaf37043f15c9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:07.162615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2638b798-fcb8-43cc-8d34-24b1c2874656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bfb67607801479fb17eaf37043f15c9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:07.176334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2638b798-fcb8-43cc-8d34-24b1c2874656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bfb67607801479fb17eaf37043f15c9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:07.176951 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2638b798-fcb8-43cc-8d34-24b1c2874656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bfb67607801479fb17eaf37043f15c9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:07.189295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-38118dc1-f5e2-4c75-8afd-80fb4c3110a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f2276f332064d208836ccc889f66ee2', 'request_id': 'req-38118dc1-f5e2-4c75-8afd-80fb4c3110a8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:07.283304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2638b798-fcb8-43cc-8d34-24b1c2874656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bfb67607801479fb17eaf37043f15c9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:07.294078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 938/1895] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:06 2022] DELETE /identity/v3/users/8bfb67607801479fb17eaf37043f15c9 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:07.302243 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638b798-fcb8-43cc-8d34-24b1c2874656 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:07.307509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2638b798-fcb8-43cc-8d34-24b1c2874656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:07.399648 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-38118dc1-f5e2-4c75-8afd-80fb4c3110a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f2276f332064d208836ccc889f66ee2', 'request_id': 'req-38118dc1-f5e2-4c75-8afd-80fb4c3110a8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:07.415616 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638b798-fcb8-43cc-8d34-24b1c2874656 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:07.418946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-38118dc1-f5e2-4c75-8afd-80fb4c3110a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f2276f332064d208836ccc889f66ee2', 'request_id': 'req-38118dc1-f5e2-4c75-8afd-80fb4c3110a8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:07.421375 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985643b-6137-4c1d-9dcf-28bc2322dfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:07.422510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985643b-6137-4c1d-9dcf-28bc2322dfe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:07.422866 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985643b-6137-4c1d-9dcf-28bc2322dfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:07.423325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985643b-6137-4c1d-9dcf-28bc2322dfe5 admin admin] PATH_INFO: `/v3/projects/d856fabe47914b148a54cf14e76c910e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:07.424724 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985643b-6137-4c1d-9dcf-28bc2322dfe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d856fabe47914b148a54cf14e76c910e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:07.426884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985643b-6137-4c1d-9dcf-28bc2322dfe5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:07.437587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-38118dc1-f5e2-4c75-8afd-80fb4c3110a8 admin admin] The token cache is being invalidate because project 5f2276f332064d208836ccc889f66ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:07.437963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-38118dc1-f5e2-4c75-8afd-80fb4c3110a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:07.440318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-38118dc1-f5e2-4c75-8afd-80fb4c3110a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:07.447789 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 958/1896] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:06 2022] DELETE /identity/v3/projects/5f2276f332064d208836ccc889f66ee2 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:07.449298 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d9344-e3d0-467e-986b-9cc8c4b00354 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:07.449588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d9344-e3d0-467e-986b-9cc8c4b00354 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:07.449942 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d9344-e3d0-467e-986b-9cc8c4b00354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:07.493166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0f3d9344-e3d0-467e-986b-9cc8c4b00354 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:07.498599 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0f3d9344-e3d0-467e-986b-9cc8c4b00354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:07.512155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 959/1897] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:07.522172 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11ed3-6ce7-4e57-aaf0-628f7aa349f6 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:07.537537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11ed3-6ce7-4e57-aaf0-628f7aa349f6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:07.537537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11ed3-6ce7-4e57-aaf0-628f7aa349f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:07.552200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-81a11ed3-6ce7-4e57-aaf0-628f7aa349f6 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:07.554000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-81a11ed3-6ce7-4e57-aaf0-628f7aa349f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:07.562767 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 960/1898] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:07.566823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a11ed3-6ce7-4e57-aaf0-628f7aa349f6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:07.578527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a11ed3-6ce7-4e57-aaf0-628f7aa349f6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:07.585706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f96c9-1b69-483e-9eff-76f264c854e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:07.586255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f96c9-1b69-483e-9eff-76f264c854e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:07.586588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f96c9-1b69-483e-9eff-76f264c854e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:07.586797 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f96c9-1b69-483e-9eff-76f264c854e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:07.587437 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f96c9-1b69-483e-9eff-76f264c854e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:33:07.587743 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f96c9-1b69-483e-9eff-76f264c854e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:07.589389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f96c9-1b69-483e-9eff-76f264c854e6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:07.610369 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 961/1899] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:33:07.614633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f96c9-1b69-483e-9eff-76f264c854e6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:07.625966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f96c9-1b69-483e-9eff-76f264c854e6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:07.631111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa0997-a609-481d-bce1-65e89c3e6eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:07.631746 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa0997-a609-481d-bce1-65e89c3e6eda admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:07.632161 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa0997-a609-481d-bce1-65e89c3e6eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:07.632459 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa0997-a609-481d-bce1-65e89c3e6eda admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:07.633134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa0997-a609-481d-bce1-65e89c3e6eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:07.635267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa0997-a609-481d-bce1-65e89c3e6eda admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:07.671932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3985643b-6137-4c1d-9dcf-28bc2322dfe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd856fabe47914b148a54cf14e76c910e', 'request_id': 'req-3985643b-6137-4c1d-9dcf-28bc2322dfe5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:07.752551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3985643b-6137-4c1d-9dcf-28bc2322dfe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd856fabe47914b148a54cf14e76c910e', 'request_id': 'req-3985643b-6137-4c1d-9dcf-28bc2322dfe5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:07.759146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3985643b-6137-4c1d-9dcf-28bc2322dfe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd856fabe47914b148a54cf14e76c910e', 'request_id': 'req-3985643b-6137-4c1d-9dcf-28bc2322dfe5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:07.764123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 962/1900] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:07 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:07.765243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa0997-a609-481d-bce1-65e89c3e6eda admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:07.770873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3985643b-6137-4c1d-9dcf-28bc2322dfe5 admin admin] The token cache is being invalidate because project d856fabe47914b148a54cf14e76c910e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:07.771163 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3985643b-6137-4c1d-9dcf-28bc2322dfe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:07.771837 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3985643b-6137-4c1d-9dcf-28bc2322dfe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:07.773834 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 939/1901] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:07 2022] DELETE /identity/v3/projects/d856fabe47914b148a54cf14e76c910e => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:07.778491 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d239a99-e382-4ba7-b810-e70f928892a6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:07.778772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d239a99-e382-4ba7-b810-e70f928892a6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:07.779045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d239a99-e382-4ba7-b810-e70f928892a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:07.800169 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4d239a99-e382-4ba7-b810-e70f928892a6 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:07.801595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4d239a99-e382-4ba7-b810-e70f928892a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:07.846837 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa0997-a609-481d-bce1-65e89c3e6eda admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:07.852118 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07527a-5cf4-47d6-b041-62ad5324428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:07.852720 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07527a-5cf4-47d6-b041-62ad5324428f admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:07.853024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07527a-5cf4-47d6-b041-62ad5324428f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:07.853289 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07527a-5cf4-47d6-b041-62ad5324428f admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:07.853932 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07527a-5cf4-47d6-b041-62ad5324428f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:07.856034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07527a-5cf4-47d6-b041-62ad5324428f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:07.868737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 940/1902] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:07.876589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d1a90-31cf-421f-a9b6-16b41f42f01d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:07.876876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d1a90-31cf-421f-a9b6-16b41f42f01d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:07.877144 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d1a90-31cf-421f-a9b6-16b41f42f01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:07.899067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a24d1a90-31cf-421f-a9b6-16b41f42f01d None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:07.900275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a24d1a90-31cf-421f-a9b6-16b41f42f01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:07.908556 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 941/1903] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:07.912357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d1a90-31cf-421f-a9b6-16b41f42f01d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:07.922167 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d1a90-31cf-421f-a9b6-16b41f42f01d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:07.927037 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb070b87-1256-431b-b10f-9130127a5c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:07.927631 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb070b87-1256-431b-b10f-9130127a5c9e admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:07.927906 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb070b87-1256-431b-b10f-9130127a5c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:07.928233 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb070b87-1256-431b-b10f-9130127a5c9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:07.929531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb070b87-1256-431b-b10f-9130127a5c9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:33:07.929883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb070b87-1256-431b-b10f-9130127a5c9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:07.933725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb070b87-1256-431b-b10f-9130127a5c9e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:07.942953 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 942/1904] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:33:07.947155 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb070b87-1256-431b-b10f-9130127a5c9e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:07.956244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb070b87-1256-431b-b10f-9130127a5c9e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:07.963939 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ef7ac-0d1a-450a-8b51-2fc992cd1f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:07.963939 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ef7ac-0d1a-450a-8b51-2fc992cd1f78 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:07.963939 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ef7ac-0d1a-450a-8b51-2fc992cd1f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:07.963939 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ef7ac-0d1a-450a-8b51-2fc992cd1f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:07.966997 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ef7ac-0d1a-450a-8b51-2fc992cd1f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:07.967074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 963/1905] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:07 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:07.967165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ef7ac-0d1a-450a-8b51-2fc992cd1f78 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:07.976385 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07527a-5cf4-47d6-b041-62ad5324428f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:07.978110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0b07527a-5cf4-47d6-b041-62ad5324428f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:07.989909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07527a-5cf4-47d6-b041-62ad5324428f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:07.994537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429a203-e2d3-4e40-b167-d5402d8efa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:07.995318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429a203-e2d3-4e40-b167-d5402d8efa08 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:07.995451 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429a203-e2d3-4e40-b167-d5402d8efa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:07.995667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429a203-e2d3-4e40-b167-d5402d8efa08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:07.996309 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429a203-e2d3-4e40-b167-d5402d8efa08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:07.998089 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429a203-e2d3-4e40-b167-d5402d8efa08 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:08.011476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 964/1906] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:08.011476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429a203-e2d3-4e40-b167-d5402d8efa08 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:08.011476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a429a203-e2d3-4e40-b167-d5402d8efa08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:08.025074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429a203-e2d3-4e40-b167-d5402d8efa08 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:08.029821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226eb6e-fa68-4908-b30b-0ec55903cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:08.030450 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226eb6e-fa68-4908-b30b-0ec55903cead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:08.030742 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226eb6e-fa68-4908-b30b-0ec55903cead admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:08.030997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226eb6e-fa68-4908-b30b-0ec55903cead admin admin] PATH_INFO: `/v3/projects/e667b6006480444d91a5974c6b950471` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:08.032111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226eb6e-fa68-4908-b30b-0ec55903cead admin admin] RBAC: Authorizing `identity:delete_project(project_id=e667b6006480444d91a5974c6b950471)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:08.034056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226eb6e-fa68-4908-b30b-0ec55903cead admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:08.072228 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 943/1907] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:07 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:08.073200 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ef7ac-0d1a-450a-8b51-2fc992cd1f78 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:08.133682 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ef7ac-0d1a-450a-8b51-2fc992cd1f78 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:08.139071 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98149c7-20e1-4ef3-aef8-7d7153e00d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:08.139675 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98149c7-20e1-4ef3-aef8-7d7153e00d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:08.139959 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98149c7-20e1-4ef3-aef8-7d7153e00d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:08.140230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98149c7-20e1-4ef3-aef8-7d7153e00d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:08.140866 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98149c7-20e1-4ef3-aef8-7d7153e00d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:08.142564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98149c7-20e1-4ef3-aef8-7d7153e00d73 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:08.151632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c226eb6e-fa68-4908-b30b-0ec55903cead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e667b6006480444d91a5974c6b950471', 'request_id': 'req-c226eb6e-fa68-4908-b30b-0ec55903cead'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:08.153392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 944/1908] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:08.154279 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98149c7-20e1-4ef3-aef8-7d7153e00d73 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:08.164506 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98149c7-20e1-4ef3-aef8-7d7153e00d73 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:08.219376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db985a5e-e1fc-42b3-ae1f-726a0902b30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:08.219998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db985a5e-e1fc-42b3-ae1f-726a0902b30f admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:08.220276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db985a5e-e1fc-42b3-ae1f-726a0902b30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:08.220659 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db985a5e-e1fc-42b3-ae1f-726a0902b30f admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:08.221286 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db985a5e-e1fc-42b3-ae1f-726a0902b30f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:08.223211 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db985a5e-e1fc-42b3-ae1f-726a0902b30f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:08.281997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c226eb6e-fa68-4908-b30b-0ec55903cead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e667b6006480444d91a5974c6b950471', 'request_id': 'req-c226eb6e-fa68-4908-b30b-0ec55903cead'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:08.289765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c226eb6e-fa68-4908-b30b-0ec55903cead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e667b6006480444d91a5974c6b950471', 'request_id': 'req-c226eb6e-fa68-4908-b30b-0ec55903cead'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:08.299971 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c226eb6e-fa68-4908-b30b-0ec55903cead admin admin] The token cache is being invalidate because project e667b6006480444d91a5974c6b950471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:08.300260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c226eb6e-fa68-4908-b30b-0ec55903cead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:08.300922 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c226eb6e-fa68-4908-b30b-0ec55903cead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:08.302439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 965/1909] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:08 2022] DELETE /identity/v3/projects/e667b6006480444d91a5974c6b950471 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:08.303247 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226eb6e-fa68-4908-b30b-0ec55903cead admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:08.304492 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c226eb6e-fa68-4908-b30b-0ec55903cead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:08.316357 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226eb6e-fa68-4908-b30b-0ec55903cead admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:08.321489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb813e-a118-47e4-88c2-dcfc789c5245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:08.322158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb813e-a118-47e4-88c2-dcfc789c5245 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:08.322430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb813e-a118-47e4-88c2-dcfc789c5245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:08.322700 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb813e-a118-47e4-88c2-dcfc789c5245 admin admin] PATH_INFO: `/v3/projects/31401a1bf56e4f0dbdd557c0ec6cd5cb/users/24f498153c154f809da405ae3fc73c86/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:08.329895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 945/1910] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:08 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:08.329895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6138c-70e9-44cf-87f5-b4cb5afe1ecf None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:08.329895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6138c-70e9-44cf-87f5-b4cb5afe1ecf None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:08.329895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6138c-70e9-44cf-87f5-b4cb5afe1ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:08.338278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb813e-a118-47e4-88c2-dcfc789c5245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31401a1bf56e4f0dbdd557c0ec6cd5cb, user_id=24f498153c154f809da405ae3fc73c86, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:08.340920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb813e-a118-47e4-88c2-dcfc789c5245 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:08.349529 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bae6138c-70e9-44cf-87f5-b4cb5afe1ecf None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:08.350813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bae6138c-70e9-44cf-87f5-b4cb5afe1ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:08.358771 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 946/1911] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:08.359543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6138c-70e9-44cf-87f5-b4cb5afe1ecf None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:08.367405 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bae6138c-70e9-44cf-87f5-b4cb5afe1ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:08.374571 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6138c-70e9-44cf-87f5-b4cb5afe1ecf None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:08.379380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a513a-f8b2-4616-a2cf-19654b44c332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:08.379982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a513a-f8b2-4616-a2cf-19654b44c332 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:08.380262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a513a-f8b2-4616-a2cf-19654b44c332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:08.380603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a513a-f8b2-4616-a2cf-19654b44c332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:08.381801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a513a-f8b2-4616-a2cf-19654b44c332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:08.383447 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a513a-f8b2-4616-a2cf-19654b44c332 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:08.393212 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 947/1912] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:08.394480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b791f-eed2-43e2-a6ef-90ac2bdecb50 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:08.394767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b791f-eed2-43e2-a6ef-90ac2bdecb50 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:08.395041 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b791f-eed2-43e2-a6ef-90ac2bdecb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:08.414586 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bd7b791f-eed2-43e2-a6ef-90ac2bdecb50 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:08.415762 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bd7b791f-eed2-43e2-a6ef-90ac2bdecb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:08.423578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 948/1913] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:08.424324 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b791f-eed2-43e2-a6ef-90ac2bdecb50 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:08.433681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b791f-eed2-43e2-a6ef-90ac2bdecb50 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:08.436587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 966/1914] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:08 2022] PUT /identity/v3/projects/31401a1bf56e4f0dbdd557c0ec6cd5cb/users/24f498153c154f809da405ae3fc73c86/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:08.437525 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb813e-a118-47e4-88c2-dcfc789c5245 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:08.490673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee09ca-96dc-4ad3-a962-002fbee3abb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:08.491281 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee09ca-96dc-4ad3-a962-002fbee3abb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:08.491560 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee09ca-96dc-4ad3-a962-002fbee3abb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:08.491832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee09ca-96dc-4ad3-a962-002fbee3abb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:08.492473 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee09ca-96dc-4ad3-a962-002fbee3abb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:08.494094 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee09ca-96dc-4ad3-a962-002fbee3abb3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:08.500386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb813e-a118-47e4-88c2-dcfc789c5245 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:08.503817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 949/1915] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:08.505129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ebd62-d382-4b47-91a4-ff85b3597c08 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:08.505415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ebd62-d382-4b47-91a4-ff85b3597c08 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:08.505690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ebd62-d382-4b47-91a4-ff85b3597c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:08.508911 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35767d-9bd6-42c2-8b87-5c890a2065d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:08.509682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35767d-9bd6-42c2-8b87-5c890a2065d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:08.510048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35767d-9bd6-42c2-8b87-5c890a2065d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:08.510333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35767d-9bd6-42c2-8b87-5c890a2065d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:08.510994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35767d-9bd6-42c2-8b87-5c890a2065d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:33:08.517273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35767d-9bd6-42c2-8b87-5c890a2065d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:08.517273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35767d-9bd6-42c2-8b87-5c890a2065d1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:08.526221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 967/1916] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:33:08.526869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35767d-9bd6-42c2-8b87-5c890a2065d1 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:08.537172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f76ebd62-d382-4b47-91a4-ff85b3597c08 None None] MFA Rules not processed for user `24f498153c154f809da405ae3fc73c86`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:08.538577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f76ebd62-d382-4b47-91a4-ff85b3597c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:08.538938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35767d-9bd6-42c2-8b87-5c890a2065d1 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:08.543946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bf9a1-dfe8-4949-9122-847e1ed941fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:08.551586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bf9a1-dfe8-4949-9122-847e1ed941fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:08.551586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bf9a1-dfe8-4949-9122-847e1ed941fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:08.551586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bf9a1-dfe8-4949-9122-847e1ed941fc admin admin] PATH_INFO: `/v3/projects/a5d7768e2bf74e728e122f553e7a9cf9/users/3b3c21e5ef3e4eddab4c8278d7df4702/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:08.561355 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bf9a1-dfe8-4949-9122-847e1ed941fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5d7768e2bf74e728e122f553e7a9cf9, user_id=3b3c21e5ef3e4eddab4c8278d7df4702, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:08.565674 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bf9a1-dfe8-4949-9122-847e1ed941fc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:08.607148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 950/1917] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:08.607981 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ebd62-d382-4b47-91a4-ff85b3597c08 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:08.619016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ebd62-d382-4b47-91a4-ff85b3597c08 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:08.623527 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efeaaf-8291-4d0a-9d55-0b59ec3bda1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:08.624134 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efeaaf-8291-4d0a-9d55-0b59ec3bda1b admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:08.624425 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efeaaf-8291-4d0a-9d55-0b59ec3bda1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:08.624671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efeaaf-8291-4d0a-9d55-0b59ec3bda1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:08.625312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efeaaf-8291-4d0a-9d55-0b59ec3bda1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:08.627209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efeaaf-8291-4d0a-9d55-0b59ec3bda1b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:08.684110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 968/1918] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:08 2022] PUT /identity/v3/projects/a5d7768e2bf74e728e122f553e7a9cf9/users/3b3c21e5ef3e4eddab4c8278d7df4702/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:08.684748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bf9a1-dfe8-4949-9122-847e1ed941fc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:08.688289 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-152bf9a1-dfe8-4949-9122-847e1ed941fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:08.751613 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bf9a1-dfe8-4949-9122-847e1ed941fc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:08.755250 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dcef1-b6c5-4942-891e-74ac39d26b92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:08.755826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dcef1-b6c5-4942-891e-74ac39d26b92 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:08.756098 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dcef1-b6c5-4942-891e-74ac39d26b92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:08.756955 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dcef1-b6c5-4942-891e-74ac39d26b92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:08.799046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 951/1919] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:08 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:08.800222 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede0e6a-1284-4f0c-ab01-e2066714eedc None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:08.800503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede0e6a-1284-4f0c-ab01-e2066714eedc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:08.800772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede0e6a-1284-4f0c-ab01-e2066714eedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:08.818762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306dcef1-b6c5-4942-891e-74ac39d26b92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:08.820997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306dcef1-b6c5-4942-891e-74ac39d26b92 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:08.830737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-aede0e6a-1284-4f0c-ab01-e2066714eedc None None] MFA Rules not processed for user `3b3c21e5ef3e4eddab4c8278d7df4702`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:08.831985 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-aede0e6a-1284-4f0c-ab01-e2066714eedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:08.841883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 969/1920] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:08.842819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dcef1-b6c5-4942-891e-74ac39d26b92 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:08.913983 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dcef1-b6c5-4942-891e-74ac39d26b92 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:08.917896 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 952/1921] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:08.919049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede0e6a-1284-4f0c-ab01-e2066714eedc None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:08.973048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d5383-ff59-4537-a388-c7a30ad6032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:08.973719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d5383-ff59-4537-a388-c7a30ad6032a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:08.974028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d5383-ff59-4537-a388-c7a30ad6032a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:08.974302 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d5383-ff59-4537-a388-c7a30ad6032a admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:08.975000 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d5383-ff59-4537-a388-c7a30ad6032a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:08.976912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d5383-ff59-4537-a388-c7a30ad6032a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:08.996460 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede0e6a-1284-4f0c-ab01-e2066714eedc None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:09.001159 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70767486-2d16-4495-9b2b-907446a83e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:09.001783 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70767486-2d16-4495-9b2b-907446a83e75 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:09.002060 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70767486-2d16-4495-9b2b-907446a83e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:09.002324 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70767486-2d16-4495-9b2b-907446a83e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:09.002946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70767486-2d16-4495-9b2b-907446a83e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:09.004853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70767486-2d16-4495-9b2b-907446a83e75 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:09.126111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 970/1922] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:08 2022] POST /identity/v3/users => generated 292 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:09.126936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 953/1923] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:08 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:09.127685 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d5383-ff59-4537-a388-c7a30ad6032a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:09.128195 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70767486-2d16-4495-9b2b-907446a83e75 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:09.137340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d5383-ff59-4537-a388-c7a30ad6032a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:09.189982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70767486-2d16-4495-9b2b-907446a83e75 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:09.194640 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5373237-7bc7-45b5-baf1-98eac2b0c8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:09.195246 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5373237-7bc7-45b5-baf1-98eac2b0c8cd admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:09.195523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5373237-7bc7-45b5-baf1-98eac2b0c8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:09.195790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5373237-7bc7-45b5-baf1-98eac2b0c8cd admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:09.196416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5373237-7bc7-45b5-baf1-98eac2b0c8cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:09.198473 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5373237-7bc7-45b5-baf1-98eac2b0c8cd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:09.200782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009080fb-87ca-4ca8-aa27-5468cc601778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:09.201364 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009080fb-87ca-4ca8-aa27-5468cc601778 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:09.201680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009080fb-87ca-4ca8-aa27-5468cc601778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:09.201977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009080fb-87ca-4ca8-aa27-5468cc601778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:09.204007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009080fb-87ca-4ca8-aa27-5468cc601778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:09.204414 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009080fb-87ca-4ca8-aa27-5468cc601778 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:09.218682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 971/1924] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:09.219585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009080fb-87ca-4ca8-aa27-5468cc601778 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:09.229753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009080fb-87ca-4ca8-aa27-5468cc601778 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:09.234363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886eb42f-3de0-447f-b891-4000d4a72f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:09.234939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb42f-3de0-447f-b891-4000d4a72f18 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:09.235241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb42f-3de0-447f-b891-4000d4a72f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:09.235494 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb42f-3de0-447f-b891-4000d4a72f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:09.237593 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886eb42f-3de0-447f-b891-4000d4a72f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:09.237724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886eb42f-3de0-447f-b891-4000d4a72f18 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:09.247943 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 972/1925] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:09.251823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886eb42f-3de0-447f-b891-4000d4a72f18 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:09.260994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886eb42f-3de0-447f-b891-4000d4a72f18 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:09.265505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b3dfa-5be9-48fe-806f-525882813139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:09.266129 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b3dfa-5be9-48fe-806f-525882813139 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:09.266407 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b3dfa-5be9-48fe-806f-525882813139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:09.266680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b3dfa-5be9-48fe-806f-525882813139 admin admin] PATH_INFO: `/v3/projects/147e3b820981420080e50f450434252c/users/a2507253788d41078455b58db99f86fd/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:09.280810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b3dfa-5be9-48fe-806f-525882813139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=147e3b820981420080e50f450434252c, user_id=a2507253788d41078455b58db99f86fd, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:09.283429 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b3dfa-5be9-48fe-806f-525882813139 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:09.365423 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 954/1926] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:09 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:09.366993 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5373237-7bc7-45b5-baf1-98eac2b0c8cd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:09.377143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5373237-7bc7-45b5-baf1-98eac2b0c8cd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:09.382097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb9819-7074-496f-bcd9-b4a1ed67af9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:09.382552 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb9819-7074-496f-bcd9-b4a1ed67af9e admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:09.386520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb9819-7074-496f-bcd9-b4a1ed67af9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:09.386520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb9819-7074-496f-bcd9-b4a1ed67af9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:09.386520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb9819-7074-496f-bcd9-b4a1ed67af9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:09.386520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb9819-7074-496f-bcd9-b4a1ed67af9e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:09.389919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 973/1927] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:09 2022] PUT /identity/v3/projects/147e3b820981420080e50f450434252c/users/a2507253788d41078455b58db99f86fd/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:09.400825 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 955/1928] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:09.402046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb9819-7074-496f-bcd9-b4a1ed67af9e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:09.402399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd80baf-d78d-41ad-bdf7-1fde71a6cf42 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:09.402678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd80baf-d78d-41ad-bdf7-1fde71a6cf42 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:09.402955 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd80baf-d78d-41ad-bdf7-1fde71a6cf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:09.411679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb9819-7074-496f-bcd9-b4a1ed67af9e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:09.431398 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2dd80baf-d78d-41ad-bdf7-1fde71a6cf42 None None] MFA Rules not processed for user `a2507253788d41078455b58db99f86fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:09.432664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2dd80baf-d78d-41ad-bdf7-1fde71a6cf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:09.466968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d113b3-73c1-4082-bf05-f4f5745e62f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:09.467565 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d113b3-73c1-4082-bf05-f4f5745e62f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:09.467843 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d113b3-73c1-4082-bf05-f4f5745e62f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:09.468112 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d113b3-73c1-4082-bf05-f4f5745e62f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:09.468738 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d113b3-73c1-4082-bf05-f4f5745e62f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:09.470370 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d113b3-73c1-4082-bf05-f4f5745e62f9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:09.480754 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 956/1929] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:09.484910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d113b3-73c1-4082-bf05-f4f5745e62f9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:09.491662 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:09.497008 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 974/1930] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:09.497789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d113b3-73c1-4082-bf05-f4f5745e62f9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:09.502894 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7ab04-5ce3-40d9-be67-6a814b7cba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:09.503764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7ab04-5ce3-40d9-be67-6a814b7cba09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:09.504152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7ab04-5ce3-40d9-be67-6a814b7cba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:09.504894 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7ab04-5ce3-40d9-be67-6a814b7cba09 admin admin] PATH_INFO: `/v3/projects/f91bd562492f41b681a554cc62214e93/users/c58978260e494c4ba2bc87b31b9f65bd/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:09.506873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd80baf-d78d-41ad-bdf7-1fde71a6cf42 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:09.523349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd80baf-d78d-41ad-bdf7-1fde71a6cf42 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:09.528297 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45658ff-0ada-4757-b868-1f76b469785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:09.528911 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45658ff-0ada-4757-b868-1f76b469785b admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:09.529189 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45658ff-0ada-4757-b868-1f76b469785b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:09.529458 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45658ff-0ada-4757-b868-1f76b469785b admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:09.529889 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7ab04-5ce3-40d9-be67-6a814b7cba09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f91bd562492f41b681a554cc62214e93, user_id=c58978260e494c4ba2bc87b31b9f65bd, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:09.530123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45658ff-0ada-4757-b868-1f76b469785b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:09.535707 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45658ff-0ada-4757-b868-1f76b469785b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:09.535841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7ab04-5ce3-40d9-be67-6a814b7cba09 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:09.677545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 957/1931] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:09 2022] PUT /identity/v3/projects/f91bd562492f41b681a554cc62214e93/users/c58978260e494c4ba2bc87b31b9f65bd/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:09.683421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 975/1932] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:09 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:09.687353 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7ab04-5ce3-40d9-be67-6a814b7cba09 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:09.697816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a64444-7d8b-4542-bb89-567646192621 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:09.698443 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a64444-7d8b-4542-bb89-567646192621 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:09.698727 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a64444-7d8b-4542-bb89-567646192621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:09.707784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:09.729230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c6a64444-7d8b-4542-bb89-567646192621 None None] MFA Rules not processed for user `c58978260e494c4ba2bc87b31b9f65bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:09.730490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c6a64444-7d8b-4542-bb89-567646192621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:09.749825 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7ab04-5ce3-40d9-be67-6a814b7cba09 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:09.811489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 976/1933] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:09.816558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a64444-7d8b-4542-bb89-567646192621 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:09.827332 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0249c-93aa-4a53-a115-0ef0ceced12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:09.828090 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0249c-93aa-4a53-a115-0ef0ceced12c admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:09.828468 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0249c-93aa-4a53-a115-0ef0ceced12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:09.828855 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0249c-93aa-4a53-a115-0ef0ceced12c admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:09.829718 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0249c-93aa-4a53-a115-0ef0ceced12c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:09.831927 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0249c-93aa-4a53-a115-0ef0ceced12c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:09.909943 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a64444-7d8b-4542-bb89-567646192621 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:09.923483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76000013-7ce9-454c-b31a-9da270253a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:09.923760 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 958/1934] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:09 2022] POST /identity/v3/users => generated 298 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:09.924660 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76000013-7ce9-454c-b31a-9da270253a73 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:09.925090 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76000013-7ce9-454c-b31a-9da270253a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:09.925559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76000013-7ce9-454c-b31a-9da270253a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:09.926410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76000013-7ce9-454c-b31a-9da270253a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:09.929108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76000013-7ce9-454c-b31a-9da270253a73 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:09.930344 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0249c-93aa-4a53-a115-0ef0ceced12c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:09.941341 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0249c-93aa-4a53-a115-0ef0ceced12c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:09.946766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbd278-835b-4278-a224-cfaf05c8973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:09.947381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbd278-835b-4278-a224-cfaf05c8973e admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:09.953392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbd278-835b-4278-a224-cfaf05c8973e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:09.953392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbd278-835b-4278-a224-cfaf05c8973e admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:09.953392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbd278-835b-4278-a224-cfaf05c8973e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:09.953392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbd278-835b-4278-a224-cfaf05c8973e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:09.960536 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 959/1935] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:09.967511 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbd278-835b-4278-a224-cfaf05c8973e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:09.979850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbd278-835b-4278-a224-cfaf05c8973e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:09.985008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389eede-24fb-483d-a670-ad6dc3d0d037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:09.985669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389eede-24fb-483d-a670-ad6dc3d0d037 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:09.985975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389eede-24fb-483d-a670-ad6dc3d0d037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:09.986246 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389eede-24fb-483d-a670-ad6dc3d0d037 admin admin] PATH_INFO: `/v3/projects/0d1596a4c983486eb64cca6c29c3cdb5/users/6053fe25b20945968d1fa6960af59c88/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:10.001371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389eede-24fb-483d-a670-ad6dc3d0d037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1596a4c983486eb64cca6c29c3cdb5, user_id=6053fe25b20945968d1fa6960af59c88, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:10.006842 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389eede-24fb-483d-a670-ad6dc3d0d037 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:10.055672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 977/1936] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:09 2022] POST /identity/v3/projects => generated 387 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:10.061033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76000013-7ce9-454c-b31a-9da270253a73 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:10.119759 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76000013-7ce9-454c-b31a-9da270253a73 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:10.121248 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 960/1937] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:09 2022] PUT /identity/v3/projects/0d1596a4c983486eb64cca6c29c3cdb5/users/6053fe25b20945968d1fa6960af59c88/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:10.125217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389eede-24fb-483d-a670-ad6dc3d0d037 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:10.175813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f83500-ed64-44d0-86dc-e228262aaa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:10.176360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f83500-ed64-44d0-86dc-e228262aaa99 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:10.176603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f83500-ed64-44d0-86dc-e228262aaa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:10.176875 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f83500-ed64-44d0-86dc-e228262aaa99 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:10.177497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f83500-ed64-44d0-86dc-e228262aaa99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:10.180057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f83500-ed64-44d0-86dc-e228262aaa99 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:10.185831 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389eede-24fb-483d-a670-ad6dc3d0d037 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:10.190705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cf8a4-2444-445b-b8ef-7b9d5dd8bb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:10.191328 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cf8a4-2444-445b-b8ef-7b9d5dd8bb68 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:10.191610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cf8a4-2444-445b-b8ef-7b9d5dd8bb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:10.191883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cf8a4-2444-445b-b8ef-7b9d5dd8bb68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:10.192539 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cf8a4-2444-445b-b8ef-7b9d5dd8bb68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:10.194372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cf8a4-2444-445b-b8ef-7b9d5dd8bb68 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:10.204900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 961/1938] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:10.208965 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cf8a4-2444-445b-b8ef-7b9d5dd8bb68 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:10.218874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cf8a4-2444-445b-b8ef-7b9d5dd8bb68 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:10.223453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58e084-c28f-4802-88b1-90216ca7c501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:10.224018 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58e084-c28f-4802-88b1-90216ca7c501 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:10.224298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58e084-c28f-4802-88b1-90216ca7c501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:10.224787 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58e084-c28f-4802-88b1-90216ca7c501 admin admin] PATH_INFO: `/v3/projects/0d1596a4c983486eb64cca6c29c3cdb5/users/6053fe25b20945968d1fa6960af59c88/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:10.227349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58e084-c28f-4802-88b1-90216ca7c501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1596a4c983486eb64cca6c29c3cdb5, user_id=6053fe25b20945968d1fa6960af59c88, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:10.229970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58e084-c28f-4802-88b1-90216ca7c501 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:10.249568 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 962/1939] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:10 2022] PUT /identity/v3/projects/0d1596a4c983486eb64cca6c29c3cdb5/users/6053fe25b20945968d1fa6960af59c88/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:10.251343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc618e-a09b-4514-bae6-35a6d01c05b3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:10.251627 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc618e-a09b-4514-bae6-35a6d01c05b3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:10.251897 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc618e-a09b-4514-bae6-35a6d01c05b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:10.283981 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-cbcc618e-a09b-4514-bae6-35a6d01c05b3 None None] MFA Rules not processed for user `6053fe25b20945968d1fa6960af59c88`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:10.283981 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cbcc618e-a09b-4514-bae6-35a6d01c05b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:10.318197 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 978/1940] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:10 2022] POST /identity/v3/users => generated 300 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:10.319267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f83500-ed64-44d0-86dc-e228262aaa99 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:10.340789 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f83500-ed64-44d0-86dc-e228262aaa99 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:10.374048 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 963/1941] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:10.386801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc618e-a09b-4514-bae6-35a6d01c05b3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:10.408325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017f209-9581-4389-84e2-d251013a60af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:10.408949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017f209-9581-4389-84e2-d251013a60af admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:10.409224 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017f209-9581-4389-84e2-d251013a60af admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:10.409497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017f209-9581-4389-84e2-d251013a60af admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:10.410357 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017f209-9581-4389-84e2-d251013a60af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:10.412026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017f209-9581-4389-84e2-d251013a60af admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:10.424050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 979/1942] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:10.428441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017f209-9581-4389-84e2-d251013a60af admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:10.438644 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017f209-9581-4389-84e2-d251013a60af admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:10.445285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70563fcc-e55f-4601-bed2-d8c2beba8d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:10.445998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70563fcc-e55f-4601-bed2-d8c2beba8d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:10.446270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70563fcc-e55f-4601-bed2-d8c2beba8d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:10.446538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70563fcc-e55f-4601-bed2-d8c2beba8d8f admin admin] PATH_INFO: `/v3/projects/4a77ede9593e42d7896bbf90af78dbb7/users/949d9ba9318c48188325d7522f1fa915/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:10.453402 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc618e-a09b-4514-bae6-35a6d01c05b3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:10.457356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200050d1-d322-401d-a5e0-d3ad83e73dd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:10.458207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200050d1-d322-401d-a5e0-d3ad83e73dd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:10.458485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200050d1-d322-401d-a5e0-d3ad83e73dd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:10.458752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200050d1-d322-401d-a5e0-d3ad83e73dd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:10.463928 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70563fcc-e55f-4601-bed2-d8c2beba8d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a77ede9593e42d7896bbf90af78dbb7, user_id=949d9ba9318c48188325d7522f1fa915, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:10.468138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70563fcc-e55f-4601-bed2-d8c2beba8d8f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:10.519536 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200050d1-d322-401d-a5e0-d3ad83e73dd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:10.521096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200050d1-d322-401d-a5e0-d3ad83e73dd6 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:10.532191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 964/1943] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:33:10.572304 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 980/1944] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:10 2022] PUT /identity/v3/projects/4a77ede9593e42d7896bbf90af78dbb7/users/949d9ba9318c48188325d7522f1fa915/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:10.573801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200050d1-d322-401d-a5e0-d3ad83e73dd6 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:10.586417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200050d1-d322-401d-a5e0-d3ad83e73dd6 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:10.653097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3794b1-75a4-49eb-8935-f28f5cd8d9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:10.653712 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3794b1-75a4-49eb-8935-f28f5cd8d9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:10.654456 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3794b1-75a4-49eb-8935-f28f5cd8d9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:10.654456 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3794b1-75a4-49eb-8935-f28f5cd8d9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:10.655041 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3794b1-75a4-49eb-8935-f28f5cd8d9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:10.656676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3794b1-75a4-49eb-8935-f28f5cd8d9a7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:10.667811 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 965/1945] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:10.672173 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70563fcc-e55f-4601-bed2-d8c2beba8d8f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:10.687292 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70563fcc-e55f-4601-bed2-d8c2beba8d8f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:10.689500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c9afd-927e-42c7-b5cb-d3f931d0332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:10.690193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c9afd-927e-42c7-b5cb-d3f931d0332d admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:10.690470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c9afd-927e-42c7-b5cb-d3f931d0332d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:10.690742 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c9afd-927e-42c7-b5cb-d3f931d0332d admin admin] PATH_INFO: `/v3/projects/4a77ede9593e42d7896bbf90af78dbb7/users/949d9ba9318c48188325d7522f1fa915/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:10.693442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c9afd-927e-42c7-b5cb-d3f931d0332d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a77ede9593e42d7896bbf90af78dbb7, user_id=949d9ba9318c48188325d7522f1fa915, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:10.696632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c9afd-927e-42c7-b5cb-d3f931d0332d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:10.713781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 981/1946] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:10 2022] PUT /identity/v3/projects/4a77ede9593e42d7896bbf90af78dbb7/users/949d9ba9318c48188325d7522f1fa915/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:10.723756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e0c44-a16d-4702-8617-79f8f7903f6f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:10.724364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e0c44-a16d-4702-8617-79f8f7903f6f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:10.724867 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e0c44-a16d-4702-8617-79f8f7903f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:10.759943 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4d9e0c44-a16d-4702-8617-79f8f7903f6f None None] MFA Rules not processed for user `949d9ba9318c48188325d7522f1fa915`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:10.761178 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4d9e0c44-a16d-4702-8617-79f8f7903f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:10.799197 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e31e7-97a7-4eb9-9199-062985f6676f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:10.799718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e31e7-97a7-4eb9-9199-062985f6676f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:10.808021 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e31e7-97a7-4eb9-9199-062985f6676f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:10.819828 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a03e31e7-97a7-4eb9-9199-062985f6676f None None] MFA Rules not processed for user `24f498153c154f809da405ae3fc73c86`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:10.821038 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a03e31e7-97a7-4eb9-9199-062985f6676f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:10.843394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 966/1947] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:10.858613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e0c44-a16d-4702-8617-79f8f7903f6f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:10.888507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 982/1948] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:10.923670 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e0c44-a16d-4702-8617-79f8f7903f6f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:10.927694 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7db848-079a-48b2-825d-a2feb4696afc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:10.928817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7db848-079a-48b2-825d-a2feb4696afc service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:10.929273 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7db848-079a-48b2-825d-a2feb4696afc service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:10.929423 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7db848-079a-48b2-825d-a2feb4696afc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:10.951468 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7db848-079a-48b2-825d-a2feb4696afc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:10.951468 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7db848-079a-48b2-825d-a2feb4696afc service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:10.957051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 967/1949] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:33:11.233465 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:11.414980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:12.763598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e31e7-97a7-4eb9-9199-062985f6676f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:12.774132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e31e7-97a7-4eb9-9199-062985f6676f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:12.777870 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0ee7a-0132-492e-a9ec-be6e253ba2e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:12.778678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0ee7a-0132-492e-a9ec-be6e253ba2e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:12.778959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0ee7a-0132-492e-a9ec-be6e253ba2e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:12.779234 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0ee7a-0132-492e-a9ec-be6e253ba2e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:12.839894 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0ee7a-0132-492e-a9ec-be6e253ba2e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:12.841438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0ee7a-0132-492e-a9ec-be6e253ba2e1 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:12.851391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 983/1950] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:13.939852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:14.091046 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:17.133614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:18.042231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:19.625423 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7db848-079a-48b2-825d-a2feb4696afc service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:19.633849 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7db848-079a-48b2-825d-a2feb4696afc service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:19.637449 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7da573-d489-4f79-aba7-e842b7b8acd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:19.638069 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7da573-d489-4f79-aba7-e842b7b8acd3 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:19.638346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7da573-d489-4f79-aba7-e842b7b8acd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:19.638617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7da573-d489-4f79-aba7-e842b7b8acd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:19.706388 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7da573-d489-4f79-aba7-e842b7b8acd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:19.708087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7da573-d489-4f79-aba7-e842b7b8acd3 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:19.718399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 968/1951] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:33:19.808128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:20.354773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0ee7a-0132-492e-a9ec-be6e253ba2e1 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:20.356233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4ca0ee7a-0132-492e-a9ec-be6e253ba2e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:20.368709 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0ee7a-0132-492e-a9ec-be6e253ba2e1 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:20.372498 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5add82-9b13-4ffe-bd9c-74bbb8a31663 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:20.373375 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5add82-9b13-4ffe-bd9c-74bbb8a31663 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:20.373482 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5add82-9b13-4ffe-bd9c-74bbb8a31663 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:20.373674 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5add82-9b13-4ffe-bd9c-74bbb8a31663 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:20.441948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:20.445378 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5add82-9b13-4ffe-bd9c-74bbb8a31663 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:20.447800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5add82-9b13-4ffe-bd9c-74bbb8a31663 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:20.457502 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 984/1952] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:21.082036 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:21.398123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d2099-bdb0-4149-b7ea-c06e965def50 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:21.398653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d2099-bdb0-4149-b7ea-c06e965def50 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:21.398653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d2099-bdb0-4149-b7ea-c06e965def50 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:21.400012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 969/1953] 10.222.0.82 () {54 vars in 921 bytes} [Fri Sep 23 15:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:33:21.411949 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc88cc-d69c-4054-85e4-234a6085b383 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:21.412267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc88cc-d69c-4054-85e4-234a6085b383 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:21.412507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc88cc-d69c-4054-85e4-234a6085b383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:21.433860 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5ffc88cc-d69c-4054-85e4-234a6085b383 None None] MFA Rules not processed for user `a25109eeb1b34b3689b10e3f7c44a6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:21.435035 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5ffc88cc-d69c-4054-85e4-234a6085b383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:21.522557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 985/1954] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Sep 23 15:33:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:21.542578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d2099-bdb0-4149-b7ea-c06e965def50 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:21.544251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b26d2099-bdb0-4149-b7ea-c06e965def50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:21.561032 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d2099-bdb0-4149-b7ea-c06e965def50 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:21.570416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a231a30-145d-45d9-831e-9ac9980e8eda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25109eeb1b34b3689b10e3f7c44a6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:21.570416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a231a30-145d-45d9-831e-9ac9980e8eda service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:21.570416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a231a30-145d-45d9-831e-9ac9980e8eda service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:21.570416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a231a30-145d-45d9-831e-9ac9980e8eda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:21.578036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a231a30-145d-45d9-831e-9ac9980e8eda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:21.579637 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a231a30-145d-45d9-831e-9ac9980e8eda service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:21.590735 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 970/1955] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:21.662799 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc88cc-d69c-4054-85e4-234a6085b383 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:21.664186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5ffc88cc-d69c-4054-85e4-234a6085b383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:21.732219 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc88cc-d69c-4054-85e4-234a6085b383 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:21.736889 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f2910-8929-4e70-897f-c351918c42aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:21.737518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f2910-8929-4e70-897f-c351918c42aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:21.737834 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f2910-8929-4e70-897f-c351918c42aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:21.738137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f2910-8929-4e70-897f-c351918c42aa admin admin] PATH_INFO: `/v3/users/21bce78eea1f41dea1e8cf71d12612b7` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:21.739272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f2910-8929-4e70-897f-c351918c42aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=21bce78eea1f41dea1e8cf71d12612b7)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:21.741410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f2910-8929-4e70-897f-c351918c42aa admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:21.924212 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-de0f2910-8929-4e70-897f-c351918c42aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21bce78eea1f41dea1e8cf71d12612b7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:21.936876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-de0f2910-8929-4e70-897f-c351918c42aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21bce78eea1f41dea1e8cf71d12612b7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:21.944280 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-de0f2910-8929-4e70-897f-c351918c42aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21bce78eea1f41dea1e8cf71d12612b7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:21.947355 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-de0f2910-8929-4e70-897f-c351918c42aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21bce78eea1f41dea1e8cf71d12612b7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:22.024304 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-de0f2910-8929-4e70-897f-c351918c42aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21bce78eea1f41dea1e8cf71d12612b7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:22.030721 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 986/1956] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:21 2022] DELETE /identity/v3/users/21bce78eea1f41dea1e8cf71d12612b7 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:22.313232 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a231a30-145d-45d9-831e-9ac9980e8eda service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:22.328551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a231a30-145d-45d9-831e-9ac9980e8eda service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:22.410633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b758fc2-0a94-4344-a496-5cf0bb36459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:22.411399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b758fc2-0a94-4344-a496-5cf0bb36459b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:22.411678 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b758fc2-0a94-4344-a496-5cf0bb36459b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:22.412508 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b758fc2-0a94-4344-a496-5cf0bb36459b admin admin] PATH_INFO: `/v3/projects/bb7554c7413148e49cc7048900b7ecba` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:22.413700 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b758fc2-0a94-4344-a496-5cf0bb36459b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb7554c7413148e49cc7048900b7ecba)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:22.416178 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b758fc2-0a94-4344-a496-5cf0bb36459b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:22.579372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-9b758fc2-0a94-4344-a496-5cf0bb36459b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb7554c7413148e49cc7048900b7ecba', 'request_id': 'req-9b758fc2-0a94-4344-a496-5cf0bb36459b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:22.689133 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:22.694404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-9b758fc2-0a94-4344-a496-5cf0bb36459b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb7554c7413148e49cc7048900b7ecba', 'request_id': 'req-9b758fc2-0a94-4344-a496-5cf0bb36459b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:22.701202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-9b758fc2-0a94-4344-a496-5cf0bb36459b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb7554c7413148e49cc7048900b7ecba', 'request_id': 'req-9b758fc2-0a94-4344-a496-5cf0bb36459b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:22.733265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-9b758fc2-0a94-4344-a496-5cf0bb36459b admin admin] The token cache is being invalidate because project bb7554c7413148e49cc7048900b7ecba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:22.733565 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-9b758fc2-0a94-4344-a496-5cf0bb36459b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:22.734379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-9b758fc2-0a94-4344-a496-5cf0bb36459b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:22.750685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 971/1957] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:22 2022] DELETE /identity/v3/projects/bb7554c7413148e49cc7048900b7ecba => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:22.751006 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387a13d-69ad-4888-991c-1f3ed81ba65c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:22.751006 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387a13d-69ad-4888-991c-1f3ed81ba65c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:22.751006 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387a13d-69ad-4888-991c-1f3ed81ba65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:22.766216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2387a13d-69ad-4888-991c-1f3ed81ba65c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:22.767687 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2387a13d-69ad-4888-991c-1f3ed81ba65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:22.834890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 987/1958] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:22.842624 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581441b4-eee9-4990-992d-5cd5e33737a3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:22.842906 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581441b4-eee9-4990-992d-5cd5e33737a3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:22.843182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581441b4-eee9-4990-992d-5cd5e33737a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:22.862282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-581441b4-eee9-4990-992d-5cd5e33737a3 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:22.863511 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-581441b4-eee9-4990-992d-5cd5e33737a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:22.871468 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 972/1959] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:22.875694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387a13d-69ad-4888-991c-1f3ed81ba65c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:22.885755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387a13d-69ad-4888-991c-1f3ed81ba65c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:22.890642 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0d82e-e940-46cd-b332-134d362e7205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:22.891198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0d82e-e940-46cd-b332-134d362e7205 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:22.891476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0d82e-e940-46cd-b332-134d362e7205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:22.891746 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0d82e-e940-46cd-b332-134d362e7205 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:22.892395 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0d82e-e940-46cd-b332-134d362e7205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:33:22.892697 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0d82e-e940-46cd-b332-134d362e7205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:22.894362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0d82e-e940-46cd-b332-134d362e7205 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:22.907016 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 988/1960] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:33:22.911346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581441b4-eee9-4990-992d-5cd5e33737a3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:22.920583 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581441b4-eee9-4990-992d-5cd5e33737a3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:22.926093 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ed54b-223b-44bf-b6c2-8eef03d25681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:22.926878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ed54b-223b-44bf-b6c2-8eef03d25681 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:22.927179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ed54b-223b-44bf-b6c2-8eef03d25681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:22.928045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ed54b-223b-44bf-b6c2-8eef03d25681 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:22.928663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ed54b-223b-44bf-b6c2-8eef03d25681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:22.930629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ed54b-223b-44bf-b6c2-8eef03d25681 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:23.041876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:23.122360 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 973/1961] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:22 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:23.126265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0d82e-e940-46cd-b332-134d362e7205 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:23.136736 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0d82e-e940-46cd-b332-134d362e7205 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:23.196607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ba0b3-beed-4ece-9657-3633e8f3689e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:23.197217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ba0b3-beed-4ece-9657-3633e8f3689e admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:23.197488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ba0b3-beed-4ece-9657-3633e8f3689e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:23.197780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ba0b3-beed-4ece-9657-3633e8f3689e admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:23.198416 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ba0b3-beed-4ece-9657-3633e8f3689e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:23.200312 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ba0b3-beed-4ece-9657-3633e8f3689e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:23.350926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 989/1962] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:23 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:23.355304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ed54b-223b-44bf-b6c2-8eef03d25681 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:23.365441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ed54b-223b-44bf-b6c2-8eef03d25681 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:23.370774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087d806-2f46-4642-80b3-ca4b46e66f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:23.371393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087d806-2f46-4642-80b3-ca4b46e66f3e admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:23.371677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087d806-2f46-4642-80b3-ca4b46e66f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:23.371953 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087d806-2f46-4642-80b3-ca4b46e66f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:23.372595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087d806-2f46-4642-80b3-ca4b46e66f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:23.374206 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087d806-2f46-4642-80b3-ca4b46e66f3e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:23.383915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 974/1963] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:23.387922 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ba0b3-beed-4ece-9657-3633e8f3689e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:23.398229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ba0b3-beed-4ece-9657-3633e8f3689e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:23.402932 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04f2ce-6971-484d-a039-492015c0d558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:23.403522 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04f2ce-6971-484d-a039-492015c0d558 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:23.403798 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04f2ce-6971-484d-a039-492015c0d558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:23.404069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04f2ce-6971-484d-a039-492015c0d558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:23.404700 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04f2ce-6971-484d-a039-492015c0d558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:23.406336 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04f2ce-6971-484d-a039-492015c0d558 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:23.417183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 990/1964] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:23.421248 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087d806-2f46-4642-80b3-ca4b46e66f3e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:23.431730 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087d806-2f46-4642-80b3-ca4b46e66f3e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:23.436534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade631f-0d96-4414-8ae6-f6b93872df18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:23.437179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade631f-0d96-4414-8ae6-f6b93872df18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:23.437456 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade631f-0d96-4414-8ae6-f6b93872df18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:23.437750 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade631f-0d96-4414-8ae6-f6b93872df18 admin admin] PATH_INFO: `/v3/projects/cb40d72fc0fd4da397bfa8318ac56271/users/d98d8b988db843579e03e9b7e2410298/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:23.452603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade631f-0d96-4414-8ae6-f6b93872df18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb40d72fc0fd4da397bfa8318ac56271, user_id=d98d8b988db843579e03e9b7e2410298, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:23.455292 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade631f-0d96-4414-8ae6-f6b93872df18 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:23.648527 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 975/1965] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:23 2022] PUT /identity/v3/projects/cb40d72fc0fd4da397bfa8318ac56271/users/d98d8b988db843579e03e9b7e2410298/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:23.658196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26e4fc-d369-4e4e-b231-abe35ac6f396 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:23.658485 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26e4fc-d369-4e4e-b231-abe35ac6f396 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:23.658761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26e4fc-d369-4e4e-b231-abe35ac6f396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:23.687382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5a26e4fc-d369-4e4e-b231-abe35ac6f396 None None] MFA Rules not processed for user `d98d8b988db843579e03e9b7e2410298`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:23.688595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5a26e4fc-d369-4e4e-b231-abe35ac6f396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:23.753248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 991/1966] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:23.765705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade631f-0d96-4414-8ae6-f6b93872df18 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:23.767628 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fade631f-0d96-4414-8ae6-f6b93872df18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:23.880550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade631f-0d96-4414-8ae6-f6b93872df18 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:23.891297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966465e-d3a8-44dd-a453-d593f27f0c75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:23.892071 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966465e-d3a8-44dd-a453-d593f27f0c75 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:23.892351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966465e-d3a8-44dd-a453-d593f27f0c75 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:23.892621 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966465e-d3a8-44dd-a453-d593f27f0c75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:23.902434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966465e-d3a8-44dd-a453-d593f27f0c75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:23.904111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966465e-d3a8-44dd-a453-d593f27f0c75 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:23.914960 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 976/1967] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:25.501293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26e4fc-d369-4e4e-b231-abe35ac6f396 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:25.503574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5a26e4fc-d369-4e4e-b231-abe35ac6f396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:25.566330 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26e4fc-d369-4e4e-b231-abe35ac6f396 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:25.571501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45859c-026d-4818-b461-b9a281e46446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:25.572122 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45859c-026d-4818-b461-b9a281e46446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:25.572398 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45859c-026d-4818-b461-b9a281e46446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:25.572668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45859c-026d-4818-b461-b9a281e46446 admin admin] PATH_INFO: `/v3/users/3b3c21e5ef3e4eddab4c8278d7df4702` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:25.573783 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45859c-026d-4818-b461-b9a281e46446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b3c21e5ef3e4eddab4c8278d7df4702)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:25.575680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45859c-026d-4818-b461-b9a281e46446 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:25.618752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:25.838149 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3f45859c-026d-4818-b461-b9a281e46446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b3c21e5ef3e4eddab4c8278d7df4702'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:25.849967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3f45859c-026d-4818-b461-b9a281e46446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b3c21e5ef3e4eddab4c8278d7df4702'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:25.856717 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3f45859c-026d-4818-b461-b9a281e46446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b3c21e5ef3e4eddab4c8278d7df4702'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:25.857392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3f45859c-026d-4818-b461-b9a281e46446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b3c21e5ef3e4eddab4c8278d7df4702'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:25.892874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:25.988760 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3f45859c-026d-4818-b461-b9a281e46446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b3c21e5ef3e4eddab4c8278d7df4702'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:25.995590 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 992/1968] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:25 2022] DELETE /identity/v3/users/3b3c21e5ef3e4eddab4c8278d7df4702 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:26.000191 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2ba94-45f8-4174-9878-9ec419751d0c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:26.000500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2ba94-45f8-4174-9878-9ec419751d0c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:26.000777 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2ba94-45f8-4174-9878-9ec419751d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:26.019905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d2e2ba94-45f8-4174-9878-9ec419751d0c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:26.021091 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d2e2ba94-45f8-4174-9878-9ec419751d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:26.077386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 977/1969] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:26.087402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45859c-026d-4818-b461-b9a281e46446 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:26.090404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3f45859c-026d-4818-b461-b9a281e46446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:26.146171 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45859c-026d-4818-b461-b9a281e46446 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:26.151230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e73bd-1403-4f13-b9a5-2b68608e7766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:26.151595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e73bd-1403-4f13-b9a5-2b68608e7766 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:26.151871 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e73bd-1403-4f13-b9a5-2b68608e7766 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:26.152259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e73bd-1403-4f13-b9a5-2b68608e7766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:26.161628 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e73bd-1403-4f13-b9a5-2b68608e7766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:26.163112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e73bd-1403-4f13-b9a5-2b68608e7766 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:26.172389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 993/1970] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:26.711950 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2ba94-45f8-4174-9878-9ec419751d0c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:26.714022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d2e2ba94-45f8-4174-9878-9ec419751d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:26.734987 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2ba94-45f8-4174-9878-9ec419751d0c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:26.740188 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:26.740729 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:26.741159 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:26.741434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c admin admin] PATH_INFO: `/v3/projects/a5d7768e2bf74e728e122f553e7a9cf9` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:26.742680 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5d7768e2bf74e728e122f553e7a9cf9)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:26.744608 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:26.870687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5d7768e2bf74e728e122f553e7a9cf9', 'request_id': 'req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:26.955738 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5d7768e2bf74e728e122f553e7a9cf9', 'request_id': 'req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:26.962404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5d7768e2bf74e728e122f553e7a9cf9', 'request_id': 'req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:26.974866 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c admin admin] The token cache is being invalidate because project a5d7768e2bf74e728e122f553e7a9cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:26.975169 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:26.975868 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:26.977438 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 978/1971] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:26 2022] DELETE /identity/v3/projects/a5d7768e2bf74e728e122f553e7a9cf9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:26.981398 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e73bd-1403-4f13-b9a5-2b68608e7766 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:26.991149 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e73bd-1403-4f13-b9a5-2b68608e7766 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:27.050305 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4466d21-2566-4518-a879-bcc0b9f6594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:27.050928 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4466d21-2566-4518-a879-bcc0b9f6594a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:27.051208 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4466d21-2566-4518-a879-bcc0b9f6594a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:27.051484 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4466d21-2566-4518-a879-bcc0b9f6594a admin admin] PATH_INFO: `/v3/users/c58978260e494c4ba2bc87b31b9f65bd` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:27.052600 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4466d21-2566-4518-a879-bcc0b9f6594a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c58978260e494c4ba2bc87b31b9f65bd)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:27.054559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4466d21-2566-4518-a879-bcc0b9f6594a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:27.410106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f4466d21-2566-4518-a879-bcc0b9f6594a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c58978260e494c4ba2bc87b31b9f65bd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:27.424004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f4466d21-2566-4518-a879-bcc0b9f6594a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c58978260e494c4ba2bc87b31b9f65bd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:27.432159 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f4466d21-2566-4518-a879-bcc0b9f6594a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c58978260e494c4ba2bc87b31b9f65bd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:27.432907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f4466d21-2566-4518-a879-bcc0b9f6594a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c58978260e494c4ba2bc87b31b9f65bd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:27.546841 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f4466d21-2566-4518-a879-bcc0b9f6594a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c58978260e494c4ba2bc87b31b9f65bd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:27.547185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:27.547863 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:27.549077 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 994/1972] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:26 2022] DELETE /identity/v3/users/c58978260e494c4ba2bc87b31b9f65bd => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:27.563258 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762c3e3-43d7-4cc1-9d11-03503d67ad4c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:27.623842 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b354c-6d85-44a1-bc32-a947eac98051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:27.624685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b354c-6d85-44a1-bc32-a947eac98051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:27.624973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b354c-6d85-44a1-bc32-a947eac98051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:27.625245 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b354c-6d85-44a1-bc32-a947eac98051 admin admin] PATH_INFO: `/v3/users/a2507253788d41078455b58db99f86fd` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:27.626571 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b354c-6d85-44a1-bc32-a947eac98051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2507253788d41078455b58db99f86fd)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:27.628950 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b354c-6d85-44a1-bc32-a947eac98051 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:27.847236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4466d21-2566-4518-a879-bcc0b9f6594a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:27.847614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f4466d21-2566-4518-a879-bcc0b9f6594a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:27.850010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:27.862670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4466d21-2566-4518-a879-bcc0b9f6594a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:27.867582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923c454-cbb2-4ad5-9d7b-9cd68c3e435b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:27.868328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923c454-cbb2-4ad5-9d7b-9cd68c3e435b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:27.868676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923c454-cbb2-4ad5-9d7b-9cd68c3e435b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:27.869154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923c454-cbb2-4ad5-9d7b-9cd68c3e435b admin admin] PATH_INFO: `/v3/users/d98d8b988db843579e03e9b7e2410298` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:27.870517 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923c454-cbb2-4ad5-9d7b-9cd68c3e435b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d98d8b988db843579e03e9b7e2410298)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:27.872541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923c454-cbb2-4ad5-9d7b-9cd68c3e435b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:28.004608 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6a0b354c-6d85-44a1-bc32-a947eac98051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2507253788d41078455b58db99f86fd'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.017782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6a0b354c-6d85-44a1-bc32-a947eac98051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2507253788d41078455b58db99f86fd'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.025846 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6a0b354c-6d85-44a1-bc32-a947eac98051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2507253788d41078455b58db99f86fd'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.026632 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6a0b354c-6d85-44a1-bc32-a947eac98051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2507253788d41078455b58db99f86fd'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.167340 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6a0b354c-6d85-44a1-bc32-a947eac98051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2507253788d41078455b58db99f86fd'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.178222 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 979/1973] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:27 2022] DELETE /identity/v3/users/a2507253788d41078455b58db99f86fd => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:28.178222 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b354c-6d85-44a1-bc32-a947eac98051 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:28.178222 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6a0b354c-6d85-44a1-bc32-a947eac98051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:28.191699 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7923c454-cbb2-4ad5-9d7b-9cd68c3e435b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98d8b988db843579e03e9b7e2410298'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.206283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7923c454-cbb2-4ad5-9d7b-9cd68c3e435b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98d8b988db843579e03e9b7e2410298'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.213827 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7923c454-cbb2-4ad5-9d7b-9cd68c3e435b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98d8b988db843579e03e9b7e2410298'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.214194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7923c454-cbb2-4ad5-9d7b-9cd68c3e435b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98d8b988db843579e03e9b7e2410298'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.245330 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b354c-6d85-44a1-bc32-a947eac98051 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:28.249833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74046121-0f09-4b91-8414-c4164e2e686f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:28.250452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74046121-0f09-4b91-8414-c4164e2e686f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:28.250727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74046121-0f09-4b91-8414-c4164e2e686f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:28.250995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74046121-0f09-4b91-8414-c4164e2e686f admin admin] PATH_INFO: `/v3/projects/f91bd562492f41b681a554cc62214e93` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:28.252133 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74046121-0f09-4b91-8414-c4164e2e686f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f91bd562492f41b681a554cc62214e93)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:28.254037 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74046121-0f09-4b91-8414-c4164e2e686f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:28.321612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7923c454-cbb2-4ad5-9d7b-9cd68c3e435b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98d8b988db843579e03e9b7e2410298'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.328075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 995/1974] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:27 2022] DELETE /identity/v3/users/d98d8b988db843579e03e9b7e2410298 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:28.331153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3903-1130-4ff5-a9f5-86ac2ca72db5 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:28.331153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3903-1130-4ff5-a9f5-86ac2ca72db5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:28.331153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3903-1130-4ff5-a9f5-86ac2ca72db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:28.348479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3fbe3903-1130-4ff5-a9f5-86ac2ca72db5 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:28.349661 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3fbe3903-1130-4ff5-a9f5-86ac2ca72db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:28.411677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-74046121-0f09-4b91-8414-c4164e2e686f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f91bd562492f41b681a554cc62214e93', 'request_id': 'req-74046121-0f09-4b91-8414-c4164e2e686f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.412287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 996/1975] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:28.413545 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9c593-46cc-4af8-b381-f9d048852a43 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:28.413852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9c593-46cc-4af8-b381-f9d048852a43 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:28.414126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9c593-46cc-4af8-b381-f9d048852a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:28.434970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8dc9c593-46cc-4af8-b381-f9d048852a43 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:28.436153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8dc9c593-46cc-4af8-b381-f9d048852a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:28.494434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 997/1976] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:28.495436 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9c593-46cc-4af8-b381-f9d048852a43 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:28.496651 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8dc9c593-46cc-4af8-b381-f9d048852a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:28.518053 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-74046121-0f09-4b91-8414-c4164e2e686f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f91bd562492f41b681a554cc62214e93', 'request_id': 'req-74046121-0f09-4b91-8414-c4164e2e686f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.522795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-74046121-0f09-4b91-8414-c4164e2e686f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f91bd562492f41b681a554cc62214e93', 'request_id': 'req-74046121-0f09-4b91-8414-c4164e2e686f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.534839 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-74046121-0f09-4b91-8414-c4164e2e686f admin admin] The token cache is being invalidate because project f91bd562492f41b681a554cc62214e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:28.535126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-74046121-0f09-4b91-8414-c4164e2e686f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.535788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-74046121-0f09-4b91-8414-c4164e2e686f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.537521 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 980/1977] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:28 2022] DELETE /identity/v3/projects/f91bd562492f41b681a554cc62214e93 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:28.541018 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74046121-0f09-4b91-8414-c4164e2e686f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:28.542431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-74046121-0f09-4b91-8414-c4164e2e686f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:28.561868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9c593-46cc-4af8-b381-f9d048852a43 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:28.566233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a05e66-2748-4c94-bc95-34918c3774e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:28.566915 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a05e66-2748-4c94-bc95-34918c3774e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:28.567219 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a05e66-2748-4c94-bc95-34918c3774e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:28.567492 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a05e66-2748-4c94-bc95-34918c3774e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:28.570603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-04a05e66-2748-4c94-bc95-34918c3774e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:28.596736 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a05e66-2748-4c94-bc95-34918c3774e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:28.598385 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a05e66-2748-4c94-bc95-34918c3774e7 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:28.605615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74046121-0f09-4b91-8414-c4164e2e686f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:28.609092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759fa32-3fe6-4010-a578-ed64d66ef7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:28.611556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 998/1978] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:28.611717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759fa32-3fe6-4010-a578-ed64d66ef7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:28.611717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759fa32-3fe6-4010-a578-ed64d66ef7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:28.611885 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a05e66-2748-4c94-bc95-34918c3774e7 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:28.611967 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759fa32-3fe6-4010-a578-ed64d66ef7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:28.612055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-04a05e66-2748-4c94-bc95-34918c3774e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:28.612150 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c759fa32-3fe6-4010-a578-ed64d66ef7c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:28.623662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a05e66-2748-4c94-bc95-34918c3774e7 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:28.624992 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759fa32-3fe6-4010-a578-ed64d66ef7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:28.626537 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759fa32-3fe6-4010-a578-ed64d66ef7c2 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:28.629265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418480a-92a5-45cb-883d-18c178d3f0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:28.630147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418480a-92a5-45cb-883d-18c178d3f0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:28.630547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418480a-92a5-45cb-883d-18c178d3f0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:28.630899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418480a-92a5-45cb-883d-18c178d3f0af admin admin] PATH_INFO: `/v3/users/949d9ba9318c48188325d7522f1fa915` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:28.632891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418480a-92a5-45cb-883d-18c178d3f0af admin admin] RBAC: Authorizing `identity:delete_user(user_id=949d9ba9318c48188325d7522f1fa915)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:28.634906 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418480a-92a5-45cb-883d-18c178d3f0af admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:28.637452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 981/1979] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:28.908146 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7418480a-92a5-45cb-883d-18c178d3f0af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949d9ba9318c48188325d7522f1fa915'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.930605 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7418480a-92a5-45cb-883d-18c178d3f0af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949d9ba9318c48188325d7522f1fa915'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.939214 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7418480a-92a5-45cb-883d-18c178d3f0af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949d9ba9318c48188325d7522f1fa915'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.940128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7418480a-92a5-45cb-883d-18c178d3f0af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949d9ba9318c48188325d7522f1fa915'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:28.984924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:29.018821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7418480a-92a5-45cb-883d-18c178d3f0af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949d9ba9318c48188325d7522f1fa915'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:29.029661 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 999/1980] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:28 2022] DELETE /identity/v3/users/949d9ba9318c48188325d7522f1fa915 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:29.208423 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759fa32-3fe6-4010-a578-ed64d66ef7c2 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:29.209899 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c759fa32-3fe6-4010-a578-ed64d66ef7c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:29.227934 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759fa32-3fe6-4010-a578-ed64d66ef7c2 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:29.238886 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418480a-92a5-45cb-883d-18c178d3f0af admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:29.241468 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7418480a-92a5-45cb-883d-18c178d3f0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:29.304769 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59375a2d-c0f0-4080-87b2-6da308e9148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:29.305469 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59375a2d-c0f0-4080-87b2-6da308e9148e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:29.305746 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59375a2d-c0f0-4080-87b2-6da308e9148e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:29.306055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59375a2d-c0f0-4080-87b2-6da308e9148e admin admin] PATH_INFO: `/v3/projects/147e3b820981420080e50f450434252c` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:29.307188 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59375a2d-c0f0-4080-87b2-6da308e9148e admin admin] RBAC: Authorizing `identity:delete_project(project_id=147e3b820981420080e50f450434252c)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:29.309114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59375a2d-c0f0-4080-87b2-6da308e9148e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:29.319277 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418480a-92a5-45cb-883d-18c178d3f0af admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:29.324255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95f864-3abc-4832-9f3f-52464633c301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:29.324895 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95f864-3abc-4832-9f3f-52464633c301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:29.325174 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95f864-3abc-4832-9f3f-52464633c301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:29.325453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95f864-3abc-4832-9f3f-52464633c301 admin admin] PATH_INFO: `/v3/projects/cb40d72fc0fd4da397bfa8318ac56271` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:29.326697 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95f864-3abc-4832-9f3f-52464633c301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb40d72fc0fd4da397bfa8318ac56271)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:29.328642 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95f864-3abc-4832-9f3f-52464633c301 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:29.441577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:29.471567 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-59375a2d-c0f0-4080-87b2-6da308e9148e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '147e3b820981420080e50f450434252c', 'request_id': 'req-59375a2d-c0f0-4080-87b2-6da308e9148e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:29.471743 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9d95f864-3abc-4832-9f3f-52464633c301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb40d72fc0fd4da397bfa8318ac56271', 'request_id': 'req-9d95f864-3abc-4832-9f3f-52464633c301'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:29.612719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9d95f864-3abc-4832-9f3f-52464633c301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb40d72fc0fd4da397bfa8318ac56271', 'request_id': 'req-9d95f864-3abc-4832-9f3f-52464633c301'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:29.620167 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9d95f864-3abc-4832-9f3f-52464633c301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb40d72fc0fd4da397bfa8318ac56271', 'request_id': 'req-9d95f864-3abc-4832-9f3f-52464633c301'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:29.630858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9d95f864-3abc-4832-9f3f-52464633c301 admin admin] The token cache is being invalidate because project cb40d72fc0fd4da397bfa8318ac56271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:29.631152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9d95f864-3abc-4832-9f3f-52464633c301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:29.631798 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9d95f864-3abc-4832-9f3f-52464633c301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:29.633509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1000/1981] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:29 2022] DELETE /identity/v3/projects/cb40d72fc0fd4da397bfa8318ac56271 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:29.638001 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6261e-2066-4fdb-aace-bc94670563a5 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:29.638291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6261e-2066-4fdb-aace-bc94670563a5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:29.638585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6261e-2066-4fdb-aace-bc94670563a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:29.658787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-96b6261e-2066-4fdb-aace-bc94670563a5 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:29.660025 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-96b6261e-2066-4fdb-aace-bc94670563a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:29.704241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-59375a2d-c0f0-4080-87b2-6da308e9148e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '147e3b820981420080e50f450434252c', 'request_id': 'req-59375a2d-c0f0-4080-87b2-6da308e9148e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:29.712052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-59375a2d-c0f0-4080-87b2-6da308e9148e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '147e3b820981420080e50f450434252c', 'request_id': 'req-59375a2d-c0f0-4080-87b2-6da308e9148e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:29.729879 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-59375a2d-c0f0-4080-87b2-6da308e9148e admin admin] The token cache is being invalidate because project 147e3b820981420080e50f450434252c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:29.730449 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-59375a2d-c0f0-4080-87b2-6da308e9148e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:29.731157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-59375a2d-c0f0-4080-87b2-6da308e9148e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:29.732932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 982/1982] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:29 2022] DELETE /identity/v3/projects/147e3b820981420080e50f450434252c => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:29.733905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59375a2d-c0f0-4080-87b2-6da308e9148e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:29.735244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-59375a2d-c0f0-4080-87b2-6da308e9148e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:29.738111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1001/1983] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:29.746668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6261e-2066-4fdb-aace-bc94670563a5 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:29.748134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-96b6261e-2066-4fdb-aace-bc94670563a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:29.749303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59375a2d-c0f0-4080-87b2-6da308e9148e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:29.754417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f98664-9464-424e-9b35-18b6b401164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:29.755334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f98664-9464-424e-9b35-18b6b401164f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:29.755752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f98664-9464-424e-9b35-18b6b401164f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:29.756835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f98664-9464-424e-9b35-18b6b401164f admin admin] PATH_INFO: `/v3/projects/4a77ede9593e42d7896bbf90af78dbb7` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:29.762505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f98664-9464-424e-9b35-18b6b401164f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a77ede9593e42d7896bbf90af78dbb7)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:29.764080 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6261e-2066-4fdb-aace-bc94670563a5 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:29.764899 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f98664-9464-424e-9b35-18b6b401164f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:29.769248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960aad2-fc6a-49bf-b945-c2ba939989fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:29.770006 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960aad2-fc6a-49bf-b945-c2ba939989fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:29.770436 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960aad2-fc6a-49bf-b945-c2ba939989fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:29.770705 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960aad2-fc6a-49bf-b945-c2ba939989fe admin admin] PATH_INFO: `/v3/users/6053fe25b20945968d1fa6960af59c88` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:29.772912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960aad2-fc6a-49bf-b945-c2ba939989fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6053fe25b20945968d1fa6960af59c88)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:29.775011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960aad2-fc6a-49bf-b945-c2ba939989fe admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:29.905071 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d5f98664-9464-424e-9b35-18b6b401164f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a77ede9593e42d7896bbf90af78dbb7', 'request_id': 'req-d5f98664-9464-424e-9b35-18b6b401164f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:30.337328 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d5f98664-9464-424e-9b35-18b6b401164f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a77ede9593e42d7896bbf90af78dbb7', 'request_id': 'req-d5f98664-9464-424e-9b35-18b6b401164f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:30.343243 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d5f98664-9464-424e-9b35-18b6b401164f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a77ede9593e42d7896bbf90af78dbb7', 'request_id': 'req-d5f98664-9464-424e-9b35-18b6b401164f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:30.354525 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d5f98664-9464-424e-9b35-18b6b401164f admin admin] The token cache is being invalidate because project 4a77ede9593e42d7896bbf90af78dbb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:30.354814 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d5f98664-9464-424e-9b35-18b6b401164f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:30.355462 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d5f98664-9464-424e-9b35-18b6b401164f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:30.356952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 983/1984] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:29 2022] DELETE /identity/v3/projects/4a77ede9593e42d7896bbf90af78dbb7 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:30.358241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525747e8-e4e8-49c7-96d6-4e9125da4024 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:30.358519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525747e8-e4e8-49c7-96d6-4e9125da4024 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:30.358793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525747e8-e4e8-49c7-96d6-4e9125da4024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:30.378031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-525747e8-e4e8-49c7-96d6-4e9125da4024 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:30.379242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-525747e8-e4e8-49c7-96d6-4e9125da4024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:30.438271 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 984/1985] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:30.439834 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aa7c8-5615-4dba-ad17-8b62cdbe4b19 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:30.462478 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aa7c8-5615-4dba-ad17-8b62cdbe4b19 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:30.462478 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aa7c8-5615-4dba-ad17-8b62cdbe4b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:30.462672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c960aad2-fc6a-49bf-b945-c2ba939989fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6053fe25b20945968d1fa6960af59c88'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:30.463137 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-827aa7c8-5615-4dba-ad17-8b62cdbe4b19 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:30.463137 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-827aa7c8-5615-4dba-ad17-8b62cdbe4b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:30.465471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c960aad2-fc6a-49bf-b945-c2ba939989fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6053fe25b20945968d1fa6960af59c88'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:30.471448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 985/1986] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:30.472264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aa7c8-5615-4dba-ad17-8b62cdbe4b19 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:30.478760 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c960aad2-fc6a-49bf-b945-c2ba939989fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6053fe25b20945968d1fa6960af59c88'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:30.479551 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c960aad2-fc6a-49bf-b945-c2ba939989fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6053fe25b20945968d1fa6960af59c88'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:30.482893 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aa7c8-5615-4dba-ad17-8b62cdbe4b19 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:30.487858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308f58e-eb92-4657-a036-a4f49263be7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:30.488681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308f58e-eb92-4657-a036-a4f49263be7c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:30.489062 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308f58e-eb92-4657-a036-a4f49263be7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:30.489434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308f58e-eb92-4657-a036-a4f49263be7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:30.490721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308f58e-eb92-4657-a036-a4f49263be7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:33:30.491029 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308f58e-eb92-4657-a036-a4f49263be7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:30.492653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308f58e-eb92-4657-a036-a4f49263be7c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:30.504583 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 986/1987] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:33:30.506436 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ff59f-9c31-41de-ab23-e4b2bd8551da None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:30.506720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ff59f-9c31-41de-ab23-e4b2bd8551da None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:30.506993 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ff59f-9c31-41de-ab23-e4b2bd8551da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:30.526467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-479ff59f-9c31-41de-ab23-e4b2bd8551da None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:30.527676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-479ff59f-9c31-41de-ab23-e4b2bd8551da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:30.535481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 987/1988] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:30.536213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ff59f-9c31-41de-ab23-e4b2bd8551da None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:30.537435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-479ff59f-9c31-41de-ab23-e4b2bd8551da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:30.548914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ff59f-9c31-41de-ab23-e4b2bd8551da None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:30.554124 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70f5c0-abb8-4615-b331-d944b4a9e25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:30.554725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70f5c0-abb8-4615-b331-d944b4a9e25c admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:30.555003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70f5c0-abb8-4615-b331-d944b4a9e25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:30.555270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70f5c0-abb8-4615-b331-d944b4a9e25c admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:30.555896 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70f5c0-abb8-4615-b331-d944b4a9e25c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:30.557814 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70f5c0-abb8-4615-b331-d944b4a9e25c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:30.893131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c960aad2-fc6a-49bf-b945-c2ba939989fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6053fe25b20945968d1fa6960af59c88'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:30.903127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1002/1989] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:29 2022] DELETE /identity/v3/users/6053fe25b20945968d1fa6960af59c88 => generated 0 bytes in 1161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:30.903357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 988/1990] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:30 2022] POST /identity/v3/projects => generated 405 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:30.903486 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960aad2-fc6a-49bf-b945-c2ba939989fe admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:30.905344 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70f5c0-abb8-4615-b331-d944b4a9e25c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:30.994889 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960aad2-fc6a-49bf-b945-c2ba939989fe admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:30.995550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70f5c0-abb8-4615-b331-d944b4a9e25c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:30.995651 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa4180-b377-4753-89b5-68e24b5b31e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:30.995651 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa4180-b377-4753-89b5-68e24b5b31e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:30.995651 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa4180-b377-4753-89b5-68e24b5b31e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:30.995651 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa4180-b377-4753-89b5-68e24b5b31e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:30.995974 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa4180-b377-4753-89b5-68e24b5b31e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:33:30.995974 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa4180-b377-4753-89b5-68e24b5b31e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:30.996953 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa4180-b377-4753-89b5-68e24b5b31e8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:30.997486 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8051a8-af31-49e1-a9dc-b76b56d2433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:30.998952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8051a8-af31-49e1-a9dc-b76b56d2433d admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:30.999540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8051a8-af31-49e1-a9dc-b76b56d2433d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:31.000765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8051a8-af31-49e1-a9dc-b76b56d2433d admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:31.002300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8051a8-af31-49e1-a9dc-b76b56d2433d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:31.005704 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8051a8-af31-49e1-a9dc-b76b56d2433d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:31.027568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1003/1991] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:33:31.046889 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa4180-b377-4753-89b5-68e24b5b31e8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:31.057041 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa4180-b377-4753-89b5-68e24b5b31e8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:31.073078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad5e10-dba1-4e83-b66a-f022b998bc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:31.074440 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad5e10-dba1-4e83-b66a-f022b998bc1f admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:31.074727 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad5e10-dba1-4e83-b66a-f022b998bc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:31.075008 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad5e10-dba1-4e83-b66a-f022b998bc1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:31.075971 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad5e10-dba1-4e83-b66a-f022b998bc1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:31.079421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad5e10-dba1-4e83-b66a-f022b998bc1f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:31.117375 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 989/1992] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:30 2022] POST /identity/v3/users => generated 303 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:31.121823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8051a8-af31-49e1-a9dc-b76b56d2433d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:31.133386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8051a8-af31-49e1-a9dc-b76b56d2433d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:31.138863 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296513a-d49c-43c9-b50f-9f4a16737d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:31.139674 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296513a-d49c-43c9-b50f-9f4a16737d72 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:31.140060 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296513a-d49c-43c9-b50f-9f4a16737d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:31.140436 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296513a-d49c-43c9-b50f-9f4a16737d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:31.141422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296513a-d49c-43c9-b50f-9f4a16737d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:31.143259 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296513a-d49c-43c9-b50f-9f4a16737d72 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:31.157652 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 990/1993] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:31.162309 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296513a-d49c-43c9-b50f-9f4a16737d72 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:31.173029 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296513a-d49c-43c9-b50f-9f4a16737d72 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:31.178845 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83079347-a33f-43c6-a6f9-8fac6bd6b509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:31.201584 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83079347-a33f-43c6-a6f9-8fac6bd6b509 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:31.201584 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83079347-a33f-43c6-a6f9-8fac6bd6b509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:31.201584 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83079347-a33f-43c6-a6f9-8fac6bd6b509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:31.201584 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83079347-a33f-43c6-a6f9-8fac6bd6b509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:31.201584 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83079347-a33f-43c6-a6f9-8fac6bd6b509 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:31.201584 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 991/1994] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:31.204924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83079347-a33f-43c6-a6f9-8fac6bd6b509 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:31.216489 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83079347-a33f-43c6-a6f9-8fac6bd6b509 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:31.226093 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3a5a9-dbb2-4af0-9fce-5f69ff23d1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:31.226783 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3a5a9-dbb2-4af0-9fce-5f69ff23d1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:31.227214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3a5a9-dbb2-4af0-9fce-5f69ff23d1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:31.227495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3a5a9-dbb2-4af0-9fce-5f69ff23d1c2 admin admin] PATH_INFO: `/v3/projects/e984e042bb514e8ca5f4155ff5d114fd/users/fd06a51acc0249a6858488712b6f2e7f/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:31.247912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3a5a9-dbb2-4af0-9fce-5f69ff23d1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e984e042bb514e8ca5f4155ff5d114fd, user_id=fd06a51acc0249a6858488712b6f2e7f, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:31.247912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3a5a9-dbb2-4af0-9fce-5f69ff23d1c2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:31.261081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1004/1995] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:31 2022] POST /identity/v3/projects => generated 401 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:31.265559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad5e10-dba1-4e83-b66a-f022b998bc1f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:31.345608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad5e10-dba1-4e83-b66a-f022b998bc1f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:31.351421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0b619-f9f0-407e-8d38-eb046c3af215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:31.352110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0b619-f9f0-407e-8d38-eb046c3af215 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:31.352463 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0b619-f9f0-407e-8d38-eb046c3af215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:31.352820 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0b619-f9f0-407e-8d38-eb046c3af215 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:31.353519 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0b619-f9f0-407e-8d38-eb046c3af215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:31.355572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0b619-f9f0-407e-8d38-eb046c3af215 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:31.377681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 992/1996] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:31 2022] PUT /identity/v3/projects/e984e042bb514e8ca5f4155ff5d114fd/users/fd06a51acc0249a6858488712b6f2e7f/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:31.382453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0d739-24a8-4d1e-b6ff-55c5632b76bf None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:31.382837 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0d739-24a8-4d1e-b6ff-55c5632b76bf None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:31.383188 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0d739-24a8-4d1e-b6ff-55c5632b76bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:31.415793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3bb0d739-24a8-4d1e-b6ff-55c5632b76bf None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:31.417292 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3bb0d739-24a8-4d1e-b6ff-55c5632b76bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:31.438386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1005/1997] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:31 2022] POST /identity/v3/users => generated 301 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:31.439739 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0b619-f9f0-407e-8d38-eb046c3af215 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:31.454226 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0b619-f9f0-407e-8d38-eb046c3af215 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:31.503352 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 993/1998] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:31.512725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0d739-24a8-4d1e-b6ff-55c5632b76bf None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:31.514119 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3bb0d739-24a8-4d1e-b6ff-55c5632b76bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:31.515340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c12104-6958-4a97-ab53-709629461040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:31.515952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c12104-6958-4a97-ab53-709629461040 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:31.516228 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c12104-6958-4a97-ab53-709629461040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:31.516497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c12104-6958-4a97-ab53-709629461040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:31.517131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c12104-6958-4a97-ab53-709629461040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:31.518752 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c12104-6958-4a97-ab53-709629461040 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:31.533456 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1006/1999] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:31.537942 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c12104-6958-4a97-ab53-709629461040 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:31.547623 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c12104-6958-4a97-ab53-709629461040 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:31.552391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a95d8d-87d5-4c9a-b70a-f46a8aa38a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:31.552980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a95d8d-87d5-4c9a-b70a-f46a8aa38a82 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:31.553259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a95d8d-87d5-4c9a-b70a-f46a8aa38a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:31.553532 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a95d8d-87d5-4c9a-b70a-f46a8aa38a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:31.554276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a95d8d-87d5-4c9a-b70a-f46a8aa38a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:31.559643 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a95d8d-87d5-4c9a-b70a-f46a8aa38a82 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:31.573809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1007/2000] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:31.576336 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a95d8d-87d5-4c9a-b70a-f46a8aa38a82 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:31.578261 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d3a95d8d-87d5-4c9a-b70a-f46a8aa38a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:31.578451 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0d739-24a8-4d1e-b6ff-55c5632b76bf None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:31.584817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656d345-17bc-4bca-9e11-e0324d028bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:31.589905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656d345-17bc-4bca-9e11-e0324d028bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:31.590902 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656d345-17bc-4bca-9e11-e0324d028bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:31.590902 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656d345-17bc-4bca-9e11-e0324d028bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:31.600171 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a95d8d-87d5-4c9a-b70a-f46a8aa38a82 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:31.602812 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656d345-17bc-4bca-9e11-e0324d028bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:31.604327 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656d345-17bc-4bca-9e11-e0324d028bc6 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:31.607003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c09110-b637-4b3b-b138-07be1ef344a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:31.607827 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c09110-b637-4b3b-b138-07be1ef344a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:31.608113 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c09110-b637-4b3b-b138-07be1ef344a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:31.610010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c09110-b637-4b3b-b138-07be1ef344a9 admin admin] PATH_INFO: `/v3/projects/0d1596a4c983486eb64cca6c29c3cdb5` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:31.610010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c09110-b637-4b3b-b138-07be1ef344a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1596a4c983486eb64cca6c29c3cdb5)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:31.611565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c09110-b637-4b3b-b138-07be1ef344a9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:31.615257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 994/2001] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:33:31.622751 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656d345-17bc-4bca-9e11-e0324d028bc6 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:31.633541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656d345-17bc-4bca-9e11-e0324d028bc6 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:31.638250 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf85584-ae61-4bbe-9597-0e231c7f8eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:31.639012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf85584-ae61-4bbe-9597-0e231c7f8eee admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:31.639397 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf85584-ae61-4bbe-9597-0e231c7f8eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:31.639605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf85584-ae61-4bbe-9597-0e231c7f8eee admin admin] PATH_INFO: `/v3/projects/30806d48388c44cf8ed6062c59ec7b48/users/cdda7c23819f49099f62a076eb9175b2/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:31.655258 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf85584-ae61-4bbe-9597-0e231c7f8eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=30806d48388c44cf8ed6062c59ec7b48, user_id=cdda7c23819f49099f62a076eb9175b2, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:31.657915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf85584-ae61-4bbe-9597-0e231c7f8eee admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:31.810079 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 995/2002] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:31 2022] PUT /identity/v3/projects/30806d48388c44cf8ed6062c59ec7b48/users/cdda7c23819f49099f62a076eb9175b2/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:31.810854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-33c09110-b637-4b3b-b138-07be1ef344a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1596a4c983486eb64cca6c29c3cdb5', 'request_id': 'req-33c09110-b637-4b3b-b138-07be1ef344a9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:31.811901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf361f2a-fe2b-4078-93aa-451a10b1c11d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:31.812186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf361f2a-fe2b-4078-93aa-451a10b1c11d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:31.812463 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf361f2a-fe2b-4078-93aa-451a10b1c11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:31.843147 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-cf361f2a-fe2b-4078-93aa-451a10b1c11d None None] MFA Rules not processed for user `cdda7c23819f49099f62a076eb9175b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:31.844376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cf361f2a-fe2b-4078-93aa-451a10b1c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:31.875204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-33c09110-b637-4b3b-b138-07be1ef344a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1596a4c983486eb64cca6c29c3cdb5', 'request_id': 'req-33c09110-b637-4b3b-b138-07be1ef344a9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:31.882419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-33c09110-b637-4b3b-b138-07be1ef344a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1596a4c983486eb64cca6c29c3cdb5', 'request_id': 'req-33c09110-b637-4b3b-b138-07be1ef344a9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:31.892922 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-33c09110-b637-4b3b-b138-07be1ef344a9 admin admin] The token cache is being invalidate because project 0d1596a4c983486eb64cca6c29c3cdb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:31.893213 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-33c09110-b637-4b3b-b138-07be1ef344a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:31.894602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-33c09110-b637-4b3b-b138-07be1ef344a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:31.896345 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1008/2003] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:31 2022] DELETE /identity/v3/projects/0d1596a4c983486eb64cca6c29c3cdb5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:31.902192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae3ccc-ee32-4157-a414-3cf79d67676e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:31.902641 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae3ccc-ee32-4157-a414-3cf79d67676e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:31.903178 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae3ccc-ee32-4157-a414-3cf79d67676e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:31.907299 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:31.913881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 996/2004] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:31 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:31.916784 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf361f2a-fe2b-4078-93aa-451a10b1c11d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:31.918215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cf361f2a-fe2b-4078-93aa-451a10b1c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:31.928148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d9ae3ccc-ee32-4157-a414-3cf79d67676e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:31.929387 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d9ae3ccc-ee32-4157-a414-3cf79d67676e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:31.986174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf361f2a-fe2b-4078-93aa-451a10b1c11d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:31.992918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2a9ea-a522-4580-9d90-3ebcedb5049d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:31.993616 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2a9ea-a522-4580-9d90-3ebcedb5049d admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:31.993995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2a9ea-a522-4580-9d90-3ebcedb5049d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:31.994340 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2a9ea-a522-4580-9d90-3ebcedb5049d admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:31.995109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2a9ea-a522-4580-9d90-3ebcedb5049d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:31.997595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2a9ea-a522-4580-9d90-3ebcedb5049d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:32.011653 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1009/2005] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:32.016026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b8a1c-fcf8-4f47-b5d5-ded78988ab6c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:32.016810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b8a1c-fcf8-4f47-b5d5-ded78988ab6c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:32.018050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b8a1c-fcf8-4f47-b5d5-ded78988ab6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:32.046671 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-098b8a1c-fcf8-4f47-b5d5-ded78988ab6c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:32.047883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-098b8a1c-fcf8-4f47-b5d5-ded78988ab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:32.056529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1010/2006] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:32.063043 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b8a1c-fcf8-4f47-b5d5-ded78988ab6c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:32.071939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b8a1c-fcf8-4f47-b5d5-ded78988ab6c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:32.076956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e840172-733a-4c0f-8473-d8575c98555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:32.077826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e840172-733a-4c0f-8473-d8575c98555c admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:32.078168 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e840172-733a-4c0f-8473-d8575c98555c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:32.079021 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e840172-733a-4c0f-8473-d8575c98555c admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:32.079768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e840172-733a-4c0f-8473-d8575c98555c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:33:32.080116 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e840172-733a-4c0f-8473-d8575c98555c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:32.081850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e840172-733a-4c0f-8473-d8575c98555c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:32.108199 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1011/2007] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:33:32.112633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e840172-733a-4c0f-8473-d8575c98555c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:32.122276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e840172-733a-4c0f-8473-d8575c98555c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:32.123589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 997/2008] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:31 2022] POST /identity/v3/projects => generated 401 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:32.127231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2a9ea-a522-4580-9d90-3ebcedb5049d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:32.179811 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a811e8-b45a-4779-bb9a-8901b4993543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:32.180420 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a811e8-b45a-4779-bb9a-8901b4993543 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:32.180727 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a811e8-b45a-4779-bb9a-8901b4993543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:32.180996 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a811e8-b45a-4779-bb9a-8901b4993543 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:32.181621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a811e8-b45a-4779-bb9a-8901b4993543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:32.183633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a811e8-b45a-4779-bb9a-8901b4993543 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:32.188829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2a9ea-a522-4580-9d90-3ebcedb5049d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:32.193475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f625a-c40e-4e06-af47-41e15479c26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:32.194108 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f625a-c40e-4e06-af47-41e15479c26b admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:32.194390 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f625a-c40e-4e06-af47-41e15479c26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:32.194664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f625a-c40e-4e06-af47-41e15479c26b admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:32.195552 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f625a-c40e-4e06-af47-41e15479c26b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:32.197185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f625a-c40e-4e06-af47-41e15479c26b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:32.343780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1012/2009] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:32 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:32.344748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a811e8-b45a-4779-bb9a-8901b4993543 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:32.370150 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 998/2010] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:32 2022] POST /identity/v3/users => generated 307 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:32.371306 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f625a-c40e-4e06-af47-41e15479c26b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:32.382730 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f625a-c40e-4e06-af47-41e15479c26b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:32.414733 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a811e8-b45a-4779-bb9a-8901b4993543 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:32.419523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054141b5-3fe0-44c5-bcfd-119217699ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:32.420204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054141b5-3fe0-44c5-bcfd-119217699ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:32.420553 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054141b5-3fe0-44c5-bcfd-119217699ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:32.420895 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054141b5-3fe0-44c5-bcfd-119217699ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:32.421650 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054141b5-3fe0-44c5-bcfd-119217699ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:32.423747 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054141b5-3fe0-44c5-bcfd-119217699ab1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:32.441152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb2129-b089-4b40-8957-867a084f2550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:32.441764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb2129-b089-4b40-8957-867a084f2550 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:32.442464 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb2129-b089-4b40-8957-867a084f2550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:32.442464 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb2129-b089-4b40-8957-867a084f2550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:32.443640 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb2129-b089-4b40-8957-867a084f2550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:32.445223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb2129-b089-4b40-8957-867a084f2550 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:32.454863 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 999/2011] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:32.459414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb2129-b089-4b40-8957-867a084f2550 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:32.468826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb2129-b089-4b40-8957-867a084f2550 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:32.473551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3dd77-e853-4006-b004-f761f32934f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:32.474259 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3dd77-e853-4006-b004-f761f32934f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:32.474540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3dd77-e853-4006-b004-f761f32934f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:32.477064 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3dd77-e853-4006-b004-f761f32934f5 admin admin] PATH_INFO: `/v3/projects/b891c3892cae45dda2665d27db0d24c6/users/763c56d3f28c49ffb2ee7f9315cf4f5e/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:32.490696 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3dd77-e853-4006-b004-f761f32934f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b891c3892cae45dda2665d27db0d24c6, user_id=763c56d3f28c49ffb2ee7f9315cf4f5e, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:32.493404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3dd77-e853-4006-b004-f761f32934f5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:32.598332 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1013/2012] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:32 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:32.604258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054141b5-3fe0-44c5-bcfd-119217699ab1 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:32.615266 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054141b5-3fe0-44c5-bcfd-119217699ab1 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:32.621533 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678cadd-f696-46e7-afb8-1b0607d4fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:32.622313 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678cadd-f696-46e7-afb8-1b0607d4fbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:32.622966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678cadd-f696-46e7-afb8-1b0607d4fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:32.623077 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678cadd-f696-46e7-afb8-1b0607d4fbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:32.623787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678cadd-f696-46e7-afb8-1b0607d4fbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:32.625632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678cadd-f696-46e7-afb8-1b0607d4fbd1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:32.647153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1014/2013] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:32.651219 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1000/2014] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:32 2022] PUT /identity/v3/projects/b891c3892cae45dda2665d27db0d24c6/users/763c56d3f28c49ffb2ee7f9315cf4f5e/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:32.651409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678cadd-f696-46e7-afb8-1b0607d4fbd1 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:32.653570 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3dd77-e853-4006-b004-f761f32934f5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:32.664619 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678cadd-f696-46e7-afb8-1b0607d4fbd1 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:32.728999 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395230f-7342-4711-9c12-2d44daed6544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:32.729812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395230f-7342-4711-9c12-2d44daed6544 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:32.730207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395230f-7342-4711-9c12-2d44daed6544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:32.730435 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395230f-7342-4711-9c12-2d44daed6544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:32.731039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395230f-7342-4711-9c12-2d44daed6544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:32.731690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3dd77-e853-4006-b004-f761f32934f5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:32.732809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395230f-7342-4711-9c12-2d44daed6544 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:32.737209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0efd1-6a91-42bc-9e8b-f672645898db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:32.738059 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0efd1-6a91-42bc-9e8b-f672645898db admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:32.738342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0efd1-6a91-42bc-9e8b-f672645898db admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:32.738619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0efd1-6a91-42bc-9e8b-f672645898db admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:32.739277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0efd1-6a91-42bc-9e8b-f672645898db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:32.741536 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0efd1-6a91-42bc-9e8b-f672645898db admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:32.745895 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1015/2015] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:32.750117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395230f-7342-4711-9c12-2d44daed6544 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:32.753109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1001/2016] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:32.757610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0efd1-6a91-42bc-9e8b-f672645898db admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:32.762355 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395230f-7342-4711-9c12-2d44daed6544 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:32.768563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707bb99-be1c-46bb-8f90-6fa432540616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:32.769245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707bb99-be1c-46bb-8f90-6fa432540616 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:32.769527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707bb99-be1c-46bb-8f90-6fa432540616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:32.769834 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707bb99-be1c-46bb-8f90-6fa432540616 admin admin] PATH_INFO: `/v3/projects/4c46bb5af2554a66a8ab7c96a86d0c0b/users/159b0f43250841a1a23a326eb02e112a/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:32.770727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0efd1-6a91-42bc-9e8b-f672645898db admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:32.776588 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f1a36-c90f-4abc-b3e1-4712a4254c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:32.777497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f1a36-c90f-4abc-b3e1-4712a4254c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:32.777959 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f1a36-c90f-4abc-b3e1-4712a4254c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:32.778499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f1a36-c90f-4abc-b3e1-4712a4254c9e admin admin] PATH_INFO: `/v3/projects/b891c3892cae45dda2665d27db0d24c6/users/763c56d3f28c49ffb2ee7f9315cf4f5e/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:32.781160 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f1a36-c90f-4abc-b3e1-4712a4254c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b891c3892cae45dda2665d27db0d24c6, user_id=763c56d3f28c49ffb2ee7f9315cf4f5e, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:32.784149 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f1a36-c90f-4abc-b3e1-4712a4254c9e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:32.787247 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707bb99-be1c-46bb-8f90-6fa432540616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c46bb5af2554a66a8ab7c96a86d0c0b, user_id=159b0f43250841a1a23a326eb02e112a, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:32.790110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707bb99-be1c-46bb-8f90-6fa432540616 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:32.796049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1002/2017] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:32 2022] PUT /identity/v3/projects/b891c3892cae45dda2665d27db0d24c6/users/763c56d3f28c49ffb2ee7f9315cf4f5e/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:32.808647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0501e-ae61-439f-8d79-d10e88a0942d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:32.808940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0501e-ae61-439f-8d79-d10e88a0942d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:32.809214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0501e-ae61-439f-8d79-d10e88a0942d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:32.826920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:32.843164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d6f0501e-ae61-439f-8d79-d10e88a0942d None None] MFA Rules not processed for user `763c56d3f28c49ffb2ee7f9315cf4f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:32.844391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d6f0501e-ae61-439f-8d79-d10e88a0942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:32.872009 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1016/2018] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:32 2022] PUT /identity/v3/projects/4c46bb5af2554a66a8ab7c96a86d0c0b/users/159b0f43250841a1a23a326eb02e112a/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:32.885768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8603313-972e-4d81-a0ff-e61510cab19f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:32.886107 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8603313-972e-4d81-a0ff-e61510cab19f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:32.886506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8603313-972e-4d81-a0ff-e61510cab19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:32.918388 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e8603313-972e-4d81-a0ff-e61510cab19f None None] MFA Rules not processed for user `159b0f43250841a1a23a326eb02e112a`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:32.919890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e8603313-972e-4d81-a0ff-e61510cab19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:32.941907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1003/2019] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:32 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:32.951881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0501e-ae61-439f-8d79-d10e88a0942d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:32.956517 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d6f0501e-ae61-439f-8d79-d10e88a0942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:33.253075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1017/2020] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:33.253075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8603313-972e-4d81-a0ff-e61510cab19f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:33.253664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0501e-ae61-439f-8d79-d10e88a0942d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:33.253664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292c795-d7de-4999-9580-8f5757a724ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:33.253664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292c795-d7de-4999-9580-8f5757a724ce service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:33.253664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292c795-d7de-4999-9580-8f5757a724ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:33.255586 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292c795-d7de-4999-9580-8f5757a724ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:33.256577 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8603313-972e-4d81-a0ff-e61510cab19f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:33.256577 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d50d80-a376-4cb4-ae42-70868f931a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:33.256577 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d50d80-a376-4cb4-ae42-70868f931a35 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:33.256577 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d50d80-a376-4cb4-ae42-70868f931a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:33.262816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d50d80-a376-4cb4-ae42-70868f931a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:33.262816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d50d80-a376-4cb4-ae42-70868f931a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:33.262816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d50d80-a376-4cb4-ae42-70868f931a35 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:33.264282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292c795-d7de-4999-9580-8f5757a724ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:33.264282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292c795-d7de-4999-9580-8f5757a724ce service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:33.264282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1004/2021] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:32 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:33:33.291189 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1018/2022] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:33 2022] POST /identity/v3/projects => generated 383 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:33.294474 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292c795-d7de-4999-9580-8f5757a724ce service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:33.306184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292c795-d7de-4999-9580-8f5757a724ce service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:33.380912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1badac-3301-4556-b0c9-96e629a1da71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:33.389924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1badac-3301-4556-b0c9-96e629a1da71 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:33.389924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1badac-3301-4556-b0c9-96e629a1da71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:33.389924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1badac-3301-4556-b0c9-96e629a1da71 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:33.389924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1badac-3301-4556-b0c9-96e629a1da71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:33.389924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1badac-3301-4556-b0c9-96e629a1da71 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:33.455330 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d50d80-a376-4cb4-ae42-70868f931a35 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:33.510416 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d50d80-a376-4cb4-ae42-70868f931a35 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:33.513644 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa67ac4-7fb2-4102-be14-4b38bc7bf8e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:33.514300 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa67ac4-7fb2-4102-be14-4b38bc7bf8e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:33.514573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa67ac4-7fb2-4102-be14-4b38bc7bf8e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:33.514842 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa67ac4-7fb2-4102-be14-4b38bc7bf8e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:33.569298 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa67ac4-7fb2-4102-be14-4b38bc7bf8e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:33.570786 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa67ac4-7fb2-4102-be14-4b38bc7bf8e1 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:33.579560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1019/2023] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:33 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:33:33.595550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1005/2024] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:33 2022] POST /identity/v3/users => generated 292 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:33.605791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa67ac4-7fb2-4102-be14-4b38bc7bf8e1 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:33.612401 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa67ac4-7fb2-4102-be14-4b38bc7bf8e1 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:33.617672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a390ee-85f4-4dfe-83a9-0d11dee4b88c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:33.617882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f952fc-d3de-4f8c-aaa9-ba79bfa2d125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:33.618063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a390ee-85f4-4dfe-83a9-0d11dee4b88c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:33.618467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a390ee-85f4-4dfe-83a9-0d11dee4b88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:33.618568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f952fc-d3de-4f8c-aaa9-ba79bfa2d125 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:33.618867 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f952fc-d3de-4f8c-aaa9-ba79bfa2d125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:33.619145 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f952fc-d3de-4f8c-aaa9-ba79bfa2d125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:33.619806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f952fc-d3de-4f8c-aaa9-ba79bfa2d125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:33.622100 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f952fc-d3de-4f8c-aaa9-ba79bfa2d125 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:33.634261 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1020/2025] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:33.636875 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f952fc-d3de-4f8c-aaa9-ba79bfa2d125 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:33.644214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d3a390ee-85f4-4dfe-83a9-0d11dee4b88c None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:33.645439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d3a390ee-85f4-4dfe-83a9-0d11dee4b88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:33.649043 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f952fc-d3de-4f8c-aaa9-ba79bfa2d125 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:33.656727 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316354a-e7be-4836-8a9f-8c0f8f1195fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:33.657342 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316354a-e7be-4836-8a9f-8c0f8f1195fb admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:33.657632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316354a-e7be-4836-8a9f-8c0f8f1195fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:33.657939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316354a-e7be-4836-8a9f-8c0f8f1195fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:33.658657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316354a-e7be-4836-8a9f-8c0f8f1195fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:33.660959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316354a-e7be-4836-8a9f-8c0f8f1195fb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:33.675012 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1021/2026] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:33.683996 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316354a-e7be-4836-8a9f-8c0f8f1195fb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:33.702750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316354a-e7be-4836-8a9f-8c0f8f1195fb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:33.717189 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8668850-1cbd-49c5-9039-fe8bd4edbc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:33.718019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8668850-1cbd-49c5-9039-fe8bd4edbc6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:33.718585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8668850-1cbd-49c5-9039-fe8bd4edbc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:33.718704 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8668850-1cbd-49c5-9039-fe8bd4edbc6e admin admin] PATH_INFO: `/v3/projects/f93758f59be345e98d1d4bc1385944b8/users/179789f6200945ebba484570d45a3d00/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:33.739906 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1006/2027] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Sep 23 15:33:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:33.745291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8668850-1cbd-49c5-9039-fe8bd4edbc6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93758f59be345e98d1d4bc1385944b8, user_id=179789f6200945ebba484570d45a3d00, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:33.748336 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8668850-1cbd-49c5-9039-fe8bd4edbc6e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:33.780788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d477de-b1a1-4b21-a0bd-be79da71bc5d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:33.781074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d477de-b1a1-4b21-a0bd-be79da71bc5d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:33.781345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d477de-b1a1-4b21-a0bd-be79da71bc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:33.810842 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-09d477de-b1a1-4b21-a0bd-be79da71bc5d None None] MFA Rules not processed for user `fd06a51acc0249a6858488712b6f2e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:33.812098 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-09d477de-b1a1-4b21-a0bd-be79da71bc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:33.868229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1022/2028] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:33 2022] PUT /identity/v3/projects/f93758f59be345e98d1d4bc1385944b8/users/179789f6200945ebba484570d45a3d00/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:33.884930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8668850-1cbd-49c5-9039-fe8bd4edbc6e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:33.884930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c8668850-1cbd-49c5-9039-fe8bd4edbc6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:33.885144 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1007/2029] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:33.886462 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c2c6e-33aa-4bdd-a279-9dc3c947f988 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:33.886756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c2c6e-33aa-4bdd-a279-9dc3c947f988 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:33.887034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c2c6e-33aa-4bdd-a279-9dc3c947f988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:33.919798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-053c2c6e-33aa-4bdd-a279-9dc3c947f988 None None] MFA Rules not processed for user `179789f6200945ebba484570d45a3d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:33.921013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-053c2c6e-33aa-4bdd-a279-9dc3c947f988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:33.944388 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8668850-1cbd-49c5-9039-fe8bd4edbc6e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:33.951039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2511cd8-2221-4701-9e0e-4268839e626e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:33.951656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2511cd8-2221-4701-9e0e-4268839e626e service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:33.951939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2511cd8-2221-4701-9e0e-4268839e626e service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:33.952209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2511cd8-2221-4701-9e0e-4268839e626e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:33.992485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1008/2030] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:33.993278 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c2c6e-33aa-4bdd-a279-9dc3c947f988 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:33.994600 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-053c2c6e-33aa-4bdd-a279-9dc3c947f988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:34.039183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2511cd8-2221-4701-9e0e-4268839e626e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:34.041112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2511cd8-2221-4701-9e0e-4268839e626e service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:34.050775 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1023/2031] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:33:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 15:33:34.051593 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2511cd8-2221-4701-9e0e-4268839e626e service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:34.075163 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c2c6e-33aa-4bdd-a279-9dc3c947f988 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:34.083804 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88f4dd-d75e-4e80-a618-f8e7ab083205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:34.084501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88f4dd-d75e-4e80-a618-f8e7ab083205 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:34.085226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88f4dd-d75e-4e80-a618-f8e7ab083205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:34.086116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88f4dd-d75e-4e80-a618-f8e7ab083205 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:34.089458 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88f4dd-d75e-4e80-a618-f8e7ab083205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:34.091644 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88f4dd-d75e-4e80-a618-f8e7ab083205 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:34.126753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2511cd8-2221-4701-9e0e-4268839e626e service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:34.131923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9a86e-7400-4239-9080-36a8c582e15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:34.132534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9a86e-7400-4239-9080-36a8c582e15d admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:34.132815 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9a86e-7400-4239-9080-36a8c582e15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:34.133115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9a86e-7400-4239-9080-36a8c582e15d admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:34.133762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9a86e-7400-4239-9080-36a8c582e15d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:34.135692 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9a86e-7400-4239-9080-36a8c582e15d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:34.214499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1009/2032] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:33 2022] POST /identity/v3/projects => generated 403 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:34.218510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88f4dd-d75e-4e80-a618-f8e7ab083205 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:34.265289 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1024/2033] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:34 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:34.266518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9a86e-7400-4239-9080-36a8c582e15d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:34.291300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88f4dd-d75e-4e80-a618-f8e7ab083205 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:34.330972 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9a86e-7400-4239-9080-36a8c582e15d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:34.336241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fa253-f9f4-4c21-90f2-e831f716fa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:34.336864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fa253-f9f4-4c21-90f2-e831f716fa98 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:34.337132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fa253-f9f4-4c21-90f2-e831f716fa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:34.337426 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fa253-f9f4-4c21-90f2-e831f716fa98 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:34.338180 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fa253-f9f4-4c21-90f2-e831f716fa98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:34.340109 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fa253-f9f4-4c21-90f2-e831f716fa98 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:34.347395 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd4fcc-6800-4431-968b-6527bdcf9ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:34.348013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd4fcc-6800-4431-968b-6527bdcf9ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:34.348474 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd4fcc-6800-4431-968b-6527bdcf9ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:34.348826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd4fcc-6800-4431-968b-6527bdcf9ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:34.349462 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd4fcc-6800-4431-968b-6527bdcf9ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:34.351693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd4fcc-6800-4431-968b-6527bdcf9ea9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:34.419781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1025/2034] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:34 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:34.425992 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fa253-f9f4-4c21-90f2-e831f716fa98 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:34.437207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fa253-f9f4-4c21-90f2-e831f716fa98 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:34.442027 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f3cb6-4c55-43c5-b942-5fecf54b670d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:34.443200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f3cb6-4c55-43c5-b942-5fecf54b670d admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:34.443544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f3cb6-4c55-43c5-b942-5fecf54b670d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:34.443934 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f3cb6-4c55-43c5-b942-5fecf54b670d admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:34.444694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f3cb6-4c55-43c5-b942-5fecf54b670d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:34.446448 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f3cb6-4c55-43c5-b942-5fecf54b670d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:34.463204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1026/2035] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:34.466217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f3cb6-4c55-43c5-b942-5fecf54b670d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:34.476093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f3cb6-4c55-43c5-b942-5fecf54b670d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:34.481178 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182a566-1d68-4c10-8910-f658e40f3fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:34.481845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182a566-1d68-4c10-8910-f658e40f3fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:34.482128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182a566-1d68-4c10-8910-f658e40f3fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:34.482404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182a566-1d68-4c10-8910-f658e40f3fa7 admin admin] PATH_INFO: `/v3/projects/c8c02a521d4e43cda33f303908e1b380/users/8c07aab09de44e5eb486ba699923e9fe/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:34.496518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1010/2036] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:34 2022] POST /identity/v3/users => generated 308 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:34.499779 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd4fcc-6800-4431-968b-6527bdcf9ea9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:34.500272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182a566-1d68-4c10-8910-f658e40f3fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8c02a521d4e43cda33f303908e1b380, user_id=8c07aab09de44e5eb486ba699923e9fe, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:34.503298 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182a566-1d68-4c10-8910-f658e40f3fa7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:34.513472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd4fcc-6800-4431-968b-6527bdcf9ea9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:34.522762 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc51655-f377-4939-8b3f-1a05a89c13b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:34.523448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc51655-f377-4939-8b3f-1a05a89c13b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:34.523726 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc51655-f377-4939-8b3f-1a05a89c13b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:34.523995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc51655-f377-4939-8b3f-1a05a89c13b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:34.524656 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc51655-f377-4939-8b3f-1a05a89c13b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:34.527728 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc51655-f377-4939-8b3f-1a05a89c13b8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:34.538313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1011/2037] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:34.542558 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc51655-f377-4939-8b3f-1a05a89c13b8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:34.552913 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc51655-f377-4939-8b3f-1a05a89c13b8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:34.557912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f949f0-8209-4a1e-a093-7170dc9644dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:34.558557 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f949f0-8209-4a1e-a093-7170dc9644dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:34.558830 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f949f0-8209-4a1e-a093-7170dc9644dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:34.559097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f949f0-8209-4a1e-a093-7170dc9644dc admin admin] PATH_INFO: `/v3/projects/238a79d7e4cd401aade4f3dfd279e829/users/5e610d42ecd94366b6190ae1703b8eff/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:34.574125 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f949f0-8209-4a1e-a093-7170dc9644dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=238a79d7e4cd401aade4f3dfd279e829, user_id=5e610d42ecd94366b6190ae1703b8eff, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:34.576774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f949f0-8209-4a1e-a093-7170dc9644dc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:34.624008 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1027/2038] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:34 2022] PUT /identity/v3/projects/c8c02a521d4e43cda33f303908e1b380/users/8c07aab09de44e5eb486ba699923e9fe/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:34.628039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182a566-1d68-4c10-8910-f658e40f3fa7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:34.693071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182a566-1d68-4c10-8910-f658e40f3fa7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:34.701824 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242d5d2-01c0-4760-bcad-f27d7467512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:34.702436 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242d5d2-01c0-4760-bcad-f27d7467512f admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:34.704880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242d5d2-01c0-4760-bcad-f27d7467512f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:34.706319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242d5d2-01c0-4760-bcad-f27d7467512f admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:34.706977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242d5d2-01c0-4760-bcad-f27d7467512f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:34.708573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242d5d2-01c0-4760-bcad-f27d7467512f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:34.721767 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1028/2039] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:34.726057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242d5d2-01c0-4760-bcad-f27d7467512f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:34.735832 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242d5d2-01c0-4760-bcad-f27d7467512f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:34.741940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d8ed-516e-4e80-b437-416fbbfae9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:34.742640 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d8ed-516e-4e80-b437-416fbbfae9ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:34.742920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d8ed-516e-4e80-b437-416fbbfae9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:34.743263 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d8ed-516e-4e80-b437-416fbbfae9ca admin admin] PATH_INFO: `/v3/projects/c8c02a521d4e43cda33f303908e1b380/users/8c07aab09de44e5eb486ba699923e9fe/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:34.745563 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1012/2040] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:34 2022] PUT /identity/v3/projects/238a79d7e4cd401aade4f3dfd279e829/users/5e610d42ecd94366b6190ae1703b8eff/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:34.749342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f949f0-8209-4a1e-a093-7170dc9644dc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:34.749529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9d8ed-516e-4e80-b437-416fbbfae9ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8c02a521d4e43cda33f303908e1b380, user_id=8c07aab09de44e5eb486ba699923e9fe, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:34.752921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9d8ed-516e-4e80-b437-416fbbfae9ca admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:34.768782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1029/2041] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:34 2022] PUT /identity/v3/projects/c8c02a521d4e43cda33f303908e1b380/users/8c07aab09de44e5eb486ba699923e9fe/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:34.779838 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f111d-dedb-472a-ba93-51798f99930e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:34.780146 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f111d-dedb-472a-ba93-51798f99930e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:34.780426 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f111d-dedb-472a-ba93-51798f99930e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:34.813803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cf0f111d-dedb-472a-ba93-51798f99930e None None] MFA Rules not processed for user `8c07aab09de44e5eb486ba699923e9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:34.815068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cf0f111d-dedb-472a-ba93-51798f99930e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:34.829553 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f949f0-8209-4a1e-a093-7170dc9644dc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:34.891683 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcd773-33d3-49c0-8e6c-43bdecaaa28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:34.892299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcd773-33d3-49c0-8e6c-43bdecaaa28b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:34.892578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcd773-33d3-49c0-8e6c-43bdecaaa28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:34.892848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcd773-33d3-49c0-8e6c-43bdecaaa28b admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:34.893519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcd773-33d3-49c0-8e6c-43bdecaaa28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:34.894996 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1030/2042] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:34.896086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcd773-33d3-49c0-8e6c-43bdecaaa28b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:34.907026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f111d-dedb-472a-ba93-51798f99930e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:34.910075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cf0f111d-dedb-472a-ba93-51798f99930e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:34.910167 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1013/2043] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:34.915389 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcd773-33d3-49c0-8e6c-43bdecaaa28b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:34.927535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcd773-33d3-49c0-8e6c-43bdecaaa28b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:34.932900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4ac8c-c926-4360-b190-7b0b3cc4508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:34.933619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4ac8c-c926-4360-b190-7b0b3cc4508b admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:34.934041 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4ac8c-c926-4360-b190-7b0b3cc4508b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:34.934317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4ac8c-c926-4360-b190-7b0b3cc4508b admin admin] PATH_INFO: `/v3/projects/238a79d7e4cd401aade4f3dfd279e829/users/5e610d42ecd94366b6190ae1703b8eff/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:34.936593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4ac8c-c926-4360-b190-7b0b3cc4508b admin admin] RBAC: Authorizing `identity:create_grant(project_id=238a79d7e4cd401aade4f3dfd279e829, user_id=5e610d42ecd94366b6190ae1703b8eff, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:34.939645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4ac8c-c926-4360-b190-7b0b3cc4508b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:34.950902 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1014/2044] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:34 2022] PUT /identity/v3/projects/238a79d7e4cd401aade4f3dfd279e829/users/5e610d42ecd94366b6190ae1703b8eff/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:34.973121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f111d-dedb-472a-ba93-51798f99930e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:35.007053 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:35.026878 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b26655-4b2c-4bf0-b6cc-2eb496ec22e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:35.027501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b26655-4b2c-4bf0-b6cc-2eb496ec22e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:35.027929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b26655-4b2c-4bf0-b6cc-2eb496ec22e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:35.028205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b26655-4b2c-4bf0-b6cc-2eb496ec22e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:35.088239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b26655-4b2c-4bf0-b6cc-2eb496ec22e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:35.089708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b26655-4b2c-4bf0-b6cc-2eb496ec22e2 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:35.099918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1031/2045] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:33:35.141200 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fe49a-0d3b-41ab-af38-b558feacbca1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:35.141575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fe49a-0d3b-41ab-af38-b558feacbca1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:35.142249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fe49a-0d3b-41ab-af38-b558feacbca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:35.166270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7f6fe49a-0d3b-41ab-af38-b558feacbca1 None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:35.167750 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7f6fe49a-0d3b-41ab-af38-b558feacbca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:35.237027 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1015/2046] 10.222.0.82 () {58 vars in 967 bytes} [Fri Sep 23 15:33:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:35.250256 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b26655-4b2c-4bf0-b6cc-2eb496ec22e2 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:35.271634 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:35.320246 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b26655-4b2c-4bf0-b6cc-2eb496ec22e2 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:35.325461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab72125-ebca-49e2-9a08-6a2efd7ce41b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:35.326255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab72125-ebca-49e2-9a08-6a2efd7ce41b service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:35.326536 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab72125-ebca-49e2-9a08-6a2efd7ce41b service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:35.326808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab72125-ebca-49e2-9a08-6a2efd7ce41b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:35.344666 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab72125-ebca-49e2-9a08-6a2efd7ce41b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:35.345590 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab72125-ebca-49e2-9a08-6a2efd7ce41b service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:35.356038 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1032/2047] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:33:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 15:33:36.248594 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91180613-c88a-4c8e-9eb0-1c93f79c2a41 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:36.249170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91180613-c88a-4c8e-9eb0-1c93f79c2a41 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:36.249170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91180613-c88a-4c8e-9eb0-1c93f79c2a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:36.268986 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-91180613-c88a-4c8e-9eb0-1c93f79c2a41 None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:36.270223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-91180613-c88a-4c8e-9eb0-1c93f79c2a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:36.277926 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1016/2048] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Sep 23 15:33:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:36.292343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab72125-ebca-49e2-9a08-6a2efd7ce41b service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:36.336393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab72125-ebca-49e2-9a08-6a2efd7ce41b service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:36.336393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7f9ce-7427-4d26-903e-432cbf1efaa8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:36.336393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7f9ce-7427-4d26-903e-432cbf1efaa8 service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:36.336393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7f9ce-7427-4d26-903e-432cbf1efaa8 service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:36.337646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7f9ce-7427-4d26-903e-432cbf1efaa8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:36.337646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7f9ce-7427-4d26-903e-432cbf1efaa8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:36.337646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7f9ce-7427-4d26-903e-432cbf1efaa8 service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:36.337646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1033/2049] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:33:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 15:33:36.456725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aec809-a1b1-48e8-87ea-7c22ca1037a5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:36.457835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aec809-a1b1-48e8-87ea-7c22ca1037a5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:36.458660 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aec809-a1b1-48e8-87ea-7c22ca1037a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:36.491518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e2aec809-a1b1-48e8-87ea-7c22ca1037a5 None None] MFA Rules not processed for user `5e610d42ecd94366b6190ae1703b8eff`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:36.493236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e2aec809-a1b1-48e8-87ea-7c22ca1037a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:36.563901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1017/2050] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:36 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:37.042557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:37.184712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08fdbd-9567-4a5b-8f01-cbcbc1a45ce8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:37.185065 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08fdbd-9567-4a5b-8f01-cbcbc1a45ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:37.185409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08fdbd-9567-4a5b-8f01-cbcbc1a45ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:37.204924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5c08fdbd-9567-4a5b-8f01-cbcbc1a45ce8 None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:37.206330 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5c08fdbd-9567-4a5b-8f01-cbcbc1a45ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:37.208557 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47657e0c-b099-4a27-88b1-f35a5dc02f37 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:37.209136 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47657e0c-b099-4a27-88b1-f35a5dc02f37 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:37.209440 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47657e0c-b099-4a27-88b1-f35a5dc02f37 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:37.211402 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1018/2051] 10.222.0.82 () {54 vars in 921 bytes} [Fri Sep 23 15:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:33:37.215188 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1034/2052] 10.222.0.82 () {58 vars in 967 bytes} [Fri Sep 23 15:33:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:37.225095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd151d95-c209-4255-996e-c47f4934cf5d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:37.225484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd151d95-c209-4255-996e-c47f4934cf5d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:37.225858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd151d95-c209-4255-996e-c47f4934cf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:37.233019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08fdbd-9567-4a5b-8f01-cbcbc1a45ce8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:37.249385 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08fdbd-9567-4a5b-8f01-cbcbc1a45ce8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:37.252676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fd151d95-c209-4255-996e-c47f4934cf5d None None] MFA Rules not processed for user `a25109eeb1b34b3689b10e3f7c44a6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:37.254817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fd151d95-c209-4255-996e-c47f4934cf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:37.255734 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d0059-73a8-48fd-a5e4-a3e2f3b6d29d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:37.256658 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d0059-73a8-48fd-a5e4-a3e2f3b6d29d service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:37.257168 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d0059-73a8-48fd-a5e4-a3e2f3b6d29d service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:37.257517 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d0059-73a8-48fd-a5e4-a3e2f3b6d29d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:37.277049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d0059-73a8-48fd-a5e4-a3e2f3b6d29d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:37.278632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d0059-73a8-48fd-a5e4-a3e2f3b6d29d service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:37.289954 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1035/2053] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:33:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 15:33:37.352512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1019/2054] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Sep 23 15:33:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:37.363945 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d0059-73a8-48fd-a5e4-a3e2f3b6d29d service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:37.365392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-589d0059-73a8-48fd-a5e4-a3e2f3b6d29d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:37.380537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d0059-73a8-48fd-a5e4-a3e2f3b6d29d service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:37.386591 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd1aef-beff-4114-b1f4-f6060038a507 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25109eeb1b34b3689b10e3f7c44a6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:37.387436 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd1aef-beff-4114-b1f4-f6060038a507 service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:37.387728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd1aef-beff-4114-b1f4-f6060038a507 service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:37.388003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd1aef-beff-4114-b1f4-f6060038a507 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:37.401879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd1aef-beff-4114-b1f4-f6060038a507 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:37.410569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd151d95-c209-4255-996e-c47f4934cf5d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:37.417248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd1aef-beff-4114-b1f4-f6060038a507 service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:37.443595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd151d95-c209-4255-996e-c47f4934cf5d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:37.447496 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1036/2055] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:37.450595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51a639-2103-4af8-bfd5-63247f3ad6c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:37.451801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51a639-2103-4af8-bfd5-63247f3ad6c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:37.452275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51a639-2103-4af8-bfd5-63247f3ad6c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:37.453792 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51a639-2103-4af8-bfd5-63247f3ad6c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:37.503873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:37.525821 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51a639-2103-4af8-bfd5-63247f3ad6c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:37.527327 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51a639-2103-4af8-bfd5-63247f3ad6c6 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:37.537128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1020/2056] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:33:38.268531 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd1aef-beff-4114-b1f4-f6060038a507 service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:38.334800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd1aef-beff-4114-b1f4-f6060038a507 service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:38.339301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0b754-d958-4110-b3c7-15e5988dc999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:38.339925 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0b754-d958-4110-b3c7-15e5988dc999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:38.340201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0b754-d958-4110-b3c7-15e5988dc999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:38.340471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0b754-d958-4110-b3c7-15e5988dc999 admin admin] PATH_INFO: `/v3/users/fd06a51acc0249a6858488712b6f2e7f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:38.342285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0b754-d958-4110-b3c7-15e5988dc999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd06a51acc0249a6858488712b6f2e7f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:38.355199 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0b754-d958-4110-b3c7-15e5988dc999 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:38.668017 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9da0b754-d958-4110-b3c7-15e5988dc999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd06a51acc0249a6858488712b6f2e7f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:38.681533 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9da0b754-d958-4110-b3c7-15e5988dc999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd06a51acc0249a6858488712b6f2e7f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:38.688218 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9da0b754-d958-4110-b3c7-15e5988dc999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd06a51acc0249a6858488712b6f2e7f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:38.688886 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9da0b754-d958-4110-b3c7-15e5988dc999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd06a51acc0249a6858488712b6f2e7f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:38.881023 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9da0b754-d958-4110-b3c7-15e5988dc999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd06a51acc0249a6858488712b6f2e7f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:38.893826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1037/2057] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:38 2022] DELETE /identity/v3/users/fd06a51acc0249a6858488712b6f2e7f => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:38.944012 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:39.344497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51a639-2103-4af8-bfd5-63247f3ad6c6 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:39.358050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51a639-2103-4af8-bfd5-63247f3ad6c6 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:39.417812 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294c92e-206e-40a1-896c-389e49aa845c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:39.418668 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294c92e-206e-40a1-896c-389e49aa845c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:39.419100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294c92e-206e-40a1-896c-389e49aa845c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:39.421858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294c92e-206e-40a1-896c-389e49aa845c admin admin] PATH_INFO: `/v3/projects/e984e042bb514e8ca5f4155ff5d114fd` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:39.421858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294c92e-206e-40a1-896c-389e49aa845c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e984e042bb514e8ca5f4155ff5d114fd)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:39.422968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294c92e-206e-40a1-896c-389e49aa845c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:39.441417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0b754-d958-4110-b3c7-15e5988dc999 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:39.444051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9da0b754-d958-4110-b3c7-15e5988dc999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:39.458719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0b754-d958-4110-b3c7-15e5988dc999 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:39.468384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b1a6d-6d82-4114-8ae3-913eeac0998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:39.469267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b1a6d-6d82-4114-8ae3-913eeac0998c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:39.469672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b1a6d-6d82-4114-8ae3-913eeac0998c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:39.470047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b1a6d-6d82-4114-8ae3-913eeac0998c admin admin] PATH_INFO: `/v3/users/cdda7c23819f49099f62a076eb9175b2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:39.479380 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b1a6d-6d82-4114-8ae3-913eeac0998c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdda7c23819f49099f62a076eb9175b2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:39.479380 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b1a6d-6d82-4114-8ae3-913eeac0998c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:39.604975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e294c92e-206e-40a1-896c-389e49aa845c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e984e042bb514e8ca5f4155ff5d114fd', 'request_id': 'req-e294c92e-206e-40a1-896c-389e49aa845c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:39.755557 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e294c92e-206e-40a1-896c-389e49aa845c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e984e042bb514e8ca5f4155ff5d114fd', 'request_id': 'req-e294c92e-206e-40a1-896c-389e49aa845c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:39.761899 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e294c92e-206e-40a1-896c-389e49aa845c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e984e042bb514e8ca5f4155ff5d114fd', 'request_id': 'req-e294c92e-206e-40a1-896c-389e49aa845c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:39.773331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e294c92e-206e-40a1-896c-389e49aa845c admin admin] The token cache is being invalidate because project e984e042bb514e8ca5f4155ff5d114fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:39.773620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e294c92e-206e-40a1-896c-389e49aa845c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:39.774286 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e294c92e-206e-40a1-896c-389e49aa845c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:39.775784 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1021/2058] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:39 2022] DELETE /identity/v3/projects/e984e042bb514e8ca5f4155ff5d114fd => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:39.776561 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294c92e-206e-40a1-896c-389e49aa845c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:39.778027 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e294c92e-206e-40a1-896c-389e49aa845c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:39.832917 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7a3b1a6d-6d82-4114-8ae3-913eeac0998c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdda7c23819f49099f62a076eb9175b2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:39.836452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294c92e-206e-40a1-896c-389e49aa845c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:39.840516 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d1421-0f62-4643-b19e-398ac13a2e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:39.841179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d1421-0f62-4643-b19e-398ac13a2e48 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:39.841463 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d1421-0f62-4643-b19e-398ac13a2e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:39.841753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d1421-0f62-4643-b19e-398ac13a2e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:39.843663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6f9d1421-0f62-4643-b19e-398ac13a2e48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:39.846190 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7a3b1a6d-6d82-4114-8ae3-913eeac0998c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdda7c23819f49099f62a076eb9175b2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:39.854510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7a3b1a6d-6d82-4114-8ae3-913eeac0998c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdda7c23819f49099f62a076eb9175b2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:39.854803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7a3b1a6d-6d82-4114-8ae3-913eeac0998c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdda7c23819f49099f62a076eb9175b2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:39.906025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d1421-0f62-4643-b19e-398ac13a2e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:39.907455 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d1421-0f62-4643-b19e-398ac13a2e48 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:39.917346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1022/2059] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:39.918165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d1421-0f62-4643-b19e-398ac13a2e48 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:39.919453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6f9d1421-0f62-4643-b19e-398ac13a2e48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:39.978018 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7a3b1a6d-6d82-4114-8ae3-913eeac0998c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdda7c23819f49099f62a076eb9175b2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:39.983010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d1421-0f62-4643-b19e-398ac13a2e48 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:39.985619 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1038/2060] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:39 2022] DELETE /identity/v3/users/cdda7c23819f49099f62a076eb9175b2 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:39.990303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd7ea9-6b31-432b-85ca-e43dec269dfa None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:39.990586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd7ea9-6b31-432b-85ca-e43dec269dfa None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:39.990881 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd7ea9-6b31-432b-85ca-e43dec269dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:39.991098 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b50a81-0880-4824-b835-06572d65527c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:39.991733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b50a81-0880-4824-b835-06572d65527c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:39.992014 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b50a81-0880-4824-b835-06572d65527c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:39.992314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b50a81-0880-4824-b835-06572d65527c admin admin] PATH_INFO: `/v3/users/5e610d42ecd94366b6190ae1703b8eff` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:39.993445 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b50a81-0880-4824-b835-06572d65527c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e610d42ecd94366b6190ae1703b8eff)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:39.995436 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b50a81-0880-4824-b835-06572d65527c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:40.012844 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-67cd7ea9-6b31-432b-85ca-e43dec269dfa None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:40.014060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-67cd7ea9-6b31-432b-85ca-e43dec269dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:40.071153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1039/2061] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:40.080986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd7ea9-6b31-432b-85ca-e43dec269dfa None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:40.082321 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-67cd7ea9-6b31-432b-85ca-e43dec269dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:40.141907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd7ea9-6b31-432b-85ca-e43dec269dfa None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:40.146701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70b7e1-9263-456a-b376-e2420b430a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:40.147772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70b7e1-9263-456a-b376-e2420b430a9e service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:40.148096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70b7e1-9263-456a-b376-e2420b430a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:40.148386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70b7e1-9263-456a-b376-e2420b430a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:40.158847 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70b7e1-9263-456a-b376-e2420b430a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:40.160329 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70b7e1-9263-456a-b376-e2420b430a9e service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:40.171830 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1040/2062] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:33:40.234157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d1b50a81-0880-4824-b835-06572d65527c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e610d42ecd94366b6190ae1703b8eff'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:40.261903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d1b50a81-0880-4824-b835-06572d65527c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e610d42ecd94366b6190ae1703b8eff'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:40.275803 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d1b50a81-0880-4824-b835-06572d65527c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e610d42ecd94366b6190ae1703b8eff'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:40.276869 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d1b50a81-0880-4824-b835-06572d65527c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e610d42ecd94366b6190ae1703b8eff'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:40.396035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d1b50a81-0880-4824-b835-06572d65527c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e610d42ecd94366b6190ae1703b8eff'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:40.404115 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1023/2063] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:39 2022] DELETE /identity/v3/users/5e610d42ecd94366b6190ae1703b8eff => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:40.486957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:40.699039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70b7e1-9263-456a-b376-e2420b430a9e service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:40.700488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-dc70b7e1-9263-456a-b376-e2420b430a9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:40.713127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70b7e1-9263-456a-b376-e2420b430a9e service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:40.735161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b50a81-0880-4824-b835-06572d65527c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:40.737274 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d1b50a81-0880-4824-b835-06572d65527c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:40.776634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4552323-e817-4caa-8e28-9786861ed78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:40.777269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4552323-e817-4caa-8e28-9786861ed78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:40.777544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4552323-e817-4caa-8e28-9786861ed78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:40.777852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4552323-e817-4caa-8e28-9786861ed78c admin admin] PATH_INFO: `/v3/projects/30806d48388c44cf8ed6062c59ec7b48` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:40.779020 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4552323-e817-4caa-8e28-9786861ed78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=30806d48388c44cf8ed6062c59ec7b48)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:40.780908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4552323-e817-4caa-8e28-9786861ed78c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:40.819886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b50a81-0880-4824-b835-06572d65527c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:40.824732 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163eb9a-593a-49f7-b617-17f85e306937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:40.825371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163eb9a-593a-49f7-b617-17f85e306937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:40.825677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163eb9a-593a-49f7-b617-17f85e306937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:40.825981 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163eb9a-593a-49f7-b617-17f85e306937 admin admin] PATH_INFO: `/v3/projects/238a79d7e4cd401aade4f3dfd279e829` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:40.827127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163eb9a-593a-49f7-b617-17f85e306937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=238a79d7e4cd401aade4f3dfd279e829)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:40.829045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163eb9a-593a-49f7-b617-17f85e306937 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:40.902993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e4552323-e817-4caa-8e28-9786861ed78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30806d48388c44cf8ed6062c59ec7b48', 'request_id': 'req-e4552323-e817-4caa-8e28-9786861ed78c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:40.926484 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:40.943835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c163eb9a-593a-49f7-b617-17f85e306937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '238a79d7e4cd401aade4f3dfd279e829', 'request_id': 'req-c163eb9a-593a-49f7-b617-17f85e306937'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:40.994805 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e4552323-e817-4caa-8e28-9786861ed78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30806d48388c44cf8ed6062c59ec7b48', 'request_id': 'req-e4552323-e817-4caa-8e28-9786861ed78c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:41.001517 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e4552323-e817-4caa-8e28-9786861ed78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30806d48388c44cf8ed6062c59ec7b48', 'request_id': 'req-e4552323-e817-4caa-8e28-9786861ed78c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:41.012378 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e4552323-e817-4caa-8e28-9786861ed78c admin admin] The token cache is being invalidate because project 30806d48388c44cf8ed6062c59ec7b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:41.012669 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e4552323-e817-4caa-8e28-9786861ed78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:41.013347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e4552323-e817-4caa-8e28-9786861ed78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:41.014850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1041/2064] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:40 2022] DELETE /identity/v3/projects/30806d48388c44cf8ed6062c59ec7b48 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:41.018635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4552323-e817-4caa-8e28-9786861ed78c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:41.019979 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e4552323-e817-4caa-8e28-9786861ed78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:41.063147 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c163eb9a-593a-49f7-b617-17f85e306937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '238a79d7e4cd401aade4f3dfd279e829', 'request_id': 'req-c163eb9a-593a-49f7-b617-17f85e306937'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:41.069082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c163eb9a-593a-49f7-b617-17f85e306937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '238a79d7e4cd401aade4f3dfd279e829', 'request_id': 'req-c163eb9a-593a-49f7-b617-17f85e306937'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:41.081403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c163eb9a-593a-49f7-b617-17f85e306937 admin admin] The token cache is being invalidate because project 238a79d7e4cd401aade4f3dfd279e829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:41.081696 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c163eb9a-593a-49f7-b617-17f85e306937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:41.082396 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c163eb9a-593a-49f7-b617-17f85e306937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:41.084410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1024/2065] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:40 2022] DELETE /identity/v3/projects/238a79d7e4cd401aade4f3dfd279e829 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:41.089018 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4552323-e817-4caa-8e28-9786861ed78c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:41.089518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a0776-4669-409c-b45f-19823bacd5a6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:41.089904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a0776-4669-409c-b45f-19823bacd5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:41.090186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a0776-4669-409c-b45f-19823bacd5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:41.111371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b54a0776-4669-409c-b45f-19823bacd5a6 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:41.113158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b54a0776-4669-409c-b45f-19823bacd5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:41.148334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ad78e-71e1-48bb-996d-c9f613e8d75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:41.148980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ad78e-71e1-48bb-996d-c9f613e8d75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:41.149260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ad78e-71e1-48bb-996d-c9f613e8d75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:41.149524 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ad78e-71e1-48bb-996d-c9f613e8d75c admin admin] PATH_INFO: `/v3/users/763c56d3f28c49ffb2ee7f9315cf4f5e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:41.150711 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ad78e-71e1-48bb-996d-c9f613e8d75c admin admin] RBAC: Authorizing `identity:delete_user(user_id=763c56d3f28c49ffb2ee7f9315cf4f5e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:41.152642 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ad78e-71e1-48bb-996d-c9f613e8d75c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:41.175097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1025/2066] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:41.184211 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d7f7e-d432-4da0-af10-36ff5de192df None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:41.184496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d7f7e-d432-4da0-af10-36ff5de192df None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:41.184772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d7f7e-d432-4da0-af10-36ff5de192df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:41.203994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-623d7f7e-d432-4da0-af10-36ff5de192df None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:41.205194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-623d7f7e-d432-4da0-af10-36ff5de192df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:41.213992 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1026/2067] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:41.218165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d7f7e-d432-4da0-af10-36ff5de192df None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:41.228211 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d7f7e-d432-4da0-af10-36ff5de192df None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:41.233457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9890e-7198-4c75-a8bb-274dfe4e4049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:41.234124 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9890e-7198-4c75-a8bb-274dfe4e4049 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:41.238660 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9890e-7198-4c75-a8bb-274dfe4e4049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:41.238660 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9890e-7198-4c75-a8bb-274dfe4e4049 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:41.238660 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9890e-7198-4c75-a8bb-274dfe4e4049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:33:41.238660 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9890e-7198-4c75-a8bb-274dfe4e4049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:41.238660 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9890e-7198-4c75-a8bb-274dfe4e4049 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:41.249408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1027/2068] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:33:41.253683 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9890e-7198-4c75-a8bb-274dfe4e4049 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:41.263432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9890e-7198-4c75-a8bb-274dfe4e4049 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:41.268157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59a035-b91e-447c-92aa-4691e0a49c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:41.268757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59a035-b91e-447c-92aa-4691e0a49c4b admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:41.269039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59a035-b91e-447c-92aa-4691e0a49c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:41.269314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59a035-b91e-447c-92aa-4691e0a49c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:41.270040 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59a035-b91e-447c-92aa-4691e0a49c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:41.272684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59a035-b91e-447c-92aa-4691e0a49c4b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:41.357833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3c9ad78e-71e1-48bb-996d-c9f613e8d75c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763c56d3f28c49ffb2ee7f9315cf4f5e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:41.371326 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3c9ad78e-71e1-48bb-996d-c9f613e8d75c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763c56d3f28c49ffb2ee7f9315cf4f5e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:41.377206 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1028/2069] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:41 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:41.378155 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59a035-b91e-447c-92aa-4691e0a49c4b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:41.383634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3c9ad78e-71e1-48bb-996d-c9f613e8d75c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763c56d3f28c49ffb2ee7f9315cf4f5e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:41.384736 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3c9ad78e-71e1-48bb-996d-c9f613e8d75c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763c56d3f28c49ffb2ee7f9315cf4f5e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:41.442904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59a035-b91e-447c-92aa-4691e0a49c4b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:41.447676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761c861-bc48-41ca-947f-6e4b88624856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:41.448271 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761c861-bc48-41ca-947f-6e4b88624856 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:41.448547 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761c861-bc48-41ca-947f-6e4b88624856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:41.448812 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761c861-bc48-41ca-947f-6e4b88624856 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:41.449439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761c861-bc48-41ca-947f-6e4b88624856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:41.451482 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761c861-bc48-41ca-947f-6e4b88624856 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:41.480796 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3c9ad78e-71e1-48bb-996d-c9f613e8d75c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763c56d3f28c49ffb2ee7f9315cf4f5e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:41.487372 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1042/2070] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:41 2022] DELETE /identity/v3/users/763c56d3f28c49ffb2ee7f9315cf4f5e => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:41.593352 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1029/2071] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:41 2022] POST /identity/v3/users => generated 284 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:41.594694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ad78e-71e1-48bb-996d-c9f613e8d75c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:41.596114 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3c9ad78e-71e1-48bb-996d-c9f613e8d75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:41.660072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ad78e-71e1-48bb-996d-c9f613e8d75c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:41.664681 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a20463-0421-4770-b010-634871337930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:41.665280 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a20463-0421-4770-b010-634871337930 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:41.665557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a20463-0421-4770-b010-634871337930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:41.665858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a20463-0421-4770-b010-634871337930 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:41.666500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a20463-0421-4770-b010-634871337930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:41.668113 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a20463-0421-4770-b010-634871337930 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:41.678232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1043/2072] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:41.682282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761c861-bc48-41ca-947f-6e4b88624856 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:41.692236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761c861-bc48-41ca-947f-6e4b88624856 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:41.697293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570e248-c6ee-4c50-bfb8-1a6cf0b864c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:41.697921 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570e248-c6ee-4c50-bfb8-1a6cf0b864c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:41.698220 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570e248-c6ee-4c50-bfb8-1a6cf0b864c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:41.698471 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570e248-c6ee-4c50-bfb8-1a6cf0b864c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:41.699114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570e248-c6ee-4c50-bfb8-1a6cf0b864c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:41.700700 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570e248-c6ee-4c50-bfb8-1a6cf0b864c9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:41.701631 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a20463-0421-4770-b010-634871337930 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:41.703438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-01a20463-0421-4770-b010-634871337930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:41.711584 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1030/2073] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:41.715839 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570e248-c6ee-4c50-bfb8-1a6cf0b864c9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:41.716045 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a20463-0421-4770-b010-634871337930 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:41.720915 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c753a73-665b-40ce-9106-4ee2111efcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:41.721286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753a73-665b-40ce-9106-4ee2111efcd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:41.721564 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753a73-665b-40ce-9106-4ee2111efcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:41.721874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753a73-665b-40ce-9106-4ee2111efcd0 admin admin] PATH_INFO: `/v3/users/24f498153c154f809da405ae3fc73c86` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:41.723101 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c753a73-665b-40ce-9106-4ee2111efcd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24f498153c154f809da405ae3fc73c86)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:41.725473 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c753a73-665b-40ce-9106-4ee2111efcd0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:41.725620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570e248-c6ee-4c50-bfb8-1a6cf0b864c9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:41.730793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f5fcf-ff44-48da-9726-b3d5c57eade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:41.731519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f5fcf-ff44-48da-9726-b3d5c57eade0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:41.731873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f5fcf-ff44-48da-9726-b3d5c57eade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:41.732219 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f5fcf-ff44-48da-9726-b3d5c57eade0 admin admin] PATH_INFO: `/v3/projects/bc168cfc07d943a48242eee3c95ccf2c/users/7d11a0b019364881afc3e69b05314759/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:41.771555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f5fcf-ff44-48da-9726-b3d5c57eade0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc168cfc07d943a48242eee3c95ccf2c, user_id=7d11a0b019364881afc3e69b05314759, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:41.771555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f5fcf-ff44-48da-9726-b3d5c57eade0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:41.978386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1031/2074] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:41 2022] PUT /identity/v3/projects/bc168cfc07d943a48242eee3c95ccf2c/users/7d11a0b019364881afc3e69b05314759/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:41.988535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5098f-99f2-42eb-927b-daa43d750e7e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:41.988820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5098f-99f2-42eb-927b-daa43d750e7e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:41.989608 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5098f-99f2-42eb-927b-daa43d750e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:42.016960 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b6f5098f-99f2-42eb-927b-daa43d750e7e None None] MFA Rules not processed for user `7d11a0b019364881afc3e69b05314759`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:42.018217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b6f5098f-99f2-42eb-927b-daa43d750e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:42.079435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1032/2075] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:42.083949 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5098f-99f2-42eb-927b-daa43d750e7e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:42.131138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9c753a73-665b-40ce-9106-4ee2111efcd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24f498153c154f809da405ae3fc73c86'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:42.148327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9c753a73-665b-40ce-9106-4ee2111efcd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24f498153c154f809da405ae3fc73c86'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:42.157200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9c753a73-665b-40ce-9106-4ee2111efcd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24f498153c154f809da405ae3fc73c86'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:42.157956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9c753a73-665b-40ce-9106-4ee2111efcd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24f498153c154f809da405ae3fc73c86'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:42.159592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5098f-99f2-42eb-927b-daa43d750e7e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:42.166959 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10749a96-f260-4b78-8c8c-c68e8ab5b1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:42.167790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10749a96-f260-4b78-8c8c-c68e8ab5b1bf admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:42.168119 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10749a96-f260-4b78-8c8c-c68e8ab5b1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:42.168423 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10749a96-f260-4b78-8c8c-c68e8ab5b1bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:42.169256 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10749a96-f260-4b78-8c8c-c68e8ab5b1bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:42.171288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10749a96-f260-4b78-8c8c-c68e8ab5b1bf admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:42.251924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9c753a73-665b-40ce-9106-4ee2111efcd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24f498153c154f809da405ae3fc73c86'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:42.258302 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1044/2076] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:41 2022] DELETE /identity/v3/users/24f498153c154f809da405ae3fc73c86 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:42.259079 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c753a73-665b-40ce-9106-4ee2111efcd0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:42.260422 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9c753a73-665b-40ce-9106-4ee2111efcd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:42.308156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1033/2077] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:42 2022] POST /identity/v3/projects => generated 365 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:42.309638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb4f0-9ea8-4700-823e-5987a19628e6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:42.309881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb4f0-9ea8-4700-823e-5987a19628e6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:42.310116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb4f0-9ea8-4700-823e-5987a19628e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:42.330070 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1aacb4f0-9ea8-4700-823e-5987a19628e6 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:42.331383 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1aacb4f0-9ea8-4700-823e-5987a19628e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:42.333561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c753a73-665b-40ce-9106-4ee2111efcd0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:42.399014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340493b-8c50-406c-ad42-915a266842a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:42.399014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340493b-8c50-406c-ad42-915a266842a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:42.399014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340493b-8c50-406c-ad42-915a266842a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:42.399399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1034/2078] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:42.399479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340493b-8c50-406c-ad42-915a266842a1 admin admin] PATH_INFO: `/v3/projects/b891c3892cae45dda2665d27db0d24c6` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:42.399551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacb4f0-9ea8-4700-823e-5987a19628e6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:42.399621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340493b-8c50-406c-ad42-915a266842a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b891c3892cae45dda2665d27db0d24c6)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:42.399689 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1aacb4f0-9ea8-4700-823e-5987a19628e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:42.399758 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340493b-8c50-406c-ad42-915a266842a1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:42.407468 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacb4f0-9ea8-4700-823e-5987a19628e6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:42.417042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb514264-20dc-415b-8537-925aeb40389a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:42.417042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb514264-20dc-415b-8537-925aeb40389a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:42.417042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb514264-20dc-415b-8537-925aeb40389a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:42.417042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb514264-20dc-415b-8537-925aeb40389a admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:42.417432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb514264-20dc-415b-8537-925aeb40389a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:42.417432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb514264-20dc-415b-8537-925aeb40389a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:42.439844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:42.534327 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1035/2079] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:42 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:42.538849 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb514264-20dc-415b-8537-925aeb40389a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:42.538849 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fb514264-20dc-415b-8537-925aeb40389a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:42.552020 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2340493b-8c50-406c-ad42-915a266842a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b891c3892cae45dda2665d27db0d24c6', 'request_id': 'req-2340493b-8c50-406c-ad42-915a266842a1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:42.594691 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb514264-20dc-415b-8537-925aeb40389a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:42.641060 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a655e98-2f81-4e07-a468-a7e89d9e6976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:42.641588 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a655e98-2f81-4e07-a468-a7e89d9e6976 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:42.641893 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a655e98-2f81-4e07-a468-a7e89d9e6976 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:42.642164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a655e98-2f81-4e07-a468-a7e89d9e6976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:42.697929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2340493b-8c50-406c-ad42-915a266842a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b891c3892cae45dda2665d27db0d24c6', 'request_id': 'req-2340493b-8c50-406c-ad42-915a266842a1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:42.701377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a655e98-2f81-4e07-a468-a7e89d9e6976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:42.702569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:42.702873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a655e98-2f81-4e07-a468-a7e89d9e6976 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:42.706872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2340493b-8c50-406c-ad42-915a266842a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b891c3892cae45dda2665d27db0d24c6', 'request_id': 'req-2340493b-8c50-406c-ad42-915a266842a1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:42.713500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1036/2080] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:42.714260 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a655e98-2f81-4e07-a468-a7e89d9e6976 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:42.720431 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2340493b-8c50-406c-ad42-915a266842a1 admin admin] The token cache is being invalidate because project b891c3892cae45dda2665d27db0d24c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:42.721045 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2340493b-8c50-406c-ad42-915a266842a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:42.722052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2340493b-8c50-406c-ad42-915a266842a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:42.725145 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a655e98-2f81-4e07-a468-a7e89d9e6976 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:42.726218 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1045/2081] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:42 2022] DELETE /identity/v3/projects/b891c3892cae45dda2665d27db0d24c6 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:42.731927 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62befe-e171-459d-99dd-62b4a91d97d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:42.732471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f30424-556e-4ca6-8499-670927064bdc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:42.732603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62befe-e171-459d-99dd-62b4a91d97d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:42.732796 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62befe-e171-459d-99dd-62b4a91d97d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:42.733065 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62befe-e171-459d-99dd-62b4a91d97d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:42.733415 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f30424-556e-4ca6-8499-670927064bdc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:42.733698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62befe-e171-459d-99dd-62b4a91d97d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:42.734106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f30424-556e-4ca6-8499-670927064bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:42.735310 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62befe-e171-459d-99dd-62b4a91d97d7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:42.746936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1037/2082] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:42.751179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62befe-e171-459d-99dd-62b4a91d97d7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:42.753564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fd62befe-e171-459d-99dd-62b4a91d97d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:42.761870 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-09f30424-556e-4ca6-8499-670927064bdc None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:42.763461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-09f30424-556e-4ca6-8499-670927064bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:42.767190 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62befe-e171-459d-99dd-62b4a91d97d7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:42.773467 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1046/2083] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:42.773618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a33dab-ef96-470b-b175-50baa46cfeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:42.774332 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a33dab-ef96-470b-b175-50baa46cfeb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:42.775210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a33dab-ef96-470b-b175-50baa46cfeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:42.775210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a33dab-ef96-470b-b175-50baa46cfeb7 admin admin] PATH_INFO: `/v3/projects/cb35207f41954a62b99e8f08b2ad520c/users/25e693e6b42148eabbf6e07d476a6819/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:42.781019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2814548-ea2a-4d52-8203-b359fa812d12 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:42.781298 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2814548-ea2a-4d52-8203-b359fa812d12 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:42.781566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2814548-ea2a-4d52-8203-b359fa812d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:42.791697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a33dab-ef96-470b-b175-50baa46cfeb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb35207f41954a62b99e8f08b2ad520c, user_id=25e693e6b42148eabbf6e07d476a6819, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:42.794398 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a33dab-ef96-470b-b175-50baa46cfeb7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:42.803419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f2814548-ea2a-4d52-8203-b359fa812d12 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:42.804619 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f2814548-ea2a-4d52-8203-b359fa812d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:42.812695 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1047/2084] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:42.820680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2814548-ea2a-4d52-8203-b359fa812d12 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:42.829470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2814548-ea2a-4d52-8203-b359fa812d12 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:42.838965 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684142f-cb89-48dc-be1b-75a21c98933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:42.839807 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684142f-cb89-48dc-be1b-75a21c98933d admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:42.843299 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684142f-cb89-48dc-be1b-75a21c98933d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:42.843299 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684142f-cb89-48dc-be1b-75a21c98933d admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:42.843299 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684142f-cb89-48dc-be1b-75a21c98933d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:33:42.843299 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684142f-cb89-48dc-be1b-75a21c98933d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:42.843634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684142f-cb89-48dc-be1b-75a21c98933d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:42.857800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1048/2085] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:33:42.862963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684142f-cb89-48dc-be1b-75a21c98933d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:42.870158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1038/2086] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:42 2022] PUT /identity/v3/projects/cb35207f41954a62b99e8f08b2ad520c/users/25e693e6b42148eabbf6e07d476a6819/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:42.874025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a33dab-ef96-470b-b175-50baa46cfeb7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:42.876093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684142f-cb89-48dc-be1b-75a21c98933d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:42.939755 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a33dab-ef96-470b-b175-50baa46cfeb7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:42.940848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36083e8-f235-4018-9dcf-05eca8a0c120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:42.941596 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36083e8-f235-4018-9dcf-05eca8a0c120 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:42.942012 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36083e8-f235-4018-9dcf-05eca8a0c120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:42.942312 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36083e8-f235-4018-9dcf-05eca8a0c120 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:42.942941 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36083e8-f235-4018-9dcf-05eca8a0c120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:42.944381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05764559-2953-438b-828c-cb823887723f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:42.944876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36083e8-f235-4018-9dcf-05eca8a0c120 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:42.944974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05764559-2953-438b-828c-cb823887723f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:42.945235 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05764559-2953-438b-828c-cb823887723f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:42.945507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05764559-2953-438b-828c-cb823887723f admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:42.946216 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05764559-2953-438b-828c-cb823887723f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:42.948142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05764559-2953-438b-828c-cb823887723f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:42.959515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1039/2087] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:42.963148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05764559-2953-438b-828c-cb823887723f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:42.975397 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05764559-2953-438b-828c-cb823887723f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:42.980835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d8555-0eac-4b70-aff6-40b4d8563c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:42.981503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d8555-0eac-4b70-aff6-40b4d8563c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:42.981841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d8555-0eac-4b70-aff6-40b4d8563c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:42.982091 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d8555-0eac-4b70-aff6-40b4d8563c7e admin admin] PATH_INFO: `/v3/projects/cb35207f41954a62b99e8f08b2ad520c/users/25e693e6b42148eabbf6e07d476a6819/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:42.986120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d8555-0eac-4b70-aff6-40b4d8563c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb35207f41954a62b99e8f08b2ad520c, user_id=25e693e6b42148eabbf6e07d476a6819, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:42.986854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d8555-0eac-4b70-aff6-40b4d8563c7e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:42.998685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1040/2088] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:42 2022] PUT /identity/v3/projects/cb35207f41954a62b99e8f08b2ad520c/users/25e693e6b42148eabbf6e07d476a6819/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:43.012717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952396c-fe59-4f77-94a9-4cf975b65d03 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:43.012717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952396c-fe59-4f77-94a9-4cf975b65d03 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:43.012717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952396c-fe59-4f77-94a9-4cf975b65d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:43.046970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2952396c-fe59-4f77-94a9-4cf975b65d03 None None] MFA Rules not processed for user `25e693e6b42148eabbf6e07d476a6819`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:43.048262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2952396c-fe59-4f77-94a9-4cf975b65d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:43.123292 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1041/2089] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:43.124154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952396c-fe59-4f77-94a9-4cf975b65d03 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:43.125434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2952396c-fe59-4f77-94a9-4cf975b65d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:43.150696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1049/2090] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:42 2022] POST /identity/v3/projects => generated 387 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:43.151492 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36083e8-f235-4018-9dcf-05eca8a0c120 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:43.154433 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d36083e8-f235-4018-9dcf-05eca8a0c120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:43.193982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952396c-fe59-4f77-94a9-4cf975b65d03 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:43.225233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36083e8-f235-4018-9dcf-05eca8a0c120 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:43.229207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200930e-4051-45fe-b37f-881b7edd2550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:43.230232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200930e-4051-45fe-b37f-881b7edd2550 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:43.230635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200930e-4051-45fe-b37f-881b7edd2550 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:43.230966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200930e-4051-45fe-b37f-881b7edd2550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:43.272398 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b49f0f-5b0b-41ff-a697-4345048c4fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:43.273339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b49f0f-5b0b-41ff-a697-4345048c4fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:43.273792 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b49f0f-5b0b-41ff-a697-4345048c4fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:43.274214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b49f0f-5b0b-41ff-a697-4345048c4fcd admin admin] PATH_INFO: `/v3/projects/31401a1bf56e4f0dbdd557c0ec6cd5cb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:43.275543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b49f0f-5b0b-41ff-a697-4345048c4fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=31401a1bf56e4f0dbdd557c0ec6cd5cb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:43.277713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b49f0f-5b0b-41ff-a697-4345048c4fcd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:43.299475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200930e-4051-45fe-b37f-881b7edd2550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:43.300929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200930e-4051-45fe-b37f-881b7edd2550 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:43.311528 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1050/2091] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:43.312445 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200930e-4051-45fe-b37f-881b7edd2550 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:43.324268 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200930e-4051-45fe-b37f-881b7edd2550 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:43.329493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e9173-275a-4269-9566-4c763d1a785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:43.331070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e9173-275a-4269-9566-4c763d1a785b admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:43.331070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e9173-275a-4269-9566-4c763d1a785b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:43.331070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e9173-275a-4269-9566-4c763d1a785b admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:43.331471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e9173-275a-4269-9566-4c763d1a785b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:43.334134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e9173-275a-4269-9566-4c763d1a785b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:43.413551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-28b49f0f-5b0b-41ff-a697-4345048c4fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31401a1bf56e4f0dbdd557c0ec6cd5cb', 'request_id': 'req-28b49f0f-5b0b-41ff-a697-4345048c4fcd'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:43.431187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1051/2092] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:43 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:43.437619 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e9173-275a-4269-9566-4c763d1a785b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:43.447390 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e9173-275a-4269-9566-4c763d1a785b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:43.475773 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-28b49f0f-5b0b-41ff-a697-4345048c4fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31401a1bf56e4f0dbdd557c0ec6cd5cb', 'request_id': 'req-28b49f0f-5b0b-41ff-a697-4345048c4fcd'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:43.482117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-28b49f0f-5b0b-41ff-a697-4345048c4fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31401a1bf56e4f0dbdd557c0ec6cd5cb', 'request_id': 'req-28b49f0f-5b0b-41ff-a697-4345048c4fcd'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:43.494195 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-28b49f0f-5b0b-41ff-a697-4345048c4fcd admin admin] The token cache is being invalidate because project 31401a1bf56e4f0dbdd557c0ec6cd5cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:43.494694 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-28b49f0f-5b0b-41ff-a697-4345048c4fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:43.495520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-28b49f0f-5b0b-41ff-a697-4345048c4fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:43.497416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1042/2093] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:43 2022] DELETE /identity/v3/projects/31401a1bf56e4f0dbdd557c0ec6cd5cb => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:43.502341 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2df3ab-8841-405b-a4c7-7a386ad9b33c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:43.502685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2df3ab-8841-405b-a4c7-7a386ad9b33c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:43.502962 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2df3ab-8841-405b-a4c7-7a386ad9b33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:43.508373 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9b098-1d5e-4919-b543-cdc5bc392f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:43.515973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9b098-1d5e-4919-b543-cdc5bc392f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:43.515973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9b098-1d5e-4919-b543-cdc5bc392f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:43.515973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9b098-1d5e-4919-b543-cdc5bc392f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:43.515973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9b098-1d5e-4919-b543-cdc5bc392f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:43.515973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9b098-1d5e-4919-b543-cdc5bc392f36 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:43.524134 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bf2df3ab-8841-405b-a4c7-7a386ad9b33c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:43.525565 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bf2df3ab-8841-405b-a4c7-7a386ad9b33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:43.525990 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1052/2094] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:43.530072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9b098-1d5e-4919-b543-cdc5bc392f36 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:43.531863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7ed9b098-1d5e-4919-b543-cdc5bc392f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:43.537225 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1043/2095] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:43.545900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c0891-5ca3-4519-ba10-f23c3e9a373c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:43.546185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c0891-5ca3-4519-ba10-f23c3e9a373c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:43.546494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c0891-5ca3-4519-ba10-f23c3e9a373c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:43.547503 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9b098-1d5e-4919-b543-cdc5bc392f36 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:43.553239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe69d3-d993-47ee-ac13-d4b0b52620db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:43.554077 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe69d3-d993-47ee-ac13-d4b0b52620db admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:43.555650 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe69d3-d993-47ee-ac13-d4b0b52620db admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:43.556051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe69d3-d993-47ee-ac13-d4b0b52620db admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:43.562163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe69d3-d993-47ee-ac13-d4b0b52620db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:43.562163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe69d3-d993-47ee-ac13-d4b0b52620db admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:43.569475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c22c0891-5ca3-4519-ba10-f23c3e9a373c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:43.570844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c22c0891-5ca3-4519-ba10-f23c3e9a373c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:43.575274 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1053/2096] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:43.575914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe69d3-d993-47ee-ac13-d4b0b52620db admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:43.579570 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c9fe69d3-d993-47ee-ac13-d4b0b52620db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:43.584215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1044/2097] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:43.587519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c0891-5ca3-4519-ba10-f23c3e9a373c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:43.597885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c0891-5ca3-4519-ba10-f23c3e9a373c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:43.602973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58445770-ef6e-4f94-a6bd-a0b92a0c5302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:43.603624 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58445770-ef6e-4f94-a6bd-a0b92a0c5302 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:43.604201 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58445770-ef6e-4f94-a6bd-a0b92a0c5302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:43.604201 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58445770-ef6e-4f94-a6bd-a0b92a0c5302 admin admin] PATH_INFO: `/v3/projects/f19fed04f63840828c2038b667761277/users/aa1aa918ebb1404295336e29555a14d6/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:43.619979 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58445770-ef6e-4f94-a6bd-a0b92a0c5302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19fed04f63840828c2038b667761277, user_id=aa1aa918ebb1404295336e29555a14d6, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:43.622889 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58445770-ef6e-4f94-a6bd-a0b92a0c5302 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:43.640050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe69d3-d993-47ee-ac13-d4b0b52620db admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:43.643712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49aaf6-f38c-4b87-b5cd-6617a2161c4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:43.644313 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49aaf6-f38c-4b87-b5cd-6617a2161c4b service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:43.644588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49aaf6-f38c-4b87-b5cd-6617a2161c4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:43.644915 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49aaf6-f38c-4b87-b5cd-6617a2161c4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:43.647540 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7e49aaf6-f38c-4b87-b5cd-6617a2161c4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:43.706511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49aaf6-f38c-4b87-b5cd-6617a2161c4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:43.708747 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49aaf6-f38c-4b87-b5cd-6617a2161c4b service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:43.718080 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1054/2098] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:43.718692 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49aaf6-f38c-4b87-b5cd-6617a2161c4b service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:43.728381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1045/2099] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:43 2022] PUT /identity/v3/projects/f19fed04f63840828c2038b667761277/users/aa1aa918ebb1404295336e29555a14d6/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:43.729690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49aaf6-f38c-4b87-b5cd-6617a2161c4b service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:43.740041 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775d5ff-2956-4e23-b57e-d1b74378890a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:43.740387 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775d5ff-2956-4e23-b57e-d1b74378890a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:43.740731 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775d5ff-2956-4e23-b57e-d1b74378890a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:43.770957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1775d5ff-2956-4e23-b57e-d1b74378890a None None] MFA Rules not processed for user `aa1aa918ebb1404295336e29555a14d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:43.772524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1775d5ff-2956-4e23-b57e-d1b74378890a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:43.795848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18439d95-7e51-41f7-b2df-3ae958539369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:43.795848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18439d95-7e51-41f7-b2df-3ae958539369 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:43.795848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18439d95-7e51-41f7-b2df-3ae958539369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:43.795848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18439d95-7e51-41f7-b2df-3ae958539369 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:43.796189 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18439d95-7e51-41f7-b2df-3ae958539369 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:33:43.796189 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18439d95-7e51-41f7-b2df-3ae958539369 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:43.797103 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18439d95-7e51-41f7-b2df-3ae958539369 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:43.808882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1055/2100] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:33:43.813438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18439d95-7e51-41f7-b2df-3ae958539369 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:43.823502 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18439d95-7e51-41f7-b2df-3ae958539369 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:43.830931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dc5c4-c997-488d-b4e9-b35ac84cf2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:43.830931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dc5c4-c997-488d-b4e9-b35ac84cf2bb admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:43.830931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dc5c4-c997-488d-b4e9-b35ac84cf2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:43.830931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dc5c4-c997-488d-b4e9-b35ac84cf2bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:43.831498 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dc5c4-c997-488d-b4e9-b35ac84cf2bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:43.835008 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dc5c4-c997-488d-b4e9-b35ac84cf2bb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:43.857702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1046/2101] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:43.864676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775d5ff-2956-4e23-b57e-d1b74378890a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:43.872948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775d5ff-2956-4e23-b57e-d1b74378890a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:43.878318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb6ea0-ddbb-42cf-8587-c27d3950fbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:43.878920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb6ea0-ddbb-42cf-8587-c27d3950fbc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:43.879202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb6ea0-ddbb-42cf-8587-c27d3950fbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:43.879996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb6ea0-ddbb-42cf-8587-c27d3950fbc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:43.880629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb6ea0-ddbb-42cf-8587-c27d3950fbc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:43.882582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb6ea0-ddbb-42cf-8587-c27d3950fbc1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:43.956266 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1056/2102] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:43 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:43.960282 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dc5c4-c997-488d-b4e9-b35ac84cf2bb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:44.023082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1047/2103] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:43 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:44.025158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dc5c4-c997-488d-b4e9-b35ac84cf2bb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:44.027406 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb6ea0-ddbb-42cf-8587-c27d3950fbc1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:44.069075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:44.083186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800312f-aca9-44fd-bf2b-4dc21fccf288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:44.083796 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800312f-aca9-44fd-bf2b-4dc21fccf288 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:44.084077 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800312f-aca9-44fd-bf2b-4dc21fccf288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:44.084354 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800312f-aca9-44fd-bf2b-4dc21fccf288 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:44.085010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800312f-aca9-44fd-bf2b-4dc21fccf288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:44.086966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800312f-aca9-44fd-bf2b-4dc21fccf288 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:44.089288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb6ea0-ddbb-42cf-8587-c27d3950fbc1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:44.093948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d3d37-4eae-4e9a-87ee-6174b2b850e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:44.094540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d3d37-4eae-4e9a-87ee-6174b2b850e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:44.094824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d3d37-4eae-4e9a-87ee-6174b2b850e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:44.095088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d3d37-4eae-4e9a-87ee-6174b2b850e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:44.095704 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d3d37-4eae-4e9a-87ee-6174b2b850e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:44.097949 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d3d37-4eae-4e9a-87ee-6174b2b850e1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:44.156480 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:44.191798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1048/2104] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:44 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:44.192031 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1057/2105] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:43 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:44.197430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d3d37-4eae-4e9a-87ee-6174b2b850e1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:44.198973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800312f-aca9-44fd-bf2b-4dc21fccf288 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:44.208662 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d3d37-4eae-4e9a-87ee-6174b2b850e1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:44.211836 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800312f-aca9-44fd-bf2b-4dc21fccf288 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:44.214328 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ebb86-1589-48cd-8ff3-69312f1149ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:44.215025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ebb86-1589-48cd-8ff3-69312f1149ff admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:44.215311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ebb86-1589-48cd-8ff3-69312f1149ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:44.215590 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ebb86-1589-48cd-8ff3-69312f1149ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:44.216322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ebb86-1589-48cd-8ff3-69312f1149ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:44.217980 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ebb86-1589-48cd-8ff3-69312f1149ff admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:44.218400 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f5333-82aa-47d1-a38f-5984970e7f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:44.219309 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f5333-82aa-47d1-a38f-5984970e7f2e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:44.219834 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f5333-82aa-47d1-a38f-5984970e7f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:44.220379 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f5333-82aa-47d1-a38f-5984970e7f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:44.221296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f5333-82aa-47d1-a38f-5984970e7f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:44.223084 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f5333-82aa-47d1-a38f-5984970e7f2e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:44.229413 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1049/2106] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:44.233418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ebb86-1589-48cd-8ff3-69312f1149ff admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:44.240109 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1058/2107] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:44.242943 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f5333-82aa-47d1-a38f-5984970e7f2e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:44.244444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ebb86-1589-48cd-8ff3-69312f1149ff admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:44.249165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fbe42-4b28-48d1-90b1-4f6f22abf3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:44.249789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fbe42-4b28-48d1-90b1-4f6f22abf3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:44.250129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fbe42-4b28-48d1-90b1-4f6f22abf3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:44.250404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fbe42-4b28-48d1-90b1-4f6f22abf3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:44.251096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fbe42-4b28-48d1-90b1-4f6f22abf3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:44.252917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fbe42-4b28-48d1-90b1-4f6f22abf3a8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:44.253857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f5333-82aa-47d1-a38f-5984970e7f2e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:44.259369 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d9059-f8d2-4279-bf05-86bdec0b4214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:44.260213 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d9059-f8d2-4279-bf05-86bdec0b4214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:44.260500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d9059-f8d2-4279-bf05-86bdec0b4214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:44.260935 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d9059-f8d2-4279-bf05-86bdec0b4214 admin admin] PATH_INFO: `/v3/projects/32cc4c7a5e204aba89707a8f227c9968/users/7c2a317d773a4967a9b13d85f766bc17/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:44.265565 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1050/2108] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:44.269920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fbe42-4b28-48d1-90b1-4f6f22abf3a8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:44.283634 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fbe42-4b28-48d1-90b1-4f6f22abf3a8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:44.288683 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568fcb6-7f79-4b8c-ae94-f24ad185ffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:44.289340 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568fcb6-7f79-4b8c-ae94-f24ad185ffe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:44.289616 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568fcb6-7f79-4b8c-ae94-f24ad185ffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:44.289928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568fcb6-7f79-4b8c-ae94-f24ad185ffe8 admin admin] PATH_INFO: `/v3/projects/1189a34c520e4c7289affda6101c1180/users/93d9d6782d7d4f5cb82afa51d77415c2/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:44.294647 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d9059-f8d2-4279-bf05-86bdec0b4214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32cc4c7a5e204aba89707a8f227c9968, user_id=7c2a317d773a4967a9b13d85f766bc17, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:44.297291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d9059-f8d2-4279-bf05-86bdec0b4214 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:44.307333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568fcb6-7f79-4b8c-ae94-f24ad185ffe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1189a34c520e4c7289affda6101c1180, user_id=93d9d6782d7d4f5cb82afa51d77415c2, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:44.310106 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568fcb6-7f79-4b8c-ae94-f24ad185ffe8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:44.355580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1059/2109] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:44 2022] PUT /identity/v3/projects/32cc4c7a5e204aba89707a8f227c9968/users/7c2a317d773a4967a9b13d85f766bc17/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:44.359507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d9059-f8d2-4279-bf05-86bdec0b4214 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:44.384114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1051/2110] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:44 2022] PUT /identity/v3/projects/1189a34c520e4c7289affda6101c1180/users/93d9d6782d7d4f5cb82afa51d77415c2/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:44.403291 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4a37d-b78c-49ee-a3bd-ba8e20e17e5f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:44.403581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4a37d-b78c-49ee-a3bd-ba8e20e17e5f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:44.403862 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4a37d-b78c-49ee-a3bd-ba8e20e17e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:44.425533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-59e4a37d-b78c-49ee-a3bd-ba8e20e17e5f None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:44.428021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-59e4a37d-b78c-49ee-a3bd-ba8e20e17e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:44.429626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d9059-f8d2-4279-bf05-86bdec0b4214 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:44.502092 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeafb92-a22a-4ace-823c-7a820091b8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:44.502706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeafb92-a22a-4ace-823c-7a820091b8bc admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:44.502978 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeafb92-a22a-4ace-823c-7a820091b8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:44.503250 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeafb92-a22a-4ace-823c-7a820091b8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:44.503908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeafb92-a22a-4ace-823c-7a820091b8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:44.508394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1052/2111] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:44.508701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeafb92-a22a-4ace-823c-7a820091b8bc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:44.522343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4a37d-b78c-49ee-a3bd-ba8e20e17e5f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:44.522343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-59e4a37d-b78c-49ee-a3bd-ba8e20e17e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:44.528652 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1060/2112] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:44.529527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeafb92-a22a-4ace-823c-7a820091b8bc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:44.541612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeafb92-a22a-4ace-823c-7a820091b8bc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:44.553950 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350f666-800f-44e4-a84a-57a4da537e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:44.555008 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f666-800f-44e4-a84a-57a4da537e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:44.555296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f666-800f-44e4-a84a-57a4da537e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:44.555576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f666-800f-44e4-a84a-57a4da537e1c admin admin] PATH_INFO: `/v3/projects/32cc4c7a5e204aba89707a8f227c9968/users/7c2a317d773a4967a9b13d85f766bc17/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:44.557988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350f666-800f-44e4-a84a-57a4da537e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32cc4c7a5e204aba89707a8f227c9968, user_id=7c2a317d773a4967a9b13d85f766bc17, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:44.561143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350f666-800f-44e4-a84a-57a4da537e1c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:44.573628 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1061/2113] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:44 2022] PUT /identity/v3/projects/32cc4c7a5e204aba89707a8f227c9968/users/7c2a317d773a4967a9b13d85f766bc17/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:44.585374 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51879aa2-0331-4a31-af34-ea3e5f9b171f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:44.585374 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51879aa2-0331-4a31-af34-ea3e5f9b171f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:44.585374 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51879aa2-0331-4a31-af34-ea3e5f9b171f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:44.597914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4a37d-b78c-49ee-a3bd-ba8e20e17e5f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:44.614594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-51879aa2-0331-4a31-af34-ea3e5f9b171f None None] MFA Rules not processed for user `7c2a317d773a4967a9b13d85f766bc17`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:44.615965 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-51879aa2-0331-4a31-af34-ea3e5f9b171f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:44.648747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e5ea1-4f7c-4d8c-9817-1e7919e3385f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:44.649353 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e5ea1-4f7c-4d8c-9817-1e7919e3385f service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:44.649635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e5ea1-4f7c-4d8c-9817-1e7919e3385f service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:44.649936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e5ea1-4f7c-4d8c-9817-1e7919e3385f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:44.686804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1062/2114] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:44.697336 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51879aa2-0331-4a31-af34-ea3e5f9b171f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:44.698947 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-51879aa2-0331-4a31-af34-ea3e5f9b171f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:44.711856 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:44.717278 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e5ea1-4f7c-4d8c-9817-1e7919e3385f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:44.717792 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e5ea1-4f7c-4d8c-9817-1e7919e3385f service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:44.730225 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1053/2115] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:33:44.762212 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51879aa2-0331-4a31-af34-ea3e5f9b171f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:44.769525 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737c32b-01f5-49b5-a61d-a98201bf48d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:44.770738 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737c32b-01f5-49b5-a61d-a98201bf48d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:44.771019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737c32b-01f5-49b5-a61d-a98201bf48d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:44.771320 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737c32b-01f5-49b5-a61d-a98201bf48d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:44.781159 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737c32b-01f5-49b5-a61d-a98201bf48d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:44.782661 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737c32b-01f5-49b5-a61d-a98201bf48d2 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:44.792741 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1063/2116] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:33:44.928318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e5ea1-4f7c-4d8c-9817-1e7919e3385f service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:44.937784 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e5ea1-4f7c-4d8c-9817-1e7919e3385f service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:44.942599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f449c-9973-4c30-845e-aadda9b013df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:44.943277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f449c-9973-4c30-845e-aadda9b013df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:44.953851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f449c-9973-4c30-845e-aadda9b013df admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:44.953851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f449c-9973-4c30-845e-aadda9b013df admin admin] PATH_INFO: `/v3/users/aa1aa918ebb1404295336e29555a14d6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:44.953851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f449c-9973-4c30-845e-aadda9b013df admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1aa918ebb1404295336e29555a14d6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:44.953851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f449c-9973-4c30-845e-aadda9b013df admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:45.197648 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4a6f449c-9973-4c30-845e-aadda9b013df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1aa918ebb1404295336e29555a14d6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:45.210180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4a6f449c-9973-4c30-845e-aadda9b013df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1aa918ebb1404295336e29555a14d6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:45.216807 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4a6f449c-9973-4c30-845e-aadda9b013df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1aa918ebb1404295336e29555a14d6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:45.217513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4a6f449c-9973-4c30-845e-aadda9b013df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1aa918ebb1404295336e29555a14d6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:45.315193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4a6f449c-9973-4c30-845e-aadda9b013df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1aa918ebb1404295336e29555a14d6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:45.322250 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1054/2117] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:44 2022] DELETE /identity/v3/users/aa1aa918ebb1404295336e29555a14d6 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:45.326810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b33ace-2f58-4c23-bc45-e90ba7af5eb1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:45.327283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b33ace-2f58-4c23-bc45-e90ba7af5eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:45.327506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b33ace-2f58-4c23-bc45-e90ba7af5eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:45.348204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-59b33ace-2f58-4c23-bc45-e90ba7af5eb1 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:45.349416 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-59b33ace-2f58-4c23-bc45-e90ba7af5eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:45.389993 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:45.419620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1064/2118] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:45.432504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f449c-9973-4c30-845e-aadda9b013df admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:45.434155 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4a6f449c-9973-4c30-845e-aadda9b013df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:45.539012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f449c-9973-4c30-845e-aadda9b013df admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:45.542320 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fa15f-8b0f-4b5c-b829-5bb1fd6d0719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:45.543044 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fa15f-8b0f-4b5c-b829-5bb1fd6d0719 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:45.543324 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fa15f-8b0f-4b5c-b829-5bb1fd6d0719 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:45.543596 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fa15f-8b0f-4b5c-b829-5bb1fd6d0719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:45.553604 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fa15f-8b0f-4b5c-b829-5bb1fd6d0719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:45.555174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fa15f-8b0f-4b5c-b829-5bb1fd6d0719 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:45.565189 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1055/2119] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:46.238220 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b33ace-2f58-4c23-bc45-e90ba7af5eb1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:46.241583 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-59b33ace-2f58-4c23-bc45-e90ba7af5eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:46.262932 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b33ace-2f58-4c23-bc45-e90ba7af5eb1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:46.268076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbf2be-48d8-416d-ab6b-a3bc1fd6a7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:46.268960 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbf2be-48d8-416d-ab6b-a3bc1fd6a7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:46.269318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbf2be-48d8-416d-ab6b-a3bc1fd6a7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:46.270665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbf2be-48d8-416d-ab6b-a3bc1fd6a7ea admin admin] PATH_INFO: `/v3/users/159b0f43250841a1a23a326eb02e112a` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:46.272217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbf2be-48d8-416d-ab6b-a3bc1fd6a7ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=159b0f43250841a1a23a326eb02e112a)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:46.274780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbf2be-48d8-416d-ab6b-a3bc1fd6a7ea admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:46.471235 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-43cbf2be-48d8-416d-ab6b-a3bc1fd6a7ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159b0f43250841a1a23a326eb02e112a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:46.485151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-43cbf2be-48d8-416d-ab6b-a3bc1fd6a7ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159b0f43250841a1a23a326eb02e112a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:46.494096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-43cbf2be-48d8-416d-ab6b-a3bc1fd6a7ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159b0f43250841a1a23a326eb02e112a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:46.494596 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-43cbf2be-48d8-416d-ab6b-a3bc1fd6a7ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159b0f43250841a1a23a326eb02e112a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:46.597147 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fa15f-8b0f-4b5c-b829-5bb1fd6d0719 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:46.597996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f31fa15f-8b0f-4b5c-b829-5bb1fd6d0719 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:46.613186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fa15f-8b0f-4b5c-b829-5bb1fd6d0719 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:46.618357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c80ed-cc37-4a79-b157-808df695872f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:46.619152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c80ed-cc37-4a79-b157-808df695872f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:46.619729 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c80ed-cc37-4a79-b157-808df695872f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:46.620100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c80ed-cc37-4a79-b157-808df695872f admin admin] PATH_INFO: `/v3/projects/f19fed04f63840828c2038b667761277` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:46.621575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c80ed-cc37-4a79-b157-808df695872f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19fed04f63840828c2038b667761277)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:46.624071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-43cbf2be-48d8-416d-ab6b-a3bc1fd6a7ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159b0f43250841a1a23a326eb02e112a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:46.624256 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c80ed-cc37-4a79-b157-808df695872f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:46.637857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1065/2120] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:46 2022] DELETE /identity/v3/users/159b0f43250841a1a23a326eb02e112a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:46.642488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d4201-a175-4d55-93e4-35b0b24590f1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:46.643207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d4201-a175-4d55-93e4-35b0b24590f1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:46.643646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d4201-a175-4d55-93e4-35b0b24590f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:46.684894 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-663d4201-a175-4d55-93e4-35b0b24590f1 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:46.687066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-663d4201-a175-4d55-93e4-35b0b24590f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:46.760128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1066/2121] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:46.768603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fa5c80ed-cc37-4a79-b157-808df695872f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19fed04f63840828c2038b667761277', 'request_id': 'req-fa5c80ed-cc37-4a79-b157-808df695872f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:46.772699 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d4201-a175-4d55-93e4-35b0b24590f1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:46.775044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-663d4201-a175-4d55-93e4-35b0b24590f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:46.838191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d4201-a175-4d55-93e4-35b0b24590f1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:46.840211 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fa5c80ed-cc37-4a79-b157-808df695872f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19fed04f63840828c2038b667761277', 'request_id': 'req-fa5c80ed-cc37-4a79-b157-808df695872f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:46.848197 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fa5c80ed-cc37-4a79-b157-808df695872f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19fed04f63840828c2038b667761277', 'request_id': 'req-fa5c80ed-cc37-4a79-b157-808df695872f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:46.863747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fa5c80ed-cc37-4a79-b157-808df695872f admin admin] The token cache is being invalidate because project f19fed04f63840828c2038b667761277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:46.865633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fa5c80ed-cc37-4a79-b157-808df695872f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:46.866426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fa5c80ed-cc37-4a79-b157-808df695872f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:46.868142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1056/2122] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:46 2022] DELETE /identity/v3/projects/f19fed04f63840828c2038b667761277 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:46.872384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c80ed-cc37-4a79-b157-808df695872f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:46.874143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fa5c80ed-cc37-4a79-b157-808df695872f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:46.902419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0baa03e-ed47-4647-a719-b26f7dd39b59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:46.907993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baa03e-ed47-4647-a719-b26f7dd39b59 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:46.907993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baa03e-ed47-4647-a719-b26f7dd39b59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:46.907993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baa03e-ed47-4647-a719-b26f7dd39b59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:46.907993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c0baa03e-ed47-4647-a719-b26f7dd39b59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:46.946367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c80ed-cc37-4a79-b157-808df695872f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:46.951197 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c10abd-d197-4174-961b-a9a0150f627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:46.951836 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c10abd-d197-4174-961b-a9a0150f627d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:46.952113 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c10abd-d197-4174-961b-a9a0150f627d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:46.952387 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c10abd-d197-4174-961b-a9a0150f627d admin admin] PATH_INFO: `/v3/users/7c2a317d773a4967a9b13d85f766bc17` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:46.953539 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c10abd-d197-4174-961b-a9a0150f627d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2a317d773a4967a9b13d85f766bc17)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:46.955513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c10abd-d197-4174-961b-a9a0150f627d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:46.988078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0baa03e-ed47-4647-a719-b26f7dd39b59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:46.990147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0baa03e-ed47-4647-a719-b26f7dd39b59 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:46.999633 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1067/2123] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:47.237895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-76c10abd-d197-4174-961b-a9a0150f627d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2a317d773a4967a9b13d85f766bc17'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:47.273008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-76c10abd-d197-4174-961b-a9a0150f627d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2a317d773a4967a9b13d85f766bc17'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:47.285243 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-76c10abd-d197-4174-961b-a9a0150f627d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2a317d773a4967a9b13d85f766bc17'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:47.286084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-76c10abd-d197-4174-961b-a9a0150f627d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2a317d773a4967a9b13d85f766bc17'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:47.354337 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-76c10abd-d197-4174-961b-a9a0150f627d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2a317d773a4967a9b13d85f766bc17'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:47.362899 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1057/2124] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:46 2022] DELETE /identity/v3/users/7c2a317d773a4967a9b13d85f766bc17 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:47.438211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0baa03e-ed47-4647-a719-b26f7dd39b59 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:47.439750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c0baa03e-ed47-4647-a719-b26f7dd39b59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:47.451892 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0baa03e-ed47-4647-a719-b26f7dd39b59 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:47.545112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd4caa-48e3-43f9-bec4-016b27257108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:47.546151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd4caa-48e3-43f9-bec4-016b27257108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:47.546296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd4caa-48e3-43f9-bec4-016b27257108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:47.546656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd4caa-48e3-43f9-bec4-016b27257108 admin admin] PATH_INFO: `/v3/projects/4c46bb5af2554a66a8ab7c96a86d0c0b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:47.548156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd4caa-48e3-43f9-bec4-016b27257108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c46bb5af2554a66a8ab7c96a86d0c0b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:47.550209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd4caa-48e3-43f9-bec4-016b27257108 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:47.771933 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-22dd4caa-48e3-43f9-bec4-016b27257108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c46bb5af2554a66a8ab7c96a86d0c0b', 'request_id': 'req-22dd4caa-48e3-43f9-bec4-016b27257108'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:47.910178 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-22dd4caa-48e3-43f9-bec4-016b27257108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c46bb5af2554a66a8ab7c96a86d0c0b', 'request_id': 'req-22dd4caa-48e3-43f9-bec4-016b27257108'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:47.914308 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-22dd4caa-48e3-43f9-bec4-016b27257108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c46bb5af2554a66a8ab7c96a86d0c0b', 'request_id': 'req-22dd4caa-48e3-43f9-bec4-016b27257108'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:47.925921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-22dd4caa-48e3-43f9-bec4-016b27257108 admin admin] The token cache is being invalidate because project 4c46bb5af2554a66a8ab7c96a86d0c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:47.926240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-22dd4caa-48e3-43f9-bec4-016b27257108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:47.926889 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-22dd4caa-48e3-43f9-bec4-016b27257108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:47.928407 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1068/2125] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:47 2022] DELETE /identity/v3/projects/4c46bb5af2554a66a8ab7c96a86d0c0b => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:47.932514 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c10abd-d197-4174-961b-a9a0150f627d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:47.934029 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-76c10abd-d197-4174-961b-a9a0150f627d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:47.946994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c10abd-d197-4174-961b-a9a0150f627d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:48.012547 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af874b-595b-4fc7-a969-939405bc0cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:48.013275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af874b-595b-4fc7-a969-939405bc0cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:48.013840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af874b-595b-4fc7-a969-939405bc0cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:48.014066 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af874b-595b-4fc7-a969-939405bc0cff admin admin] PATH_INFO: `/v3/users/179789f6200945ebba484570d45a3d00` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:48.018562 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af874b-595b-4fc7-a969-939405bc0cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=179789f6200945ebba484570d45a3d00)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:48.023648 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af874b-595b-4fc7-a969-939405bc0cff admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:48.126402 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:48.135651 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd4caa-48e3-43f9-bec4-016b27257108 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:48.137716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-22dd4caa-48e3-43f9-bec4-016b27257108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:48.152982 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd4caa-48e3-43f9-bec4-016b27257108 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:48.158209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a8efd-d377-4585-8dcc-bbbf899c0bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:48.158344 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a8efd-d377-4585-8dcc-bbbf899c0bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:48.158592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a8efd-d377-4585-8dcc-bbbf899c0bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:48.158845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a8efd-d377-4585-8dcc-bbbf899c0bbc admin admin] PATH_INFO: `/v3/projects/32cc4c7a5e204aba89707a8f227c9968` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:48.160466 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a8efd-d377-4585-8dcc-bbbf899c0bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=32cc4c7a5e204aba89707a8f227c9968)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:48.163713 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a8efd-d377-4585-8dcc-bbbf899c0bbc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:48.288316 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d0af874b-595b-4fc7-a969-939405bc0cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '179789f6200945ebba484570d45a3d00'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:48.300166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:48.322692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d0af874b-595b-4fc7-a969-939405bc0cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '179789f6200945ebba484570d45a3d00'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:48.327300 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-679a8efd-d377-4585-8dcc-bbbf899c0bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32cc4c7a5e204aba89707a8f227c9968', 'request_id': 'req-679a8efd-d377-4585-8dcc-bbbf899c0bbc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:48.338362 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d0af874b-595b-4fc7-a969-939405bc0cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '179789f6200945ebba484570d45a3d00'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:48.339195 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d0af874b-595b-4fc7-a969-939405bc0cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '179789f6200945ebba484570d45a3d00'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:48.496938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-679a8efd-d377-4585-8dcc-bbbf899c0bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32cc4c7a5e204aba89707a8f227c9968', 'request_id': 'req-679a8efd-d377-4585-8dcc-bbbf899c0bbc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:48.508729 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-679a8efd-d377-4585-8dcc-bbbf899c0bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32cc4c7a5e204aba89707a8f227c9968', 'request_id': 'req-679a8efd-d377-4585-8dcc-bbbf899c0bbc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:48.522753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-679a8efd-d377-4585-8dcc-bbbf899c0bbc admin admin] The token cache is being invalidate because project 32cc4c7a5e204aba89707a8f227c9968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:48.523250 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-679a8efd-d377-4585-8dcc-bbbf899c0bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:48.524140 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-679a8efd-d377-4585-8dcc-bbbf899c0bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:48.525916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1069/2126] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:48 2022] DELETE /identity/v3/projects/32cc4c7a5e204aba89707a8f227c9968 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:48.532852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271c9f8-b193-41fa-8332-43a862dbbd18 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:48.533408 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271c9f8-b193-41fa-8332-43a862dbbd18 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:48.533975 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271c9f8-b193-41fa-8332-43a862dbbd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:48.569453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7271c9f8-b193-41fa-8332-43a862dbbd18 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:48.571022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7271c9f8-b193-41fa-8332-43a862dbbd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:48.639198 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1070/2127] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:48.647111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d0af874b-595b-4fc7-a969-939405bc0cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '179789f6200945ebba484570d45a3d00'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:48.647586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047a105-3125-43f3-99b5-9ab510fee68d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:48.648351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047a105-3125-43f3-99b5-9ab510fee68d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:48.648878 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047a105-3125-43f3-99b5-9ab510fee68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:48.673449 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4047a105-3125-43f3-99b5-9ab510fee68d None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:48.674450 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4047a105-3125-43f3-99b5-9ab510fee68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:48.679605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1058/2128] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:47 2022] DELETE /identity/v3/users/179789f6200945ebba484570d45a3d00 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:48.766006 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1071/2129] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:48.766986 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af874b-595b-4fc7-a969-939405bc0cff admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:48.768552 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d0af874b-595b-4fc7-a969-939405bc0cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:48.797134 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af874b-595b-4fc7-a969-939405bc0cff admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:48.810283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d72f9a-daeb-4980-b0b3-adef9798e77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:48.823720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d72f9a-daeb-4980-b0b3-adef9798e77a admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:48.823720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d72f9a-daeb-4980-b0b3-adef9798e77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:48.823720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d72f9a-daeb-4980-b0b3-adef9798e77a admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:48.823720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d72f9a-daeb-4980-b0b3-adef9798e77a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:33:48.823720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d72f9a-daeb-4980-b0b3-adef9798e77a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:48.823720 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d72f9a-daeb-4980-b0b3-adef9798e77a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:48.848642 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1059/2130] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:33:48.853366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047a105-3125-43f3-99b5-9ab510fee68d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:48.864777 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047a105-3125-43f3-99b5-9ab510fee68d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:48.870310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2fcc3-7d61-4afd-ac58-98355a1a21d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:48.871017 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2fcc3-7d61-4afd-ac58-98355a1a21d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:48.871365 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2fcc3-7d61-4afd-ac58-98355a1a21d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:48.872274 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2fcc3-7d61-4afd-ac58-98355a1a21d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:48.873004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2fcc3-7d61-4afd-ac58-98355a1a21d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:48.875140 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2fcc3-7d61-4afd-ac58-98355a1a21d5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:49.046214 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1072/2131] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:48 2022] POST /identity/v3/projects => generated 383 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:49.049124 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d72f9a-daeb-4980-b0b3-adef9798e77a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:49.066317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d72f9a-daeb-4980-b0b3-adef9798e77a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:49.189947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d6093-568c-40db-a083-0c22f9250e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:49.190569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d6093-568c-40db-a083-0c22f9250e22 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:49.191039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d6093-568c-40db-a083-0c22f9250e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:49.191474 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d6093-568c-40db-a083-0c22f9250e22 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:49.192330 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d6093-568c-40db-a083-0c22f9250e22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:49.195066 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d6093-568c-40db-a083-0c22f9250e22 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:49.274850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2fcc3-7d61-4afd-ac58-98355a1a21d5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:49.276440 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2ed2fcc3-7d61-4afd-ac58-98355a1a21d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:49.291308 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2fcc3-7d61-4afd-ac58-98355a1a21d5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:49.303776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:49.303776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:49.303776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:49.303776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634 admin admin] PATH_INFO: `/v3/projects/f93758f59be345e98d1d4bc1385944b8` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:49.304250 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93758f59be345e98d1d4bc1385944b8)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:49.304349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1060/2132] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:49 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:49.307099 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:49.308137 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d6093-568c-40db-a083-0c22f9250e22 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:49.322386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d6093-568c-40db-a083-0c22f9250e22 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:49.328617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59631533-67ed-4e68-819a-378e6d920cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:49.343788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59631533-67ed-4e68-819a-378e6d920cde admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:49.343788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59631533-67ed-4e68-819a-378e6d920cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:49.343788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59631533-67ed-4e68-819a-378e6d920cde admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:49.343788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59631533-67ed-4e68-819a-378e6d920cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:49.343788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59631533-67ed-4e68-819a-378e6d920cde admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:49.358186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1061/2133] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:49.358908 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59631533-67ed-4e68-819a-378e6d920cde admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:49.372478 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:49.378778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59631533-67ed-4e68-819a-378e6d920cde admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:49.384688 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3749c27-6e82-4632-90d7-f5395334419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:49.385363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3749c27-6e82-4632-90d7-f5395334419a admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:49.385652 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3749c27-6e82-4632-90d7-f5395334419a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:49.385969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3749c27-6e82-4632-90d7-f5395334419a admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:49.386896 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3749c27-6e82-4632-90d7-f5395334419a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:49.389765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3749c27-6e82-4632-90d7-f5395334419a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:49.404549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1062/2134] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:49.408695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3749c27-6e82-4632-90d7-f5395334419a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:49.419399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3749c27-6e82-4632-90d7-f5395334419a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:49.434508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93758f59be345e98d1d4bc1385944b8', 'request_id': 'req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:49.482169 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0174db8-6250-488f-bfc6-b4c7a5f21cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:49.482858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0174db8-6250-488f-bfc6-b4c7a5f21cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:49.483137 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0174db8-6250-488f-bfc6-b4c7a5f21cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:49.483411 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0174db8-6250-488f-bfc6-b4c7a5f21cb4 admin admin] PATH_INFO: `/v3/projects/a277bf3bda26450aad008bf1204100fe/users/503e8319c29a465eb51941083b69d9b6/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:49.499074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0174db8-6250-488f-bfc6-b4c7a5f21cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a277bf3bda26450aad008bf1204100fe, user_id=503e8319c29a465eb51941083b69d9b6, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:49.501804 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0174db8-6250-488f-bfc6-b4c7a5f21cb4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:49.562165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93758f59be345e98d1d4bc1385944b8', 'request_id': 'req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:49.571075 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93758f59be345e98d1d4bc1385944b8', 'request_id': 'req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:49.585886 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634 admin admin] The token cache is being invalidate because project f93758f59be345e98d1d4bc1385944b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:49.586644 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:49.587598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:49.589093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1073/2135] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:49 2022] DELETE /identity/v3/projects/f93758f59be345e98d1d4bc1385944b8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:49.593621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:49.595056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:49.607888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1063/2136] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:49 2022] PUT /identity/v3/projects/a277bf3bda26450aad008bf1204100fe/users/503e8319c29a465eb51941083b69d9b6/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:49.612618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ffda0-79ee-42ad-a9c7-c8985aa6af77 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:49.612943 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ffda0-79ee-42ad-a9c7-c8985aa6af77 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:49.613174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ffda0-79ee-42ad-a9c7-c8985aa6af77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:49.631411 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07b8c0-ccab-48dc-a2c1-b9bf2e70d634 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:49.637538 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-774ffda0-79ee-42ad-a9c7-c8985aa6af77 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:49.638899 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-774ffda0-79ee-42ad-a9c7-c8985aa6af77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:49.713582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2efb7b-6f41-41aa-8839-7911c5df0df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:49.716337 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2efb7b-6f41-41aa-8839-7911c5df0df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:49.716618 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2efb7b-6f41-41aa-8839-7911c5df0df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:49.716892 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2efb7b-6f41-41aa-8839-7911c5df0df1 admin admin] PATH_INFO: `/v3/users/8c07aab09de44e5eb486ba699923e9fe` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:49.720769 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1064/2137] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:49.722118 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2efb7b-6f41-41aa-8839-7911c5df0df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c07aab09de44e5eb486ba699923e9fe)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:49.724157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2efb7b-6f41-41aa-8839-7911c5df0df1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:49.732392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ffda0-79ee-42ad-a9c7-c8985aa6af77 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:49.733941 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-774ffda0-79ee-42ad-a9c7-c8985aa6af77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:49.810936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ffda0-79ee-42ad-a9c7-c8985aa6af77 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:49.818417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781d700-7723-4654-8fff-bc59d60d78db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:49.819229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781d700-7723-4654-8fff-bc59d60d78db service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:49.819519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781d700-7723-4654-8fff-bc59d60d78db service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:49.820065 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781d700-7723-4654-8fff-bc59d60d78db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:49.833305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781d700-7723-4654-8fff-bc59d60d78db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:49.834967 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781d700-7723-4654-8fff-bc59d60d78db service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:49.852362 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1065/2138] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:33:49.992933 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ce2efb7b-6f41-41aa-8839-7911c5df0df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c07aab09de44e5eb486ba699923e9fe'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:50.009625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ce2efb7b-6f41-41aa-8839-7911c5df0df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c07aab09de44e5eb486ba699923e9fe'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:50.020232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ce2efb7b-6f41-41aa-8839-7911c5df0df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c07aab09de44e5eb486ba699923e9fe'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:50.020987 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ce2efb7b-6f41-41aa-8839-7911c5df0df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c07aab09de44e5eb486ba699923e9fe'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:50.149654 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ce2efb7b-6f41-41aa-8839-7911c5df0df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c07aab09de44e5eb486ba699923e9fe'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:50.158818 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1074/2139] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:49 2022] DELETE /identity/v3/users/8c07aab09de44e5eb486ba699923e9fe => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:50.658396 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:50.827670 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781d700-7723-4654-8fff-bc59d60d78db service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:50.834991 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:50.841472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781d700-7723-4654-8fff-bc59d60d78db service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:51.012552 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7be07b-1beb-4d14-bbd5-f7e073b0369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:51.013621 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7be07b-1beb-4d14-bbd5-f7e073b0369a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:51.014041 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7be07b-1beb-4d14-bbd5-f7e073b0369a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:51.014415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7be07b-1beb-4d14-bbd5-f7e073b0369a admin admin] PATH_INFO: `/v3/projects/c8c02a521d4e43cda33f303908e1b380` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:51.020365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7be07b-1beb-4d14-bbd5-f7e073b0369a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8c02a521d4e43cda33f303908e1b380)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:51.023114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7be07b-1beb-4d14-bbd5-f7e073b0369a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:51.168945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6f7be07b-1beb-4d14-bbd5-f7e073b0369a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8c02a521d4e43cda33f303908e1b380', 'request_id': 'req-6f7be07b-1beb-4d14-bbd5-f7e073b0369a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:51.279850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6f7be07b-1beb-4d14-bbd5-f7e073b0369a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8c02a521d4e43cda33f303908e1b380', 'request_id': 'req-6f7be07b-1beb-4d14-bbd5-f7e073b0369a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:51.286793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6f7be07b-1beb-4d14-bbd5-f7e073b0369a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8c02a521d4e43cda33f303908e1b380', 'request_id': 'req-6f7be07b-1beb-4d14-bbd5-f7e073b0369a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:51.299236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6f7be07b-1beb-4d14-bbd5-f7e073b0369a admin admin] The token cache is being invalidate because project c8c02a521d4e43cda33f303908e1b380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:51.299532 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6f7be07b-1beb-4d14-bbd5-f7e073b0369a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:51.300252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6f7be07b-1beb-4d14-bbd5-f7e073b0369a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:51.305349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1066/2140] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:50 2022] DELETE /identity/v3/projects/c8c02a521d4e43cda33f303908e1b380 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:51.307240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774acc56-b3b2-4c79-a5f0-f8159393ad98 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:51.309695 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774acc56-b3b2-4c79-a5f0-f8159393ad98 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:51.309695 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774acc56-b3b2-4c79-a5f0-f8159393ad98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:51.329460 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-774acc56-b3b2-4c79-a5f0-f8159393ad98 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:51.330822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-774acc56-b3b2-4c79-a5f0-f8159393ad98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:51.431737 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1075/2141] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:51.442975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d7131-9ef8-443c-a445-37c6ff98c4df None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:51.443262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d7131-9ef8-443c-a445-37c6ff98c4df None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:51.443535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d7131-9ef8-443c-a445-37c6ff98c4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:51.472976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-304d7131-9ef8-443c-a445-37c6ff98c4df None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:51.475378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-304d7131-9ef8-443c-a445-37c6ff98c4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:51.489553 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1067/2142] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:51.493259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774acc56-b3b2-4c79-a5f0-f8159393ad98 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:51.504883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774acc56-b3b2-4c79-a5f0-f8159393ad98 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:51.510467 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a69ec-901b-43ce-bad5-4f7624d8e023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:51.510743 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a69ec-901b-43ce-bad5-4f7624d8e023 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:51.511020 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a69ec-901b-43ce-bad5-4f7624d8e023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:51.511448 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a69ec-901b-43ce-bad5-4f7624d8e023 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:51.512261 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a69ec-901b-43ce-bad5-4f7624d8e023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:33:51.512566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a69ec-901b-43ce-bad5-4f7624d8e023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:51.514335 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a69ec-901b-43ce-bad5-4f7624d8e023 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:51.529441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1076/2143] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:33:51.532768 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d7131-9ef8-443c-a445-37c6ff98c4df None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:51.577368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d7131-9ef8-443c-a445-37c6ff98c4df None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:51.593578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429cbfd-9cf6-44f8-b038-db96e327bd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:51.596639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429cbfd-9cf6-44f8-b038-db96e327bd22 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:51.596639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429cbfd-9cf6-44f8-b038-db96e327bd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:51.596639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429cbfd-9cf6-44f8-b038-db96e327bd22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:51.596639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429cbfd-9cf6-44f8-b038-db96e327bd22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:51.597468 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429cbfd-9cf6-44f8-b038-db96e327bd22 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:51.611670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a69ec-901b-43ce-bad5-4f7624d8e023 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:51.613977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b59a69ec-901b-43ce-bad5-4f7624d8e023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:51.635939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a69ec-901b-43ce-bad5-4f7624d8e023 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:51.647904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfc198-c8ae-4d97-82bf-392ebd1f50b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:51.648571 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfc198-c8ae-4d97-82bf-392ebd1f50b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:51.649895 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfc198-c8ae-4d97-82bf-392ebd1f50b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:51.649895 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfc198-c8ae-4d97-82bf-392ebd1f50b2 admin admin] PATH_INFO: `/v3/users/7d11a0b019364881afc3e69b05314759` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:51.652349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfc198-c8ae-4d97-82bf-392ebd1f50b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d11a0b019364881afc3e69b05314759)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:51.654740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfc198-c8ae-4d97-82bf-392ebd1f50b2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:51.775045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1068/2144] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:51 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:51.779197 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429cbfd-9cf6-44f8-b038-db96e327bd22 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:51.941369 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429cbfd-9cf6-44f8-b038-db96e327bd22 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:51.946522 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1ecfc198-c8ae-4d97-82bf-392ebd1f50b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d11a0b019364881afc3e69b05314759'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:51.959952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91320e0-5b0f-41a6-a968-4e0d3350a945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:51.967339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91320e0-5b0f-41a6-a968-4e0d3350a945 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:51.967339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91320e0-5b0f-41a6-a968-4e0d3350a945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:51.967339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91320e0-5b0f-41a6-a968-4e0d3350a945 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:51.968152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91320e0-5b0f-41a6-a968-4e0d3350a945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:51.979202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91320e0-5b0f-41a6-a968-4e0d3350a945 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:51.990472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1ecfc198-c8ae-4d97-82bf-392ebd1f50b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d11a0b019364881afc3e69b05314759'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:52.018794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1ecfc198-c8ae-4d97-82bf-392ebd1f50b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d11a0b019364881afc3e69b05314759'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:52.020044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1ecfc198-c8ae-4d97-82bf-392ebd1f50b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d11a0b019364881afc3e69b05314759'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:52.102868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1ecfc198-c8ae-4d97-82bf-392ebd1f50b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d11a0b019364881afc3e69b05314759'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:52.110240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1069/2145] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:51 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:52.110777 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1077/2146] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:51 2022] DELETE /identity/v3/users/7d11a0b019364881afc3e69b05314759 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:52.114154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923fef0-e772-45ad-a2b0-7c0fcfcfe94c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:52.114154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923fef0-e772-45ad-a2b0-7c0fcfcfe94c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:52.115483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfc198-c8ae-4d97-82bf-392ebd1f50b2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:52.115802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923fef0-e772-45ad-a2b0-7c0fcfcfe94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:52.119321 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1ecfc198-c8ae-4d97-82bf-392ebd1f50b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:52.189032 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3923fef0-e772-45ad-a2b0-7c0fcfcfe94c None None] MFA Rules not processed for user `503e8319c29a465eb51941083b69d9b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:52.193365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3923fef0-e772-45ad-a2b0-7c0fcfcfe94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:52.249102 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfc198-c8ae-4d97-82bf-392ebd1f50b2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:52.256787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490970fa-9cbd-40b7-b9fc-2a2483d43884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:52.257519 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490970fa-9cbd-40b7-b9fc-2a2483d43884 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:52.257914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490970fa-9cbd-40b7-b9fc-2a2483d43884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:52.258249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490970fa-9cbd-40b7-b9fc-2a2483d43884 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:52.259755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490970fa-9cbd-40b7-b9fc-2a2483d43884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:52.262629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490970fa-9cbd-40b7-b9fc-2a2483d43884 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:52.288848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1078/2147] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:52.290972 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779517f-bad7-422c-879b-e7610ef29c3c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:52.291265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779517f-bad7-422c-879b-e7610ef29c3c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:52.295632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779517f-bad7-422c-879b-e7610ef29c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:52.332685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1070/2148] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:52.335391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923fef0-e772-45ad-a2b0-7c0fcfcfe94c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:52.350499 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f779517f-bad7-422c-879b-e7610ef29c3c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:52.352473 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f779517f-bad7-422c-879b-e7610ef29c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:52.355236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923fef0-e772-45ad-a2b0-7c0fcfcfe94c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:52.365568 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000072d6-e57b-43b1-89e6-cf31d81d2146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:52.366330 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000072d6-e57b-43b1-89e6-cf31d81d2146 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:52.366626 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000072d6-e57b-43b1-89e6-cf31d81d2146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:52.366877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000072d6-e57b-43b1-89e6-cf31d81d2146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:52.367531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000072d6-e57b-43b1-89e6-cf31d81d2146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:52.371855 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1079/2149] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:52.373303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dc135-17e8-43eb-a86f-e728ffd4cf46 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:52.373594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dc135-17e8-43eb-a86f-e728ffd4cf46 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:52.373899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dc135-17e8-43eb-a86f-e728ffd4cf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:52.375888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000072d6-e57b-43b1-89e6-cf31d81d2146 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:52.387409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1071/2150] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:52.390972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000072d6-e57b-43b1-89e6-cf31d81d2146 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:52.392990 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-000072d6-e57b-43b1-89e6-cf31d81d2146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:52.412513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-594dc135-17e8-43eb-a86f-e728ffd4cf46 None None] MFA Rules not processed for user `93d9d6782d7d4f5cb82afa51d77415c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:52.413758 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-594dc135-17e8-43eb-a86f-e728ffd4cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:52.475745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000072d6-e57b-43b1-89e6-cf31d81d2146 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:52.482279 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2834c-8966-433c-bdf8-5eff2e835cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:52.487390 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2834c-8966-433c-bdf8-5eff2e835cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:52.487390 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2834c-8966-433c-bdf8-5eff2e835cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:52.487390 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2834c-8966-433c-bdf8-5eff2e835cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:52.496229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2834c-8966-433c-bdf8-5eff2e835cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:52.498017 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2834c-8966-433c-bdf8-5eff2e835cc2 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:52.499870 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1080/2151] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:52.500956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dc135-17e8-43eb-a86f-e728ffd4cf46 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:52.503656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-594dc135-17e8-43eb-a86f-e728ffd4cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:52.508217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1072/2152] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:52.509141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2834c-8966-433c-bdf8-5eff2e835cc2 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:52.520173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2834c-8966-433c-bdf8-5eff2e835cc2 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:52.526760 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774c05d-d4b4-4bf4-80eb-5bc05f1bdb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:52.527578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774c05d-d4b4-4bf4-80eb-5bc05f1bdb77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:52.527928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774c05d-d4b4-4bf4-80eb-5bc05f1bdb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:52.528272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774c05d-d4b4-4bf4-80eb-5bc05f1bdb77 admin admin] PATH_INFO: `/v3/projects/c30c9fc4ed7b49a492b08b5cc42d6136/users/17f9783c63c544c4907084c686170a58/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:52.545660 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774c05d-d4b4-4bf4-80eb-5bc05f1bdb77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30c9fc4ed7b49a492b08b5cc42d6136, user_id=17f9783c63c544c4907084c686170a58, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:52.548635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774c05d-d4b4-4bf4-80eb-5bc05f1bdb77 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:52.583022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dc135-17e8-43eb-a86f-e728ffd4cf46 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:52.587510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375b587-5910-458d-9785-6ca26e9acd36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:52.588205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375b587-5910-458d-9785-6ca26e9acd36 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:52.589377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375b587-5910-458d-9785-6ca26e9acd36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:52.589377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375b587-5910-458d-9785-6ca26e9acd36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:52.600900 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375b587-5910-458d-9785-6ca26e9acd36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:52.602390 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375b587-5910-458d-9785-6ca26e9acd36 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:52.613185 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1081/2153] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:52.614085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375b587-5910-458d-9785-6ca26e9acd36 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:52.615498 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f375b587-5910-458d-9785-6ca26e9acd36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:52.630666 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375b587-5910-458d-9785-6ca26e9acd36 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:52.635428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa6ba0-851a-4acc-9d0b-b3d2f2c81121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:52.641421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa6ba0-851a-4acc-9d0b-b3d2f2c81121 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:52.641421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa6ba0-851a-4acc-9d0b-b3d2f2c81121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:52.641421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa6ba0-851a-4acc-9d0b-b3d2f2c81121 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:52.641421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa6ba0-851a-4acc-9d0b-b3d2f2c81121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:52.641421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa6ba0-851a-4acc-9d0b-b3d2f2c81121 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:52.674594 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1073/2154] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:52 2022] PUT /identity/v3/projects/c30c9fc4ed7b49a492b08b5cc42d6136/users/17f9783c63c544c4907084c686170a58/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:52.682149 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680308a-d5f4-42da-8d16-efdae4c97982 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:52.682432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680308a-d5f4-42da-8d16-efdae4c97982 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:52.682710 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680308a-d5f4-42da-8d16-efdae4c97982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:52.722119 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b680308a-d5f4-42da-8d16-efdae4c97982 None None] MFA Rules not processed for user `17f9783c63c544c4907084c686170a58`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:52.722119 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b680308a-d5f4-42da-8d16-efdae4c97982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:52.777455 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1082/2155] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:52 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:52.778473 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa6ba0-851a-4acc-9d0b-b3d2f2c81121 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:52.793528 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1074/2156] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:52.798116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680308a-d5f4-42da-8d16-efdae4c97982 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:52.847030 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa6ba0-851a-4acc-9d0b-b3d2f2c81121 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:52.860239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283739b-4bbf-4e5a-b6a7-afba0c709221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:52.860239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283739b-4bbf-4e5a-b6a7-afba0c709221 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:52.860239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283739b-4bbf-4e5a-b6a7-afba0c709221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:52.860239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283739b-4bbf-4e5a-b6a7-afba0c709221 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:52.860779 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283739b-4bbf-4e5a-b6a7-afba0c709221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:52.861319 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283739b-4bbf-4e5a-b6a7-afba0c709221 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:52.890159 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:52.899214 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680308a-d5f4-42da-8d16-efdae4c97982 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:52.905899 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad992ad2-106b-44ae-a82e-801aad217af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:52.906522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad992ad2-106b-44ae-a82e-801aad217af8 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:52.906990 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad992ad2-106b-44ae-a82e-801aad217af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:52.907426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad992ad2-106b-44ae-a82e-801aad217af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:52.908702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad992ad2-106b-44ae-a82e-801aad217af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:52.911988 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad992ad2-106b-44ae-a82e-801aad217af8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:52.955191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1083/2157] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:52 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:52.985849 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283739b-4bbf-4e5a-b6a7-afba0c709221 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:53.007859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283739b-4bbf-4e5a-b6a7-afba0c709221 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:53.021838 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430e9e2-020e-4aa6-910e-e8e3bbd60f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:53.022877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430e9e2-020e-4aa6-910e-e8e3bbd60f02 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:53.023219 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430e9e2-020e-4aa6-910e-e8e3bbd60f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:53.023488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430e9e2-020e-4aa6-910e-e8e3bbd60f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:53.024515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430e9e2-020e-4aa6-910e-e8e3bbd60f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:53.028428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430e9e2-020e-4aa6-910e-e8e3bbd60f02 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:53.050236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1084/2158] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:53.054500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430e9e2-020e-4aa6-910e-e8e3bbd60f02 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:53.060450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1075/2159] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:52 2022] POST /identity/v3/projects => generated 385 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:53.066056 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad992ad2-106b-44ae-a82e-801aad217af8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:53.077122 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430e9e2-020e-4aa6-910e-e8e3bbd60f02 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:53.110722 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:53.158498 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad992ad2-106b-44ae-a82e-801aad217af8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:53.165817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a2d16-a344-4a43-8e23-8c8744a46a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:53.166641 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a2d16-a344-4a43-8e23-8c8744a46a5b admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:53.166994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a2d16-a344-4a43-8e23-8c8744a46a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:53.167343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a2d16-a344-4a43-8e23-8c8744a46a5b admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:53.168474 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a2d16-a344-4a43-8e23-8c8744a46a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:53.171825 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a2d16-a344-4a43-8e23-8c8744a46a5b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:53.201314 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b327637-2b0d-4a56-8bb9-8a4c2bbc4327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:53.202178 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b327637-2b0d-4a56-8bb9-8a4c2bbc4327 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:53.202558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b327637-2b0d-4a56-8bb9-8a4c2bbc4327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:53.202835 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b327637-2b0d-4a56-8bb9-8a4c2bbc4327 admin admin] PATH_INFO: `/v3/projects/91447389ca914648b20129c3cc93e7de/users/b3fa8b4eefd147ef9dda3c732e351106/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:53.241090 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b327637-2b0d-4a56-8bb9-8a4c2bbc4327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91447389ca914648b20129c3cc93e7de, user_id=b3fa8b4eefd147ef9dda3c732e351106, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:53.243948 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b327637-2b0d-4a56-8bb9-8a4c2bbc4327 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:53.367215 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1085/2160] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:53 2022] PUT /identity/v3/projects/91447389ca914648b20129c3cc93e7de/users/b3fa8b4eefd147ef9dda3c732e351106/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:53.370797 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b327637-2b0d-4a56-8bb9-8a4c2bbc4327 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:53.372450 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9b327637-2b0d-4a56-8bb9-8a4c2bbc4327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:53.375847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1076/2161] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:53 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:53.379658 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a2d16-a344-4a43-8e23-8c8744a46a5b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:53.400543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a2d16-a344-4a43-8e23-8c8744a46a5b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:53.462974 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b327637-2b0d-4a56-8bb9-8a4c2bbc4327 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:53.462974 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd87da-11ea-4682-946a-84d88fc85122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:53.463870 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd87da-11ea-4682-946a-84d88fc85122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:53.464151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd87da-11ea-4682-946a-84d88fc85122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:53.464462 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd87da-11ea-4682-946a-84d88fc85122 admin admin] PATH_INFO: `/v3/projects/bc168cfc07d943a48242eee3c95ccf2c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:53.465887 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd87da-11ea-4682-946a-84d88fc85122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc168cfc07d943a48242eee3c95ccf2c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:53.467582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd87da-11ea-4682-946a-84d88fc85122 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:53.496086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf598afc-5050-43bc-970f-685b1189696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:53.497686 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf598afc-5050-43bc-970f-685b1189696c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:53.503054 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf598afc-5050-43bc-970f-685b1189696c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:53.503054 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf598afc-5050-43bc-970f-685b1189696c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:53.503054 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf598afc-5050-43bc-970f-685b1189696c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:53.503054 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf598afc-5050-43bc-970f-685b1189696c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:53.512607 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1077/2162] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:53.513428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf598afc-5050-43bc-970f-685b1189696c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:53.524525 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf598afc-5050-43bc-970f-685b1189696c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:53.529705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930527fa-9b6e-495e-9d85-1448a86274b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:53.530337 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930527fa-9b6e-495e-9d85-1448a86274b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:53.530618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930527fa-9b6e-495e-9d85-1448a86274b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:53.530898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930527fa-9b6e-495e-9d85-1448a86274b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:53.531543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930527fa-9b6e-495e-9d85-1448a86274b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:53.533142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930527fa-9b6e-495e-9d85-1448a86274b9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:53.567659 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1078/2163] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:53.568695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930527fa-9b6e-495e-9d85-1448a86274b9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:53.581223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930527fa-9b6e-495e-9d85-1448a86274b9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:53.587627 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d30af-7c5f-4751-b232-85582707e9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:53.588215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d30af-7c5f-4751-b232-85582707e9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:53.588486 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d30af-7c5f-4751-b232-85582707e9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:53.588763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d30af-7c5f-4751-b232-85582707e9e1 admin admin] PATH_INFO: `/v3/projects/91447389ca914648b20129c3cc93e7de/users/b3fa8b4eefd147ef9dda3c732e351106/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:53.591148 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d30af-7c5f-4751-b232-85582707e9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91447389ca914648b20129c3cc93e7de, user_id=b3fa8b4eefd147ef9dda3c732e351106, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:53.600535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d30af-7c5f-4751-b232-85582707e9e1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:53.619712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bbfd87da-11ea-4682-946a-84d88fc85122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc168cfc07d943a48242eee3c95ccf2c', 'request_id': 'req-bbfd87da-11ea-4682-946a-84d88fc85122'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:53.619888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1079/2164] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:53 2022] PUT /identity/v3/projects/91447389ca914648b20129c3cc93e7de/users/b3fa8b4eefd147ef9dda3c732e351106/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:53.619888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d30af-7c5f-4751-b232-85582707e9e1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:53.696229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d30af-7c5f-4751-b232-85582707e9e1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:53.701068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10612a7-fd79-4eb7-b286-5b6bbc9786ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:53.706609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10612a7-fd79-4eb7-b286-5b6bbc9786ae admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:53.706609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10612a7-fd79-4eb7-b286-5b6bbc9786ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:53.706609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10612a7-fd79-4eb7-b286-5b6bbc9786ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:53.706609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10612a7-fd79-4eb7-b286-5b6bbc9786ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:53.706609 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10612a7-fd79-4eb7-b286-5b6bbc9786ae admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:53.714852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1080/2165] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:53.719224 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10612a7-fd79-4eb7-b286-5b6bbc9786ae admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:53.729224 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10612a7-fd79-4eb7-b286-5b6bbc9786ae admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:53.734241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1298f-23ad-4c4d-846e-698a1aef28ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:53.735285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1298f-23ad-4c4d-846e-698a1aef28ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:53.735285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1298f-23ad-4c4d-846e-698a1aef28ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:53.735463 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1298f-23ad-4c4d-846e-698a1aef28ff admin admin] PATH_INFO: `/v3/projects/10db0b3a5482424b9ef50fff0ee20503/users/296ad5762e514e66899f2371204312ea/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:53.751166 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1298f-23ad-4c4d-846e-698a1aef28ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=10db0b3a5482424b9ef50fff0ee20503, user_id=296ad5762e514e66899f2371204312ea, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:53.755048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bbfd87da-11ea-4682-946a-84d88fc85122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc168cfc07d943a48242eee3c95ccf2c', 'request_id': 'req-bbfd87da-11ea-4682-946a-84d88fc85122'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:53.764085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bbfd87da-11ea-4682-946a-84d88fc85122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc168cfc07d943a48242eee3c95ccf2c', 'request_id': 'req-bbfd87da-11ea-4682-946a-84d88fc85122'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:53.767798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1298f-23ad-4c4d-846e-698a1aef28ff admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:53.781500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bbfd87da-11ea-4682-946a-84d88fc85122 admin admin] The token cache is being invalidate because project bc168cfc07d943a48242eee3c95ccf2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:53.781808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bbfd87da-11ea-4682-946a-84d88fc85122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:53.789610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bbfd87da-11ea-4682-946a-84d88fc85122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:53.792291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1086/2166] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:53 2022] DELETE /identity/v3/projects/bc168cfc07d943a48242eee3c95ccf2c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:53.796116 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd87da-11ea-4682-946a-84d88fc85122 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:53.797506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bbfd87da-11ea-4682-946a-84d88fc85122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:53.870759 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd87da-11ea-4682-946a-84d88fc85122 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:53.890007 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1081/2167] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:53 2022] PUT /identity/v3/projects/10db0b3a5482424b9ef50fff0ee20503/users/296ad5762e514e66899f2371204312ea/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:53.895630 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ead2dc-1d75-487f-b5ce-07dfc4e859fa None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:53.895891 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ead2dc-1d75-487f-b5ce-07dfc4e859fa None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:53.896271 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ead2dc-1d75-487f-b5ce-07dfc4e859fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:53.935790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-33ead2dc-1d75-487f-b5ce-07dfc4e859fa None None] MFA Rules not processed for user `296ad5762e514e66899f2371204312ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:53.938219 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-33ead2dc-1d75-487f-b5ce-07dfc4e859fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:53.987174 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac4a85-a50b-4e22-800d-6a056969ea9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:53.987866 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac4a85-a50b-4e22-800d-6a056969ea9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:53.988149 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac4a85-a50b-4e22-800d-6a056969ea9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:53.988962 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac4a85-a50b-4e22-800d-6a056969ea9f admin admin] PATH_INFO: `/v3/users/25e693e6b42148eabbf6e07d476a6819` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:53.992141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac4a85-a50b-4e22-800d-6a056969ea9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e693e6b42148eabbf6e07d476a6819)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:53.995234 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac4a85-a50b-4e22-800d-6a056969ea9f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:54.102788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1082/2168] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:54.104385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ead2dc-1d75-487f-b5ce-07dfc4e859fa None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:54.106610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-33ead2dc-1d75-487f-b5ce-07dfc4e859fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:54.134526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ead2dc-1d75-487f-b5ce-07dfc4e859fa None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:54.153521 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575147ed-d720-4325-a8f9-fd4a9adcc49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:54.154321 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575147ed-d720-4325-a8f9-fd4a9adcc49b admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:54.154500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575147ed-d720-4325-a8f9-fd4a9adcc49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:54.154767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575147ed-d720-4325-a8f9-fd4a9adcc49b admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:54.155472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575147ed-d720-4325-a8f9-fd4a9adcc49b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:54.157405 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575147ed-d720-4325-a8f9-fd4a9adcc49b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:54.339607 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1083/2169] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:54 2022] POST /identity/v3/projects => generated 383 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:54.344215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575147ed-d720-4325-a8f9-fd4a9adcc49b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:54.423034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-18ac4a85-a50b-4e22-800d-6a056969ea9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e693e6b42148eabbf6e07d476a6819'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:54.461748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-18ac4a85-a50b-4e22-800d-6a056969ea9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e693e6b42148eabbf6e07d476a6819'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:54.480479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-18ac4a85-a50b-4e22-800d-6a056969ea9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e693e6b42148eabbf6e07d476a6819'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:54.482421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-18ac4a85-a50b-4e22-800d-6a056969ea9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e693e6b42148eabbf6e07d476a6819'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:54.531248 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575147ed-d720-4325-a8f9-fd4a9adcc49b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:54.556402 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6de25-df7d-4fa2-bb22-684318628caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:54.556402 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6de25-df7d-4fa2-bb22-684318628caf admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:54.556402 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6de25-df7d-4fa2-bb22-684318628caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:54.556402 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6de25-df7d-4fa2-bb22-684318628caf admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:54.556755 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6de25-df7d-4fa2-bb22-684318628caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:54.556755 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6de25-df7d-4fa2-bb22-684318628caf admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:54.663288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-18ac4a85-a50b-4e22-800d-6a056969ea9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e693e6b42148eabbf6e07d476a6819'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:54.672038 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1087/2170] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:53 2022] DELETE /identity/v3/users/25e693e6b42148eabbf6e07d476a6819 => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:54.730288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1084/2171] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:54 2022] POST /identity/v3/users => generated 298 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:54.732020 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac4a85-a50b-4e22-800d-6a056969ea9f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:54.733859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-18ac4a85-a50b-4e22-800d-6a056969ea9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:54.804134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac4a85-a50b-4e22-800d-6a056969ea9f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:54.809275 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d44ac2-4299-40f0-a6ad-09e9e070e755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:54.809926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d44ac2-4299-40f0-a6ad-09e9e070e755 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:54.810205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d44ac2-4299-40f0-a6ad-09e9e070e755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:54.810482 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d44ac2-4299-40f0-a6ad-09e9e070e755 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:54.811149 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d44ac2-4299-40f0-a6ad-09e9e070e755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:54.812772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d44ac2-4299-40f0-a6ad-09e9e070e755 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:54.828201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1088/2172] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:54.832947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6de25-df7d-4fa2-bb22-684318628caf admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:54.844445 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6de25-df7d-4fa2-bb22-684318628caf admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:54.849154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ad4ac-f609-4c0d-b703-c94c12c0078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:54.849971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ad4ac-f609-4c0d-b703-c94c12c0078c admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:54.850402 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ad4ac-f609-4c0d-b703-c94c12c0078c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:54.850678 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ad4ac-f609-4c0d-b703-c94c12c0078c admin admin] PATH_INFO: `/v3/projects/46e79bf2cfeb45738a661f535f8daaae/users/634e59b0367b4ef3a7b392dc1100b705/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:54.868300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ad4ac-f609-4c0d-b703-c94c12c0078c admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e79bf2cfeb45738a661f535f8daaae, user_id=634e59b0367b4ef3a7b392dc1100b705, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:54.874657 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ad4ac-f609-4c0d-b703-c94c12c0078c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:55.006505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1085/2173] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:54 2022] PUT /identity/v3/projects/46e79bf2cfeb45738a661f535f8daaae/users/634e59b0367b4ef3a7b392dc1100b705/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:55.012356 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d44ac2-4299-40f0-a6ad-09e9e070e755 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:55.026484 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d44ac2-4299-40f0-a6ad-09e9e070e755 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:55.104405 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30839c11-5422-4034-b10e-7e5625b69f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:55.105024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839c11-5422-4034-b10e-7e5625b69f07 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:55.105387 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839c11-5422-4034-b10e-7e5625b69f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:55.105657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839c11-5422-4034-b10e-7e5625b69f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:55.106333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30839c11-5422-4034-b10e-7e5625b69f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:55.107942 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30839c11-5422-4034-b10e-7e5625b69f07 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:55.121074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1089/2174] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:55.122332 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ad4ac-f609-4c0d-b703-c94c12c0078c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:55.135988 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ad4ac-f609-4c0d-b703-c94c12c0078c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:55.141914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caaf946-14a3-4dab-a927-03b8adb66a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:55.142575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caaf946-14a3-4dab-a927-03b8adb66a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:55.142854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caaf946-14a3-4dab-a927-03b8adb66a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:55.143139 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caaf946-14a3-4dab-a927-03b8adb66a59 admin admin] PATH_INFO: `/v3/projects/46e79bf2cfeb45738a661f535f8daaae/users/634e59b0367b4ef3a7b392dc1100b705/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:55.145796 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caaf946-14a3-4dab-a927-03b8adb66a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e79bf2cfeb45738a661f535f8daaae, user_id=634e59b0367b4ef3a7b392dc1100b705, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:55.148845 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caaf946-14a3-4dab-a927-03b8adb66a59 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:55.189171 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1086/2175] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:55 2022] PUT /identity/v3/projects/46e79bf2cfeb45738a661f535f8daaae/users/634e59b0367b4ef3a7b392dc1100b705/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:55.192051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ca5f7-0d4b-4531-bab0-915f0ad7204e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:55.192051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ca5f7-0d4b-4531-bab0-915f0ad7204e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:55.192334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ca5f7-0d4b-4531-bab0-915f0ad7204e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:55.239595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a76ca5f7-0d4b-4531-bab0-915f0ad7204e None None] MFA Rules not processed for user `634e59b0367b4ef3a7b392dc1100b705`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:55.240896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a76ca5f7-0d4b-4531-bab0-915f0ad7204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:55.332664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1090/2176] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:55.353255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caaf946-14a3-4dab-a927-03b8adb66a59 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:55.353255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3caaf946-14a3-4dab-a927-03b8adb66a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:55.354761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ca5f7-0d4b-4531-bab0-915f0ad7204e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:55.356398 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a76ca5f7-0d4b-4531-bab0-915f0ad7204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:55.468260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ca5f7-0d4b-4531-bab0-915f0ad7204e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:55.474554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065eb9d0-fadb-4925-8121-4ce277b100d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:55.475271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065eb9d0-fadb-4925-8121-4ce277b100d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:55.475557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065eb9d0-fadb-4925-8121-4ce277b100d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:55.475832 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065eb9d0-fadb-4925-8121-4ce277b100d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:55.478806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-065eb9d0-fadb-4925-8121-4ce277b100d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:55.496952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caaf946-14a3-4dab-a927-03b8adb66a59 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:55.503059 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9aa43-cb49-432c-bdaf-62f85b1f0f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:55.503730 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9aa43-cb49-432c-bdaf-62f85b1f0f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:55.504558 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9aa43-cb49-432c-bdaf-62f85b1f0f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:55.505265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9aa43-cb49-432c-bdaf-62f85b1f0f41 admin admin] PATH_INFO: `/v3/projects/cb35207f41954a62b99e8f08b2ad520c` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:55.506322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9aa43-cb49-432c-bdaf-62f85b1f0f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb35207f41954a62b99e8f08b2ad520c)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:55.508311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9aa43-cb49-432c-bdaf-62f85b1f0f41 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:55.558707 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065eb9d0-fadb-4925-8121-4ce277b100d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:55.560222 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065eb9d0-fadb-4925-8121-4ce277b100d4 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:55.582494 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1091/2177] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:33:55.627905 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d41e7-97e7-48c9-b206-4b3c0539cb97 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:55.628187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d41e7-97e7-48c9-b206-4b3c0539cb97 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:55.628463 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d41e7-97e7-48c9-b206-4b3c0539cb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:55.674823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-361d41e7-97e7-48c9-b206-4b3c0539cb97 None None] MFA Rules not processed for user `503e8319c29a465eb51941083b69d9b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:55.676882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-361d41e7-97e7-48c9-b206-4b3c0539cb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:55.689302 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f0a9aa43-cb49-432c-bdaf-62f85b1f0f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb35207f41954a62b99e8f08b2ad520c', 'request_id': 'req-f0a9aa43-cb49-432c-bdaf-62f85b1f0f41'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:55.806017 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1092/2178] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:55.937281 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f0a9aa43-cb49-432c-bdaf-62f85b1f0f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb35207f41954a62b99e8f08b2ad520c', 'request_id': 'req-f0a9aa43-cb49-432c-bdaf-62f85b1f0f41'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:55.946046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f0a9aa43-cb49-432c-bdaf-62f85b1f0f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb35207f41954a62b99e8f08b2ad520c', 'request_id': 'req-f0a9aa43-cb49-432c-bdaf-62f85b1f0f41'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:55.962269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f0a9aa43-cb49-432c-bdaf-62f85b1f0f41 admin admin] The token cache is being invalidate because project cb35207f41954a62b99e8f08b2ad520c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:33:55.963004 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f0a9aa43-cb49-432c-bdaf-62f85b1f0f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:55.963904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f0a9aa43-cb49-432c-bdaf-62f85b1f0f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:33:55.965995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1087/2179] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:33:55 2022] DELETE /identity/v3/projects/cb35207f41954a62b99e8f08b2ad520c => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:55.970693 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594812e-f8bb-4012-958a-945afe08e2f5 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:55.971354 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594812e-f8bb-4012-958a-945afe08e2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:55.971810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594812e-f8bb-4012-958a-945afe08e2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:55.997194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b594812e-f8bb-4012-958a-945afe08e2f5 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:55.998555 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b594812e-f8bb-4012-958a-945afe08e2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:56.129112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1093/2180] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:56.136896 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2d9c8-8727-4ee7-a761-2f00c1c91ef9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:56.137391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2d9c8-8727-4ee7-a761-2f00c1c91ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:56.137503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2d9c8-8727-4ee7-a761-2f00c1c91ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:56.199357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-33d2d9c8-8727-4ee7-a761-2f00c1c91ef9 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:56.201501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-33d2d9c8-8727-4ee7-a761-2f00c1c91ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:56.217826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1088/2181] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:33:56.221983 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594812e-f8bb-4012-958a-945afe08e2f5 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:56.244468 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594812e-f8bb-4012-958a-945afe08e2f5 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:56.259345 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226d289-8b1d-47fa-9cd3-8a27cbab1781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:56.259981 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226d289-8b1d-47fa-9cd3-8a27cbab1781 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:56.260255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226d289-8b1d-47fa-9cd3-8a27cbab1781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:56.260523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226d289-8b1d-47fa-9cd3-8a27cbab1781 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:56.261362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226d289-8b1d-47fa-9cd3-8a27cbab1781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:33:56.261553 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226d289-8b1d-47fa-9cd3-8a27cbab1781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:56.263238 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226d289-8b1d-47fa-9cd3-8a27cbab1781 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:56.289928 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1094/2182] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:33:56.294486 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2d9c8-8727-4ee7-a761-2f00c1c91ef9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:56.326662 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2d9c8-8727-4ee7-a761-2f00c1c91ef9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:56.343615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3602b2-09cf-4469-ba14-6a8b8be89c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:56.344624 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3602b2-09cf-4469-ba14-6a8b8be89c5b admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:56.345089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3602b2-09cf-4469-ba14-6a8b8be89c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:56.345853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3602b2-09cf-4469-ba14-6a8b8be89c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:56.348030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3602b2-09cf-4469-ba14-6a8b8be89c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:56.353818 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3602b2-09cf-4469-ba14-6a8b8be89c5b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:56.486072 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1089/2183] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:56 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:56.489322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226d289-8b1d-47fa-9cd3-8a27cbab1781 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:56.505447 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226d289-8b1d-47fa-9cd3-8a27cbab1781 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:56.550112 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:56.605627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e7470-9e47-4a53-9e5e-5a6dc7c66dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:56.606284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e7470-9e47-4a53-9e5e-5a6dc7c66dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:56.606616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e7470-9e47-4a53-9e5e-5a6dc7c66dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:56.606898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e7470-9e47-4a53-9e5e-5a6dc7c66dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:56.607534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e7470-9e47-4a53-9e5e-5a6dc7c66dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:56.609495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e7470-9e47-4a53-9e5e-5a6dc7c66dd3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:56.798977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1095/2184] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:56 2022] POST /identity/v3/users => generated 289 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:56.801933 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3602b2-09cf-4469-ba14-6a8b8be89c5b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:56.825783 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3602b2-09cf-4469-ba14-6a8b8be89c5b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:56.837253 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65761a53-cc0e-41ec-9459-7bcf278791c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:56.841415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65761a53-cc0e-41ec-9459-7bcf278791c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:56.841415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65761a53-cc0e-41ec-9459-7bcf278791c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:56.841415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65761a53-cc0e-41ec-9459-7bcf278791c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:56.841415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65761a53-cc0e-41ec-9459-7bcf278791c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:56.844773 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65761a53-cc0e-41ec-9459-7bcf278791c5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:56.912412 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1090/2185] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:56.912564 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e7470-9e47-4a53-9e5e-5a6dc7c66dd3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:56.930065 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e7470-9e47-4a53-9e5e-5a6dc7c66dd3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:56.938021 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113fc8a-b116-4d5f-8e9d-d2508b4b00fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:56.938645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113fc8a-b116-4d5f-8e9d-d2508b4b00fd admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:56.938921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113fc8a-b116-4d5f-8e9d-d2508b4b00fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:56.939186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113fc8a-b116-4d5f-8e9d-d2508b4b00fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:56.939837 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113fc8a-b116-4d5f-8e9d-d2508b4b00fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:56.942125 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113fc8a-b116-4d5f-8e9d-d2508b4b00fd admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:56.959343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1096/2186] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:56.963478 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65761a53-cc0e-41ec-9459-7bcf278791c5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:56.974307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65761a53-cc0e-41ec-9459-7bcf278791c5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:56.983261 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030be82-7a69-43cf-ac13-3efd83cc5e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:56.985289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030be82-7a69-43cf-ac13-3efd83cc5e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:56.985722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030be82-7a69-43cf-ac13-3efd83cc5e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:56.986194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030be82-7a69-43cf-ac13-3efd83cc5e12 admin admin] PATH_INFO: `/v3/projects/772c73427a3d4273b68dbc3b304474f0/users/7f02e9de96b842d4a971a02d739be21c/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:57.008605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030be82-7a69-43cf-ac13-3efd83cc5e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772c73427a3d4273b68dbc3b304474f0, user_id=7f02e9de96b842d4a971a02d739be21c, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:57.011790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030be82-7a69-43cf-ac13-3efd83cc5e12 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:57.119010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1091/2187] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:56 2022] PUT /identity/v3/projects/772c73427a3d4273b68dbc3b304474f0/users/7f02e9de96b842d4a971a02d739be21c/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:57.121216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7fbd2-c1be-43d4-a48e-906939b83fd2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:57.121586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7fbd2-c1be-43d4-a48e-906939b83fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:57.122014 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7fbd2-c1be-43d4-a48e-906939b83fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:57.166090 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:33:57.171626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-33b7fbd2-c1be-43d4-a48e-906939b83fd2 None None] MFA Rules not processed for user `7f02e9de96b842d4a971a02d739be21c`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:57.172590 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-33b7fbd2-c1be-43d4-a48e-906939b83fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:57.268131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1097/2188] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:57.275859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030be82-7a69-43cf-ac13-3efd83cc5e12 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:57.401463 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030be82-7a69-43cf-ac13-3efd83cc5e12 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:57.408001 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf0187-9bc8-4033-8f41-7841e0709c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:57.408604 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf0187-9bc8-4033-8f41-7841e0709c33 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:57.409121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf0187-9bc8-4033-8f41-7841e0709c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:57.409647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf0187-9bc8-4033-8f41-7841e0709c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:57.411315 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf0187-9bc8-4033-8f41-7841e0709c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:57.413582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf0187-9bc8-4033-8f41-7841e0709c33 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:57.581095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1092/2189] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:33:57 2022] POST /identity/v3/projects => generated 381 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:33:57.582412 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7fbd2-c1be-43d4-a48e-906939b83fd2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:57.614051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7fbd2-c1be-43d4-a48e-906939b83fd2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:57.752290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e799c-d5e1-42fb-a81e-9a85d91f4e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:57.752956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e799c-d5e1-42fb-a81e-9a85d91f4e05 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:57.753236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e799c-d5e1-42fb-a81e-9a85d91f4e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:57.753508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e799c-d5e1-42fb-a81e-9a85d91f4e05 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:57.754239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e799c-d5e1-42fb-a81e-9a85d91f4e05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:57.756674 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e799c-d5e1-42fb-a81e-9a85d91f4e05 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:57.890174 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1098/2190] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:33:57 2022] POST /identity/v3/users => generated 297 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:33:57.892535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf0187-9bc8-4033-8f41-7841e0709c33 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:57.907669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf0187-9bc8-4033-8f41-7841e0709c33 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:57.920715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38907d-a89a-4de8-924e-26f52bb8c639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:57.921569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38907d-a89a-4de8-924e-26f52bb8c639 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:57.922537 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38907d-a89a-4de8-924e-26f52bb8c639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:57.922982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38907d-a89a-4de8-924e-26f52bb8c639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:57.933034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38907d-a89a-4de8-924e-26f52bb8c639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:57.936897 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38907d-a89a-4de8-924e-26f52bb8c639 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:57.958122 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1093/2191] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:33:57.963147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e799c-d5e1-42fb-a81e-9a85d91f4e05 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:57.975243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e799c-d5e1-42fb-a81e-9a85d91f4e05 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:57.980161 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98054f88-5868-45bc-879c-9bf245a7ecbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:57.980832 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98054f88-5868-45bc-879c-9bf245a7ecbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:57.981112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98054f88-5868-45bc-879c-9bf245a7ecbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:57.981436 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98054f88-5868-45bc-879c-9bf245a7ecbd admin admin] PATH_INFO: `/v3/projects/60d05e5c01244e5681394be226c1c140/users/0f8252f0cb734c62968d636001644318/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:58.000143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98054f88-5868-45bc-879c-9bf245a7ecbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d05e5c01244e5681394be226c1c140, user_id=0f8252f0cb734c62968d636001644318, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:58.003765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98054f88-5868-45bc-879c-9bf245a7ecbd admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:58.026076 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38907d-a89a-4de8-924e-26f52bb8c639 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:58.027929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3d38907d-a89a-4de8-924e-26f52bb8c639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:58.092029 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1099/2192] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:57 2022] PUT /identity/v3/projects/60d05e5c01244e5681394be226c1c140/users/0f8252f0cb734c62968d636001644318/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:33:58.096321 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98054f88-5868-45bc-879c-9bf245a7ecbd admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:58.098595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38907d-a89a-4de8-924e-26f52bb8c639 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:58.167217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ebc7f-6f85-4507-b6b7-16dc329b88b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:58.167932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ebc7f-6f85-4507-b6b7-16dc329b88b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:58.168243 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ebc7f-6f85-4507-b6b7-16dc329b88b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:58.168595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ebc7f-6f85-4507-b6b7-16dc329b88b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:58.170702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a74ebc7f-6f85-4507-b6b7-16dc329b88b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:58.196636 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98054f88-5868-45bc-879c-9bf245a7ecbd admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:58.201785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa576ba-d55f-4ac8-8914-ebadc6aa1804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:58.202735 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa576ba-d55f-4ac8-8914-ebadc6aa1804 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:58.203015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa576ba-d55f-4ac8-8914-ebadc6aa1804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:58.203287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa576ba-d55f-4ac8-8914-ebadc6aa1804 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:58.203988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa576ba-d55f-4ac8-8914-ebadc6aa1804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:58.205659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa576ba-d55f-4ac8-8914-ebadc6aa1804 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:58.216894 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1100/2193] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:33:58.221033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa576ba-d55f-4ac8-8914-ebadc6aa1804 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:58.236394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa576ba-d55f-4ac8-8914-ebadc6aa1804 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:58.241724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f796ea-41bb-4406-9d35-65401c2d8115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:58.242659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f796ea-41bb-4406-9d35-65401c2d8115 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:58.243117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f796ea-41bb-4406-9d35-65401c2d8115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:58.243570 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f796ea-41bb-4406-9d35-65401c2d8115 admin admin] PATH_INFO: `/v3/projects/60d05e5c01244e5681394be226c1c140/users/0f8252f0cb734c62968d636001644318/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:58.245725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f796ea-41bb-4406-9d35-65401c2d8115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d05e5c01244e5681394be226c1c140, user_id=0f8252f0cb734c62968d636001644318, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:58.248714 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f796ea-41bb-4406-9d35-65401c2d8115 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:58.260234 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1101/2194] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:33:58 2022] PUT /identity/v3/projects/60d05e5c01244e5681394be226c1c140/users/0f8252f0cb734c62968d636001644318/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:33:58.272782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c201540-86b3-4b4f-a11e-4250731193fd None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:58.273150 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c201540-86b3-4b4f-a11e-4250731193fd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:58.273428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c201540-86b3-4b4f-a11e-4250731193fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:58.308826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ebc7f-6f85-4507-b6b7-16dc329b88b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:58.312166 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ebc7f-6f85-4507-b6b7-16dc329b88b2 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:58.312282 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2c201540-86b3-4b4f-a11e-4250731193fd None None] MFA Rules not processed for user `0f8252f0cb734c62968d636001644318`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:33:58.312522 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2c201540-86b3-4b4f-a11e-4250731193fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:58.323928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1094/2195] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:33:58.486882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1102/2196] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:33:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:33:58.495795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ebc7f-6f85-4507-b6b7-16dc329b88b2 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:58.497789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a74ebc7f-6f85-4507-b6b7-16dc329b88b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:33:58.513983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ebc7f-6f85-4507-b6b7-16dc329b88b2 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:58.586400 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba350cb-aca2-4768-967c-c9f35c3a1350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:58.587211 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba350cb-aca2-4768-967c-c9f35c3a1350 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:58.587598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba350cb-aca2-4768-967c-c9f35c3a1350 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:58.587972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba350cb-aca2-4768-967c-c9f35c3a1350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:58.603428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba350cb-aca2-4768-967c-c9f35c3a1350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:58.605748 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba350cb-aca2-4768-967c-c9f35c3a1350 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:58.658373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1095/2197] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:33:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:33:59.580706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c201540-86b3-4b4f-a11e-4250731193fd None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:33:59.650004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c201540-86b3-4b4f-a11e-4250731193fd None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:33:59.654679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d171d7-c48b-4175-90e9-b2f9786c77b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:33:59.655502 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d171d7-c48b-4175-90e9-b2f9786c77b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:33:59.655784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d171d7-c48b-4175-90e9-b2f9786c77b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:33:59.656057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d171d7-c48b-4175-90e9-b2f9786c77b0 admin admin] PATH_INFO: `/v3/users/7f02e9de96b842d4a971a02d739be21c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:33:59.657180 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d171d7-c48b-4175-90e9-b2f9786c77b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f02e9de96b842d4a971a02d739be21c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:33:59.659453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d171d7-c48b-4175-90e9-b2f9786c77b0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:33:59.997859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-03d171d7-c48b-4175-90e9-b2f9786c77b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f02e9de96b842d4a971a02d739be21c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:00.015754 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-03d171d7-c48b-4175-90e9-b2f9786c77b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f02e9de96b842d4a971a02d739be21c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:00.026282 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-03d171d7-c48b-4175-90e9-b2f9786c77b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f02e9de96b842d4a971a02d739be21c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:00.028692 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-03d171d7-c48b-4175-90e9-b2f9786c77b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f02e9de96b842d4a971a02d739be21c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:00.115373 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-03d171d7-c48b-4175-90e9-b2f9786c77b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f02e9de96b842d4a971a02d739be21c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:00.122709 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1103/2198] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:33:59 2022] DELETE /identity/v3/users/7f02e9de96b842d4a971a02d739be21c => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:00.127235 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01fb67-be93-4eed-b3e6-0d3b93b4ddb0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:00.127715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01fb67-be93-4eed-b3e6-0d3b93b4ddb0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:00.127891 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01fb67-be93-4eed-b3e6-0d3b93b4ddb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:00.148041 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1e01fb67-be93-4eed-b3e6-0d3b93b4ddb0 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:00.149254 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1e01fb67-be93-4eed-b3e6-0d3b93b4ddb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:00.215151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1096/2199] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:34:00.225365 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d171d7-c48b-4175-90e9-b2f9786c77b0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:00.226825 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-03d171d7-c48b-4175-90e9-b2f9786c77b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:00.288591 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d171d7-c48b-4175-90e9-b2f9786c77b0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:00.293598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca172527-c61e-4c5a-9a64-09d6577ed774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:00.294657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca172527-c61e-4c5a-9a64-09d6577ed774 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:00.294862 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca172527-c61e-4c5a-9a64-09d6577ed774 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:00.295160 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca172527-c61e-4c5a-9a64-09d6577ed774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:00.308089 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca172527-c61e-4c5a-9a64-09d6577ed774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:00.309511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca172527-c61e-4c5a-9a64-09d6577ed774 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:00.321915 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1104/2200] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:34:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:34:00.632368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01fb67-be93-4eed-b3e6-0d3b93b4ddb0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:00.634468 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1e01fb67-be93-4eed-b3e6-0d3b93b4ddb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:00.726379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01fb67-be93-4eed-b3e6-0d3b93b4ddb0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:00.728802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d15fd-384b-431d-9656-dbc8b1cd2f9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:00.729668 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d15fd-384b-431d-9656-dbc8b1cd2f9d service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:00.730130 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d15fd-384b-431d-9656-dbc8b1cd2f9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:00.730568 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d15fd-384b-431d-9656-dbc8b1cd2f9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:00.734412 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0c3d15fd-384b-431d-9656-dbc8b1cd2f9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:00.833796 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d15fd-384b-431d-9656-dbc8b1cd2f9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:00.835473 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d15fd-384b-431d-9656-dbc8b1cd2f9d service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:00.846736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1097/2201] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:34:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:34:01.074377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:01.214577 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca172527-c61e-4c5a-9a64-09d6577ed774 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:01.219790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ca172527-c61e-4c5a-9a64-09d6577ed774 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:01.239987 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca172527-c61e-4c5a-9a64-09d6577ed774 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:01.256445 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9c561-aefd-440f-9d91-0174aaf9a782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:01.257327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c561-aefd-440f-9d91-0174aaf9a782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:01.260787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c561-aefd-440f-9d91-0174aaf9a782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:01.260787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c561-aefd-440f-9d91-0174aaf9a782 admin admin] PATH_INFO: `/v3/projects/772c73427a3d4273b68dbc3b304474f0` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:01.260787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9c561-aefd-440f-9d91-0174aaf9a782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=772c73427a3d4273b68dbc3b304474f0)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:01.262038 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9c561-aefd-440f-9d91-0174aaf9a782 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:01.499853 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-50b9c561-aefd-440f-9d91-0174aaf9a782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772c73427a3d4273b68dbc3b304474f0', 'request_id': 'req-50b9c561-aefd-440f-9d91-0174aaf9a782'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:01.617542 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-50b9c561-aefd-440f-9d91-0174aaf9a782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772c73427a3d4273b68dbc3b304474f0', 'request_id': 'req-50b9c561-aefd-440f-9d91-0174aaf9a782'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:01.628138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-50b9c561-aefd-440f-9d91-0174aaf9a782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772c73427a3d4273b68dbc3b304474f0', 'request_id': 'req-50b9c561-aefd-440f-9d91-0174aaf9a782'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:01.650922 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-50b9c561-aefd-440f-9d91-0174aaf9a782 admin admin] The token cache is being invalidate because project 772c73427a3d4273b68dbc3b304474f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:34:01.651283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-50b9c561-aefd-440f-9d91-0174aaf9a782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:01.653345 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-50b9c561-aefd-440f-9d91-0174aaf9a782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:01.656569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1105/2202] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:34:01 2022] DELETE /identity/v3/projects/772c73427a3d4273b68dbc3b304474f0 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:01.661834 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d15fd-384b-431d-9656-dbc8b1cd2f9d service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:01.668978 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:01.682651 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d15fd-384b-431d-9656-dbc8b1cd2f9d service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:01.721855 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43313f-3bee-4f68-868c-856a686cc061 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:01.722540 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43313f-3bee-4f68-868c-856a686cc061 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:01.722814 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43313f-3bee-4f68-868c-856a686cc061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:01.749225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6e43313f-3bee-4f68-868c-856a686cc061 None None] MFA Rules not processed for user `2ff41052ee8747cb8039347a41f4e3f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:01.751040 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6e43313f-3bee-4f68-868c-856a686cc061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:01.814695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8f9c8-3117-41c9-bbd0-cc5fdd0c2bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:01.815600 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8f9c8-3117-41c9-bbd0-cc5fdd0c2bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:01.816564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8f9c8-3117-41c9-bbd0-cc5fdd0c2bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:01.817531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8f9c8-3117-41c9-bbd0-cc5fdd0c2bf3 admin admin] PATH_INFO: `/v3/users/0f8252f0cb734c62968d636001644318` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:01.818799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8f9c8-3117-41c9-bbd0-cc5fdd0c2bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f8252f0cb734c62968d636001644318)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:01.820736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8f9c8-3117-41c9-bbd0-cc5fdd0c2bf3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:01.842816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1106/2203] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:34:02.092239 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1ba8f9c8-3117-41c9-bbd0-cc5fdd0c2bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f8252f0cb734c62968d636001644318'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:02.122746 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1ba8f9c8-3117-41c9-bbd0-cc5fdd0c2bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f8252f0cb734c62968d636001644318'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:02.134914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1ba8f9c8-3117-41c9-bbd0-cc5fdd0c2bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f8252f0cb734c62968d636001644318'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:02.135705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1ba8f9c8-3117-41c9-bbd0-cc5fdd0c2bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f8252f0cb734c62968d636001644318'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:02.251127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1ba8f9c8-3117-41c9-bbd0-cc5fdd0c2bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f8252f0cb734c62968d636001644318'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:02.258874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1098/2204] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:34:01 2022] DELETE /identity/v3/users/0f8252f0cb734c62968d636001644318 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:03.157039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43313f-3bee-4f68-868c-856a686cc061 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:03.159064 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6e43313f-3bee-4f68-868c-856a686cc061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:03.206454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43313f-3bee-4f68-868c-856a686cc061 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:03.424302 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b4916-e62d-420f-a810-ef8928a293e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:03.424955 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b4916-e62d-420f-a810-ef8928a293e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:03.425412 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b4916-e62d-420f-a810-ef8928a293e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:03.426338 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b4916-e62d-420f-a810-ef8928a293e3 admin admin] PATH_INFO: `/v3/projects/60d05e5c01244e5681394be226c1c140` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:03.434624 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b4916-e62d-420f-a810-ef8928a293e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d05e5c01244e5681394be226c1c140)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:03.436822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b4916-e62d-420f-a810-ef8928a293e3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:03.608827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d038-4618-4355-adb0-0883b830e62d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:03.609343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d038-4618-4355-adb0-0883b830e62d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:03.619078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d038-4618-4355-adb0-0883b830e62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:03.641379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1ce7d038-4618-4355-adb0-0883b830e62d None None] MFA Rules not processed for user `b3fa8b4eefd147ef9dda3c732e351106`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:03.642786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1ce7d038-4618-4355-adb0-0883b830e62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:03.658486 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-063b4916-e62d-420f-a810-ef8928a293e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d05e5c01244e5681394be226c1c140', 'request_id': 'req-063b4916-e62d-420f-a810-ef8928a293e3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:03.766215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1099/2205] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:34:03.780901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7d038-4618-4355-adb0-0883b830e62d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:03.787186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1ce7d038-4618-4355-adb0-0883b830e62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:03.851264 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-063b4916-e62d-420f-a810-ef8928a293e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d05e5c01244e5681394be226c1c140', 'request_id': 'req-063b4916-e62d-420f-a810-ef8928a293e3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:03.858863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-063b4916-e62d-420f-a810-ef8928a293e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d05e5c01244e5681394be226c1c140', 'request_id': 'req-063b4916-e62d-420f-a810-ef8928a293e3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:03.861173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7d038-4618-4355-adb0-0883b830e62d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:03.867363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bb336-7d44-4a51-8f9f-fb6286656744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:03.867976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb336-7d44-4a51-8f9f-fb6286656744 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:03.868259 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb336-7d44-4a51-8f9f-fb6286656744 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:03.868532 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb336-7d44-4a51-8f9f-fb6286656744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:03.870142 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-063b4916-e62d-420f-a810-ef8928a293e3 admin admin] The token cache is being invalidate because project 60d05e5c01244e5681394be226c1c140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:34:03.870310 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-168bb336-7d44-4a51-8f9f-fb6286656744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:03.870558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-063b4916-e62d-420f-a810-ef8928a293e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:03.871275 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-063b4916-e62d-420f-a810-ef8928a293e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:03.873341 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1107/2206] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:34:03 2022] DELETE /identity/v3/projects/60d05e5c01244e5681394be226c1c140 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:03.877836 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a965b81-cd54-414a-ac4e-b9d3fc9cf70c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:03.878215 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a965b81-cd54-414a-ac4e-b9d3fc9cf70c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:03.879247 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a965b81-cd54-414a-ac4e-b9d3fc9cf70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:03.930732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0a965b81-cd54-414a-ac4e-b9d3fc9cf70c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:03.935206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0a965b81-cd54-414a-ac4e-b9d3fc9cf70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:03.964179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bb336-7d44-4a51-8f9f-fb6286656744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:03.968917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bb336-7d44-4a51-8f9f-fb6286656744 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:03.997276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1100/2207] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:34:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:34:04.054538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1108/2208] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:34:04.062703 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c241a-651e-4494-beb6-a685a22a7f1c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:04.062994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c241a-651e-4494-beb6-a685a22a7f1c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:04.063275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c241a-651e-4494-beb6-a685a22a7f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:04.132474 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a25c241a-651e-4494-beb6-a685a22a7f1c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:04.134841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a25c241a-651e-4494-beb6-a685a22a7f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:04.154378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1101/2209] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:04.159860 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a965b81-cd54-414a-ac4e-b9d3fc9cf70c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:04.181059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a965b81-cd54-414a-ac4e-b9d3fc9cf70c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:04.194516 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cf458-ded0-4b68-be09-996507ad5631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:04.195766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cf458-ded0-4b68-be09-996507ad5631 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:04.202065 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cf458-ded0-4b68-be09-996507ad5631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:04.203375 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cf458-ded0-4b68-be09-996507ad5631 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:04.204616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cf458-ded0-4b68-be09-996507ad5631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:34:04.205654 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cf458-ded0-4b68-be09-996507ad5631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:04.209137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cf458-ded0-4b68-be09-996507ad5631 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:04.247310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1109/2210] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:34:04.247904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c241a-651e-4494-beb6-a685a22a7f1c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:04.254745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c241a-651e-4494-beb6-a685a22a7f1c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:04.259708 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa773b-42fd-4dc9-a3f7-113af963f763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:04.260311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa773b-42fd-4dc9-a3f7-113af963f763 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:04.260746 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa773b-42fd-4dc9-a3f7-113af963f763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:04.261051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa773b-42fd-4dc9-a3f7-113af963f763 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:04.261683 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa773b-42fd-4dc9-a3f7-113af963f763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:04.263690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa773b-42fd-4dc9-a3f7-113af963f763 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:04.431657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cf458-ded0-4b68-be09-996507ad5631 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:04.445334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1102/2211] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:34:04 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:34:04.451322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cf458-ded0-4b68-be09-996507ad5631 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:04.587284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce285601-87f8-4caa-a247-1aeed46d5296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:04.588743 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce285601-87f8-4caa-a247-1aeed46d5296 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:04.589559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce285601-87f8-4caa-a247-1aeed46d5296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:04.590137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce285601-87f8-4caa-a247-1aeed46d5296 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:04.591555 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce285601-87f8-4caa-a247-1aeed46d5296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:04.595397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce285601-87f8-4caa-a247-1aeed46d5296 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:04.743595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:04.756339 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1110/2212] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:34:04 2022] POST /identity/v3/users => generated 289 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:34:04.759268 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa773b-42fd-4dc9-a3f7-113af963f763 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:04.774555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa773b-42fd-4dc9-a3f7-113af963f763 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:04.779744 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a7f9c-8d11-44cc-bd7b-f6e985387d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:04.780946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a7f9c-8d11-44cc-bd7b-f6e985387d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:04.781456 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a7f9c-8d11-44cc-bd7b-f6e985387d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:04.781961 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a7f9c-8d11-44cc-bd7b-f6e985387d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:04.782940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a7f9c-8d11-44cc-bd7b-f6e985387d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:04.785011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a7f9c-8d11-44cc-bd7b-f6e985387d11 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:04.806933 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1103/2213] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:34:04.813760 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce285601-87f8-4caa-a247-1aeed46d5296 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:04.829681 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce285601-87f8-4caa-a247-1aeed46d5296 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:04.835934 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b4aec-a4fd-40f4-ab67-9b4902e562ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:04.838034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b4aec-a4fd-40f4-ab67-9b4902e562ee admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:04.838315 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b4aec-a4fd-40f4-ab67-9b4902e562ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:04.838762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b4aec-a4fd-40f4-ab67-9b4902e562ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:04.839957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b4aec-a4fd-40f4-ab67-9b4902e562ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:04.850653 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b4aec-a4fd-40f4-ab67-9b4902e562ee admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:04.866747 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1111/2214] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:34:04.870747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a7f9c-8d11-44cc-bd7b-f6e985387d11 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:04.882775 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a7f9c-8d11-44cc-bd7b-f6e985387d11 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:04.901620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d0777-5739-4e11-94c4-07cd01443eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:04.907736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d0777-5739-4e11-94c4-07cd01443eab admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:04.907736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d0777-5739-4e11-94c4-07cd01443eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:04.907736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d0777-5739-4e11-94c4-07cd01443eab admin admin] PATH_INFO: `/v3/projects/7f0cdf5755f24fa6ac61613dc507513d/users/634433f9fdca4a36894e57941f07e8ca/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:04.929564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d0777-5739-4e11-94c4-07cd01443eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0cdf5755f24fa6ac61613dc507513d, user_id=634433f9fdca4a36894e57941f07e8ca, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:04.933787 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d0777-5739-4e11-94c4-07cd01443eab admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:04.995155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:05.015683 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1104/2215] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:34:04 2022] PUT /identity/v3/projects/7f0cdf5755f24fa6ac61613dc507513d/users/634433f9fdca4a36894e57941f07e8ca/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:34:05.016283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37ce29-943b-4f58-833e-2b7d6e7e5ce4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:05.016791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37ce29-943b-4f58-833e-2b7d6e7e5ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:05.017098 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37ce29-943b-4f58-833e-2b7d6e7e5ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:05.068347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5d37ce29-943b-4f58-833e-2b7d6e7e5ce4 None None] MFA Rules not processed for user `634433f9fdca4a36894e57941f07e8ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:05.069848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5d37ce29-943b-4f58-833e-2b7d6e7e5ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:05.202909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1112/2216] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:05.212366 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d0777-5739-4e11-94c4-07cd01443eab admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:05.308223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d0777-5739-4e11-94c4-07cd01443eab admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:05.313627 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c329994-6a66-4a6d-af9b-d9bbf81acfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:05.314271 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c329994-6a66-4a6d-af9b-d9bbf81acfe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:05.314550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c329994-6a66-4a6d-af9b-d9bbf81acfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:05.314822 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c329994-6a66-4a6d-af9b-d9bbf81acfe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:05.315460 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c329994-6a66-4a6d-af9b-d9bbf81acfe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:05.318244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c329994-6a66-4a6d-af9b-d9bbf81acfe2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:05.447322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1105/2217] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:34:05 2022] POST /identity/v3/projects => generated 381 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:34:05.451194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37ce29-943b-4f58-833e-2b7d6e7e5ce4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:05.464113 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37ce29-943b-4f58-833e-2b7d6e7e5ce4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:05.562215 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef482bb7-c667-45e4-ac5e-b4052652a594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:05.563103 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef482bb7-c667-45e4-ac5e-b4052652a594 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:05.563527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef482bb7-c667-45e4-ac5e-b4052652a594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:05.563954 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef482bb7-c667-45e4-ac5e-b4052652a594 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:05.564764 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef482bb7-c667-45e4-ac5e-b4052652a594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:05.567550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef482bb7-c667-45e4-ac5e-b4052652a594 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:05.855028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1113/2218] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:34:05 2022] POST /identity/v3/users => generated 297 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:34:05.856355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c329994-6a66-4a6d-af9b-d9bbf81acfe2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:05.877042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c329994-6a66-4a6d-af9b-d9bbf81acfe2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:05.891084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac68b37-0f3c-4ebb-b302-cc33fd524ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:05.891676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac68b37-0f3c-4ebb-b302-cc33fd524ecd admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:05.891832 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac68b37-0f3c-4ebb-b302-cc33fd524ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:05.892139 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac68b37-0f3c-4ebb-b302-cc33fd524ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:05.892889 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac68b37-0f3c-4ebb-b302-cc33fd524ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:05.898211 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac68b37-0f3c-4ebb-b302-cc33fd524ecd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:05.926455 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1106/2219] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:34:05.931216 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef482bb7-c667-45e4-ac5e-b4052652a594 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:05.946049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef482bb7-c667-45e4-ac5e-b4052652a594 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:05.957035 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe7a21-2723-4392-a1ea-0b5bd93dfb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:05.961465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe7a21-2723-4392-a1ea-0b5bd93dfb54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:05.962018 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe7a21-2723-4392-a1ea-0b5bd93dfb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:05.963834 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe7a21-2723-4392-a1ea-0b5bd93dfb54 admin admin] PATH_INFO: `/v3/projects/54b0be4d42854061ac7d2d5791785a00/users/c851fdd2dfcc4802a95cb9fe7baac175/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:06.014300 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe7a21-2723-4392-a1ea-0b5bd93dfb54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b0be4d42854061ac7d2d5791785a00, user_id=c851fdd2dfcc4802a95cb9fe7baac175, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:06.017002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe7a21-2723-4392-a1ea-0b5bd93dfb54 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:06.120767 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1114/2220] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:34:05 2022] PUT /identity/v3/projects/54b0be4d42854061ac7d2d5791785a00/users/c851fdd2dfcc4802a95cb9fe7baac175/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:06.128067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac68b37-0f3c-4ebb-b302-cc33fd524ecd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:06.181563 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac68b37-0f3c-4ebb-b302-cc33fd524ecd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:06.334533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913344d1-949d-4303-804d-02e06935a6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:06.335161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913344d1-949d-4303-804d-02e06935a6ae admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:06.335441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913344d1-949d-4303-804d-02e06935a6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:06.335716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913344d1-949d-4303-804d-02e06935a6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:06.337238 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913344d1-949d-4303-804d-02e06935a6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:06.338877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913344d1-949d-4303-804d-02e06935a6ae admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:06.352195 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1107/2221] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:34:06.357919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe7a21-2723-4392-a1ea-0b5bd93dfb54 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:06.374406 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe7a21-2723-4392-a1ea-0b5bd93dfb54 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:06.381569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a76edc-831e-4b73-a141-6fee6bd24949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:06.383330 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a76edc-831e-4b73-a141-6fee6bd24949 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:06.384644 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a76edc-831e-4b73-a141-6fee6bd24949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:06.385123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a76edc-831e-4b73-a141-6fee6bd24949 admin admin] PATH_INFO: `/v3/projects/54b0be4d42854061ac7d2d5791785a00/users/c851fdd2dfcc4802a95cb9fe7baac175/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:06.388146 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a76edc-831e-4b73-a141-6fee6bd24949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b0be4d42854061ac7d2d5791785a00, user_id=c851fdd2dfcc4802a95cb9fe7baac175, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:06.392688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a76edc-831e-4b73-a141-6fee6bd24949 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:06.416043 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1115/2222] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:34:06 2022] PUT /identity/v3/projects/54b0be4d42854061ac7d2d5791785a00/users/c851fdd2dfcc4802a95cb9fe7baac175/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:06.418437 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626a8fe-b018-47f3-bcc0-d23e2c01bd0d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:06.419779 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626a8fe-b018-47f3-bcc0-d23e2c01bd0d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:06.420210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626a8fe-b018-47f3-bcc0-d23e2c01bd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:06.455273 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8626a8fe-b018-47f3-bcc0-d23e2c01bd0d None None] MFA Rules not processed for user `c851fdd2dfcc4802a95cb9fe7baac175`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:06.457453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8626a8fe-b018-47f3-bcc0-d23e2c01bd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:06.577906 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1108/2223] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:06.591239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a76edc-831e-4b73-a141-6fee6bd24949 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:06.594023 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-79a76edc-831e-4b73-a141-6fee6bd24949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:06.684833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a76edc-831e-4b73-a141-6fee6bd24949 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:06.695589 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38875b65-6d81-4205-99c5-e2b453e77e12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:06.698606 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38875b65-6d81-4205-99c5-e2b453e77e12 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:06.699117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38875b65-6d81-4205-99c5-e2b453e77e12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:06.699662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38875b65-6d81-4205-99c5-e2b453e77e12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:06.718552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38875b65-6d81-4205-99c5-e2b453e77e12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:06.720787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38875b65-6d81-4205-99c5-e2b453e77e12 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:06.759700 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1116/2224] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:34:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:34:06.991995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626a8fe-b018-47f3-bcc0-d23e2c01bd0d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:07.013426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626a8fe-b018-47f3-bcc0-d23e2c01bd0d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:07.020427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de7205-61ba-4e64-8f43-4e0629aabaf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:07.022326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de7205-61ba-4e64-8f43-4e0629aabaf1 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:07.022761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de7205-61ba-4e64-8f43-4e0629aabaf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:07.023639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de7205-61ba-4e64-8f43-4e0629aabaf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:07.194246 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de7205-61ba-4e64-8f43-4e0629aabaf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:07.198066 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de7205-61ba-4e64-8f43-4e0629aabaf1 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:07.208930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1109/2225] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:34:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:34:07.830292 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38875b65-6d81-4205-99c5-e2b453e77e12 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:07.831977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-38875b65-6d81-4205-99c5-e2b453e77e12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:07.889341 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de7205-61ba-4e64-8f43-4e0629aabaf1 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:07.903472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38875b65-6d81-4205-99c5-e2b453e77e12 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:07.908254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fd7d5-1c15-4071-86a0-340e1d65c884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:07.908898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fd7d5-1c15-4071-86a0-340e1d65c884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:07.909178 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fd7d5-1c15-4071-86a0-340e1d65c884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:07.909453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fd7d5-1c15-4071-86a0-340e1d65c884 admin admin] PATH_INFO: `/v3/users/17f9783c63c544c4907084c686170a58` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:07.911175 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fd7d5-1c15-4071-86a0-340e1d65c884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f9783c63c544c4907084c686170a58)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:07.913156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fd7d5-1c15-4071-86a0-340e1d65c884 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:07.981679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de7205-61ba-4e64-8f43-4e0629aabaf1 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:07.990179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf41ad4-4631-41d7-ba24-d6fc6f4908c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:07.991836 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf41ad4-4631-41d7-ba24-d6fc6f4908c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:07.992126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf41ad4-4631-41d7-ba24-d6fc6f4908c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:07.992688 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf41ad4-4631-41d7-ba24-d6fc6f4908c0 admin admin] PATH_INFO: `/v3/users/634433f9fdca4a36894e57941f07e8ca` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:07.993687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf41ad4-4631-41d7-ba24-d6fc6f4908c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=634433f9fdca4a36894e57941f07e8ca)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:07.995730 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf41ad4-4631-41d7-ba24-d6fc6f4908c0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:08.024090 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:08.225503 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a87fd7d5-1c15-4071-86a0-340e1d65c884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f9783c63c544c4907084c686170a58'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:08.239559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a87fd7d5-1c15-4071-86a0-340e1d65c884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f9783c63c544c4907084c686170a58'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:08.252463 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a87fd7d5-1c15-4071-86a0-340e1d65c884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f9783c63c544c4907084c686170a58'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:08.253316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a87fd7d5-1c15-4071-86a0-340e1d65c884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f9783c63c544c4907084c686170a58'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:08.260936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bf41ad4-4631-41d7-ba24-d6fc6f4908c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '634433f9fdca4a36894e57941f07e8ca'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:08.275172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bf41ad4-4631-41d7-ba24-d6fc6f4908c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '634433f9fdca4a36894e57941f07e8ca'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:08.283935 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bf41ad4-4631-41d7-ba24-d6fc6f4908c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '634433f9fdca4a36894e57941f07e8ca'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:08.285279 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bf41ad4-4631-41d7-ba24-d6fc6f4908c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '634433f9fdca4a36894e57941f07e8ca'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:08.336339 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a87fd7d5-1c15-4071-86a0-340e1d65c884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f9783c63c544c4907084c686170a58'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:08.343465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1117/2226] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:34:07 2022] DELETE /identity/v3/users/17f9783c63c544c4907084c686170a58 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:08.346259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e614bff-48be-45fc-aa14-f81a8e967f8b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:08.346259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e614bff-48be-45fc-aa14-f81a8e967f8b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:08.346259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e614bff-48be-45fc-aa14-f81a8e967f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:08.367504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5e614bff-48be-45fc-aa14-f81a8e967f8b None None] MFA Rules not processed for user `93d9d6782d7d4f5cb82afa51d77415c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:08.368786 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5e614bff-48be-45fc-aa14-f81a8e967f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:08.377199 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:08.404851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3bf41ad4-4631-41d7-ba24-d6fc6f4908c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '634433f9fdca4a36894e57941f07e8ca'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:08.411345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1110/2227] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:34:07 2022] DELETE /identity/v3/users/634433f9fdca4a36894e57941f07e8ca => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:34:08.413007 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feaf74-691e-4b2e-b14f-693ad42af9cb None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:08.413298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feaf74-691e-4b2e-b14f-693ad42af9cb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:08.413605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feaf74-691e-4b2e-b14f-693ad42af9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:08.434540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-47feaf74-691e-4b2e-b14f-693ad42af9cb None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:08.436021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-47feaf74-691e-4b2e-b14f-693ad42af9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:08.439828 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1118/2228] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:08.441855 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b58a66-a54e-4960-b44c-1b7b56ecd182 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:08.442297 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b58a66-a54e-4960-b44c-1b7b56ecd182 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:08.442658 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b58a66-a54e-4960-b44c-1b7b56ecd182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:08.472703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-99b58a66-a54e-4960-b44c-1b7b56ecd182 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:08.474249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-99b58a66-a54e-4960-b44c-1b7b56ecd182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:08.545235 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1111/2229] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:08.552738 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feaf74-691e-4b2e-b14f-693ad42af9cb None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:08.554413 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-47feaf74-691e-4b2e-b14f-693ad42af9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:08.556966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1119/2230] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:08.565566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b58a66-a54e-4960-b44c-1b7b56ecd182 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:08.567868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-99b58a66-a54e-4960-b44c-1b7b56ecd182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:08.638752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feaf74-691e-4b2e-b14f-693ad42af9cb None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:08.644559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a3d07-a692-4e90-aadf-0bcb3cecb76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:08.645284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a3d07-a692-4e90-aadf-0bcb3cecb76a service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:08.645560 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a3d07-a692-4e90-aadf-0bcb3cecb76a service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:08.645856 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a3d07-a692-4e90-aadf-0bcb3cecb76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:08.657362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b58a66-a54e-4960-b44c-1b7b56ecd182 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:08.661570 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a3d07-a692-4e90-aadf-0bcb3cecb76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:08.663140 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a3d07-a692-4e90-aadf-0bcb3cecb76a service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:08.679637 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf12607-53cf-45fd-956f-72721d65cd82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:08.680270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf12607-53cf-45fd-956f-72721d65cd82 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:08.680548 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf12607-53cf-45fd-956f-72721d65cd82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:08.680863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf12607-53cf-45fd-956f-72721d65cd82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:08.693082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1112/2231] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:34:08.693582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf12607-53cf-45fd-956f-72721d65cd82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:08.695745 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf12607-53cf-45fd-956f-72721d65cd82 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:08.713663 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1120/2232] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:34:09.954914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a3d07-a692-4e90-aadf-0bcb3cecb76a service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:09.954914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-754a3d07-a692-4e90-aadf-0bcb3cecb76a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:09.988908 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a3d07-a692-4e90-aadf-0bcb3cecb76a service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:09.995183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239bf22-f1f7-4443-8221-16be16876edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:09.995882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239bf22-f1f7-4443-8221-16be16876edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:09.996164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239bf22-f1f7-4443-8221-16be16876edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:09.996436 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239bf22-f1f7-4443-8221-16be16876edf admin admin] PATH_INFO: `/v3/projects/c30c9fc4ed7b49a492b08b5cc42d6136` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:09.997726 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239bf22-f1f7-4443-8221-16be16876edf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c30c9fc4ed7b49a492b08b5cc42d6136)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:09.999854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239bf22-f1f7-4443-8221-16be16876edf admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:10.106286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf12607-53cf-45fd-956f-72721d65cd82 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:10.108291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-dcf12607-53cf-45fd-956f-72721d65cd82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:10.123036 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf12607-53cf-45fd-956f-72721d65cd82 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:10.148225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed51047-9ca2-43b5-8407-bce9cbe3f754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:10.149005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed51047-9ca2-43b5-8407-bce9cbe3f754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:10.149452 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed51047-9ca2-43b5-8407-bce9cbe3f754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:10.149894 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed51047-9ca2-43b5-8407-bce9cbe3f754 admin admin] PATH_INFO: `/v3/projects/7f0cdf5755f24fa6ac61613dc507513d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:10.151618 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed51047-9ca2-43b5-8407-bce9cbe3f754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0cdf5755f24fa6ac61613dc507513d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:10.155845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed51047-9ca2-43b5-8407-bce9cbe3f754 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:10.171245 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4239bf22-f1f7-4443-8221-16be16876edf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c30c9fc4ed7b49a492b08b5cc42d6136', 'request_id': 'req-4239bf22-f1f7-4443-8221-16be16876edf'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:10.256561 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4239bf22-f1f7-4443-8221-16be16876edf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c30c9fc4ed7b49a492b08b5cc42d6136', 'request_id': 'req-4239bf22-f1f7-4443-8221-16be16876edf'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:10.263574 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4239bf22-f1f7-4443-8221-16be16876edf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c30c9fc4ed7b49a492b08b5cc42d6136', 'request_id': 'req-4239bf22-f1f7-4443-8221-16be16876edf'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:10.276862 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4239bf22-f1f7-4443-8221-16be16876edf admin admin] The token cache is being invalidate because project c30c9fc4ed7b49a492b08b5cc42d6136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:34:10.277158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4239bf22-f1f7-4443-8221-16be16876edf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:10.277858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4239bf22-f1f7-4443-8221-16be16876edf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:10.279565 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1113/2233] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:34:09 2022] DELETE /identity/v3/projects/c30c9fc4ed7b49a492b08b5cc42d6136 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:10.283327 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239bf22-f1f7-4443-8221-16be16876edf admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:10.285127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4239bf22-f1f7-4443-8221-16be16876edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:10.344129 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6ed51047-9ca2-43b5-8407-bce9cbe3f754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0cdf5755f24fa6ac61613dc507513d', 'request_id': 'req-6ed51047-9ca2-43b5-8407-bce9cbe3f754'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:10.363432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239bf22-f1f7-4443-8221-16be16876edf admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:10.426757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1c2d8-b203-4bd5-b226-2355a9aba556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:10.427406 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1c2d8-b203-4bd5-b226-2355a9aba556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:10.427689 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1c2d8-b203-4bd5-b226-2355a9aba556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:10.427963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1c2d8-b203-4bd5-b226-2355a9aba556 admin admin] PATH_INFO: `/v3/users/296ad5762e514e66899f2371204312ea` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:10.429231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1c2d8-b203-4bd5-b226-2355a9aba556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=296ad5762e514e66899f2371204312ea)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:10.431245 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1c2d8-b203-4bd5-b226-2355a9aba556 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:10.462886 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6ed51047-9ca2-43b5-8407-bce9cbe3f754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0cdf5755f24fa6ac61613dc507513d', 'request_id': 'req-6ed51047-9ca2-43b5-8407-bce9cbe3f754'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:10.463083 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:10.481389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6ed51047-9ca2-43b5-8407-bce9cbe3f754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0cdf5755f24fa6ac61613dc507513d', 'request_id': 'req-6ed51047-9ca2-43b5-8407-bce9cbe3f754'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:10.515465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6ed51047-9ca2-43b5-8407-bce9cbe3f754 admin admin] The token cache is being invalidate because project 7f0cdf5755f24fa6ac61613dc507513d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:34:10.515893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6ed51047-9ca2-43b5-8407-bce9cbe3f754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:10.516707 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6ed51047-9ca2-43b5-8407-bce9cbe3f754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:10.518399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1121/2234] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:34:10 2022] DELETE /identity/v3/projects/7f0cdf5755f24fa6ac61613dc507513d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:34:10.523714 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed51047-9ca2-43b5-8407-bce9cbe3f754 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:10.527577 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6ed51047-9ca2-43b5-8407-bce9cbe3f754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:10.545469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed51047-9ca2-43b5-8407-bce9cbe3f754 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:10.580706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569a023-1d78-427a-916d-63342c37bd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:10.585306 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569a023-1d78-427a-916d-63342c37bd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:10.585793 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569a023-1d78-427a-916d-63342c37bd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:10.586036 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569a023-1d78-427a-916d-63342c37bd14 admin admin] PATH_INFO: `/v3/users/c851fdd2dfcc4802a95cb9fe7baac175` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:10.588695 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569a023-1d78-427a-916d-63342c37bd14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c851fdd2dfcc4802a95cb9fe7baac175)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:10.591161 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569a023-1d78-427a-916d-63342c37bd14 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:10.883228 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dca1c2d8-b203-4bd5-b226-2355a9aba556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '296ad5762e514e66899f2371204312ea'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:10.900868 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dca1c2d8-b203-4bd5-b226-2355a9aba556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '296ad5762e514e66899f2371204312ea'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:10.915233 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dca1c2d8-b203-4bd5-b226-2355a9aba556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '296ad5762e514e66899f2371204312ea'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:10.916379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dca1c2d8-b203-4bd5-b226-2355a9aba556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '296ad5762e514e66899f2371204312ea'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:10.988276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3569a023-1d78-427a-916d-63342c37bd14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c851fdd2dfcc4802a95cb9fe7baac175'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:11.019056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3569a023-1d78-427a-916d-63342c37bd14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c851fdd2dfcc4802a95cb9fe7baac175'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:11.028936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3569a023-1d78-427a-916d-63342c37bd14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c851fdd2dfcc4802a95cb9fe7baac175'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:11.029690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3569a023-1d78-427a-916d-63342c37bd14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c851fdd2dfcc4802a95cb9fe7baac175'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:11.079282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dca1c2d8-b203-4bd5-b226-2355a9aba556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '296ad5762e514e66899f2371204312ea'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:11.088008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1114/2235] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:34:10 2022] DELETE /identity/v3/users/296ad5762e514e66899f2371204312ea => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:11.177091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3569a023-1d78-427a-916d-63342c37bd14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c851fdd2dfcc4802a95cb9fe7baac175'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:11.185411 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1122/2236] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:34:10 2022] DELETE /identity/v3/users/c851fdd2dfcc4802a95cb9fe7baac175 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:34:11.585975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1c2d8-b203-4bd5-b226-2355a9aba556 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:11.587684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dca1c2d8-b203-4bd5-b226-2355a9aba556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:11.673331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1c2d8-b203-4bd5-b226-2355a9aba556 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:11.732823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569a023-1d78-427a-916d-63342c37bd14 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:11.734823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3569a023-1d78-427a-916d-63342c37bd14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:11.744753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:11.745539 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:11.745791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:11.746076 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef admin admin] PATH_INFO: `/v3/projects/10db0b3a5482424b9ef50fff0ee20503` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:11.747325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=10db0b3a5482424b9ef50fff0ee20503)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:11.749292 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:11.841220 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569a023-1d78-427a-916d-63342c37bd14 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:11.849366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1a0da-d623-46ba-acde-74aa60f466b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:11.850184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1a0da-d623-46ba-acde-74aa60f466b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:11.850561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1a0da-d623-46ba-acde-74aa60f466b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:11.851318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1a0da-d623-46ba-acde-74aa60f466b7 admin admin] PATH_INFO: `/v3/projects/54b0be4d42854061ac7d2d5791785a00` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:11.852820 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1a0da-d623-46ba-acde-74aa60f466b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b0be4d42854061ac7d2d5791785a00)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:11.855059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1a0da-d623-46ba-acde-74aa60f466b7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:11.890180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10db0b3a5482424b9ef50fff0ee20503', 'request_id': 'req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:11.977257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10db0b3a5482424b9ef50fff0ee20503', 'request_id': 'req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:11.992769 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10db0b3a5482424b9ef50fff0ee20503', 'request_id': 'req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:12.023388 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-58e1a0da-d623-46ba-acde-74aa60f466b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b0be4d42854061ac7d2d5791785a00', 'request_id': 'req-58e1a0da-d623-46ba-acde-74aa60f466b7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:12.023582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef admin admin] The token cache is being invalidate because project 10db0b3a5482424b9ef50fff0ee20503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:34:12.023805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:12.024479 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:12.026417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1115/2237] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:34:11 2022] DELETE /identity/v3/projects/10db0b3a5482424b9ef50fff0ee20503 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:12.031093 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:12.032617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:12.100076 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b668ea-aba9-43fe-8040-3fd31fbf1fef admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:12.124899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-58e1a0da-d623-46ba-acde-74aa60f466b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b0be4d42854061ac7d2d5791785a00', 'request_id': 'req-58e1a0da-d623-46ba-acde-74aa60f466b7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:12.132408 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-58e1a0da-d623-46ba-acde-74aa60f466b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b0be4d42854061ac7d2d5791785a00', 'request_id': 'req-58e1a0da-d623-46ba-acde-74aa60f466b7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:12.145821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-58e1a0da-d623-46ba-acde-74aa60f466b7 admin admin] The token cache is being invalidate because project 54b0be4d42854061ac7d2d5791785a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:34:12.146724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-58e1a0da-d623-46ba-acde-74aa60f466b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:12.147846 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-58e1a0da-d623-46ba-acde-74aa60f466b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:12.149944 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1123/2238] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:34:11 2022] DELETE /identity/v3/projects/54b0be4d42854061ac7d2d5791785a00 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:12.157926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1ce5d-dfdd-42cb-9e4f-ea1d8141a216 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:12.158423 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1ce5d-dfdd-42cb-9e4f-ea1d8141a216 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:12.164856 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1ce5d-dfdd-42cb-9e4f-ea1d8141a216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:12.181482 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-94e1ce5d-dfdd-42cb-9e4f-ea1d8141a216 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:12.183184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-94e1ce5d-dfdd-42cb-9e4f-ea1d8141a216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:12.193265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1124/2239] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:34:12.195227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8e24f-422e-489c-9e6d-b00ebf6eb6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:12.195886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8e24f-422e-489c-9e6d-b00ebf6eb6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:12.196169 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8e24f-422e-489c-9e6d-b00ebf6eb6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:12.196442 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8e24f-422e-489c-9e6d-b00ebf6eb6b6 admin admin] PATH_INFO: `/v3/users/634e59b0367b4ef3a7b392dc1100b705` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:12.198039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8e24f-422e-489c-9e6d-b00ebf6eb6b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=634e59b0367b4ef3a7b392dc1100b705)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:12.200052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8e24f-422e-489c-9e6d-b00ebf6eb6b6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:12.200766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01cae5-b114-4d04-aa10-c78382729d9e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:12.201122 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01cae5-b114-4d04-aa10-c78382729d9e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:12.201454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01cae5-b114-4d04-aa10-c78382729d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:12.224145 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9e01cae5-b114-4d04-aa10-c78382729d9e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:12.229291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9e01cae5-b114-4d04-aa10-c78382729d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:12.234937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1125/2240] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:34:12.239365 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01cae5-b114-4d04-aa10-c78382729d9e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:12.255368 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01cae5-b114-4d04-aa10-c78382729d9e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:12.262144 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c8e0-0b7d-4adc-82f2-c601b4153f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:12.262784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c8e0-0b7d-4adc-82f2-c601b4153f2b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:12.263062 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c8e0-0b7d-4adc-82f2-c601b4153f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:12.263333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c8e0-0b7d-4adc-82f2-c601b4153f2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:12.264327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c8e0-0b7d-4adc-82f2-c601b4153f2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:34:12.264598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c8e0-0b7d-4adc-82f2-c601b4153f2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:12.266322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c8e0-0b7d-4adc-82f2-c601b4153f2b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:12.280781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1126/2241] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:34:12.285385 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c8e0-0b7d-4adc-82f2-c601b4153f2b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:12.308365 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c8e0-0b7d-4adc-82f2-c601b4153f2b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:12.334028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ce8e3-83d3-4189-af5a-5eee096fd442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:12.334703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ce8e3-83d3-4189-af5a-5eee096fd442 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:12.334987 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ce8e3-83d3-4189-af5a-5eee096fd442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:12.335290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ce8e3-83d3-4189-af5a-5eee096fd442 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:12.335938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ce8e3-83d3-4189-af5a-5eee096fd442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:12.337920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ce8e3-83d3-4189-af5a-5eee096fd442 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:12.444794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1127/2242] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:34:12 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:34:12.453176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-58f8e24f-422e-489c-9e6d-b00ebf6eb6b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '634e59b0367b4ef3a7b392dc1100b705'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:12.454580 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ce8e3-83d3-4189-af5a-5eee096fd442 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:12.468923 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-58f8e24f-422e-489c-9e6d-b00ebf6eb6b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '634e59b0367b4ef3a7b392dc1100b705'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:12.476234 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-58f8e24f-422e-489c-9e6d-b00ebf6eb6b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '634e59b0367b4ef3a7b392dc1100b705'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:12.477038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-58f8e24f-422e-489c-9e6d-b00ebf6eb6b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '634e59b0367b4ef3a7b392dc1100b705'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:12.521986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ce8e3-83d3-4189-af5a-5eee096fd442 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:12.526953 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60414401-9b41-4328-b5be-5abdefce0200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:12.527561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60414401-9b41-4328-b5be-5abdefce0200 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:12.527846 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60414401-9b41-4328-b5be-5abdefce0200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:12.528119 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60414401-9b41-4328-b5be-5abdefce0200 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:12.528774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60414401-9b41-4328-b5be-5abdefce0200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:12.530743 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60414401-9b41-4328-b5be-5abdefce0200 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:12.564470 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-58f8e24f-422e-489c-9e6d-b00ebf6eb6b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '634e59b0367b4ef3a7b392dc1100b705'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:12.574690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1116/2243] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:34:12 2022] DELETE /identity/v3/users/634e59b0367b4ef3a7b392dc1100b705 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:34:12.764632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1128/2244] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:34:12 2022] POST /identity/v3/users => generated 293 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:34:12.768754 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8e24f-422e-489c-9e6d-b00ebf6eb6b6 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:12.770271 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-58f8e24f-422e-489c-9e6d-b00ebf6eb6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:12.805229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:12.834772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8e24f-422e-489c-9e6d-b00ebf6eb6b6 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:12.840019 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88175560-c998-46d2-be8c-3da437d57985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:12.840632 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88175560-c998-46d2-be8c-3da437d57985 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:12.840912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88175560-c998-46d2-be8c-3da437d57985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:12.841184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88175560-c998-46d2-be8c-3da437d57985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:12.841908 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88175560-c998-46d2-be8c-3da437d57985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:12.843586 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88175560-c998-46d2-be8c-3da437d57985 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:12.854721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1117/2245] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:34:12.858751 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60414401-9b41-4328-b5be-5abdefce0200 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:12.869484 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60414401-9b41-4328-b5be-5abdefce0200 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:12.874194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93327f0c-d8be-4ea4-b91e-42b327e8b627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:12.874796 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93327f0c-d8be-4ea4-b91e-42b327e8b627 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:12.875076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93327f0c-d8be-4ea4-b91e-42b327e8b627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:12.875350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93327f0c-d8be-4ea4-b91e-42b327e8b627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:12.876023 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93327f0c-d8be-4ea4-b91e-42b327e8b627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:12.877818 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93327f0c-d8be-4ea4-b91e-42b327e8b627 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:12.890731 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1129/2246] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:34:12.896687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88175560-c998-46d2-be8c-3da437d57985 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:12.914706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88175560-c998-46d2-be8c-3da437d57985 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:12.919423 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93b09b-af24-48cd-921f-195c9e2bca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:12.920240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93b09b-af24-48cd-921f-195c9e2bca0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:12.920521 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93b09b-af24-48cd-921f-195c9e2bca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:12.920795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93b09b-af24-48cd-921f-195c9e2bca0a admin admin] PATH_INFO: `/v3/projects/a95a456c55ef41259d870aa12f06a1a4/users/dd5cbb9563e6442080b5fcc2cbe9c7f2/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:12.940610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93b09b-af24-48cd-921f-195c9e2bca0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95a456c55ef41259d870aa12f06a1a4, user_id=dd5cbb9563e6442080b5fcc2cbe9c7f2, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:12.943615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93b09b-af24-48cd-921f-195c9e2bca0a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:13.050850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1118/2247] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:34:12 2022] PUT /identity/v3/projects/a95a456c55ef41259d870aa12f06a1a4/users/dd5cbb9563e6442080b5fcc2cbe9c7f2/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:34:13.053273 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c01ca-a845-4a50-81c8-35e610d998ff None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:13.053705 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c01ca-a845-4a50-81c8-35e610d998ff None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:13.054212 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c01ca-a845-4a50-81c8-35e610d998ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:13.087420 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d54c01ca-a845-4a50-81c8-35e610d998ff None None] MFA Rules not processed for user `dd5cbb9563e6442080b5fcc2cbe9c7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:13.089715 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d54c01ca-a845-4a50-81c8-35e610d998ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:13.167028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1130/2248] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:34:13.181925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93b09b-af24-48cd-921f-195c9e2bca0a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:13.184401 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6b93b09b-af24-48cd-921f-195c9e2bca0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:13.258653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93b09b-af24-48cd-921f-195c9e2bca0a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:13.263117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b9eca-4cdd-417e-8fdc-d88eda1ec193 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:13.264188 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b9eca-4cdd-417e-8fdc-d88eda1ec193 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:13.264188 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b9eca-4cdd-417e-8fdc-d88eda1ec193 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:13.264695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b9eca-4cdd-417e-8fdc-d88eda1ec193 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:13.278044 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b9eca-4cdd-417e-8fdc-d88eda1ec193 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:13.279526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b9eca-4cdd-417e-8fdc-d88eda1ec193 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:13.307636 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1119/2249] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:34:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:34:13.358424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c01ca-a845-4a50-81c8-35e610d998ff None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:13.360706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d54c01ca-a845-4a50-81c8-35e610d998ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:13.458459 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c01ca-a845-4a50-81c8-35e610d998ff None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:13.465476 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:13.468071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdb899-d184-48e5-abd5-1b298269af67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:13.468722 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdb899-d184-48e5-abd5-1b298269af67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:13.468998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdb899-d184-48e5-abd5-1b298269af67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:13.469267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdb899-d184-48e5-abd5-1b298269af67 admin admin] PATH_INFO: `/v3/projects/46e79bf2cfeb45738a661f535f8daaae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:13.470738 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdb899-d184-48e5-abd5-1b298269af67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e79bf2cfeb45738a661f535f8daaae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:13.478410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdb899-d184-48e5-abd5-1b298269af67 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:13.669520 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ebcdb899-d184-48e5-abd5-1b298269af67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e79bf2cfeb45738a661f535f8daaae', 'request_id': 'req-ebcdb899-d184-48e5-abd5-1b298269af67'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:13.833809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ebcdb899-d184-48e5-abd5-1b298269af67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e79bf2cfeb45738a661f535f8daaae', 'request_id': 'req-ebcdb899-d184-48e5-abd5-1b298269af67'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:13.841312 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ebcdb899-d184-48e5-abd5-1b298269af67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e79bf2cfeb45738a661f535f8daaae', 'request_id': 'req-ebcdb899-d184-48e5-abd5-1b298269af67'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:13.853392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ebcdb899-d184-48e5-abd5-1b298269af67 admin admin] The token cache is being invalidate because project 46e79bf2cfeb45738a661f535f8daaae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:34:13.853678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ebcdb899-d184-48e5-abd5-1b298269af67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:13.854576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ebcdb899-d184-48e5-abd5-1b298269af67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:13.860002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1131/2250] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:34:13 2022] DELETE /identity/v3/projects/46e79bf2cfeb45738a661f535f8daaae => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:13.862910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52658789-ae95-4ec6-8cd7-ea0d43ba04d7 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:13.862910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52658789-ae95-4ec6-8cd7-ea0d43ba04d7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:13.865055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52658789-ae95-4ec6-8cd7-ea0d43ba04d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:13.885412 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-52658789-ae95-4ec6-8cd7-ea0d43ba04d7 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:13.886773 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-52658789-ae95-4ec6-8cd7-ea0d43ba04d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:13.949164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1120/2251] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:14.018377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e686a-599d-461f-ba13-bc60331520c5 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:14.018711 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e686a-599d-461f-ba13-bc60331520c5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:14.018993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e686a-599d-461f-ba13-bc60331520c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:14.040615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-719e686a-599d-461f-ba13-bc60331520c5 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:14.041846 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-719e686a-599d-461f-ba13-bc60331520c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:14.050588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1132/2252] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:14.054954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52658789-ae95-4ec6-8cd7-ea0d43ba04d7 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:14.064676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52658789-ae95-4ec6-8cd7-ea0d43ba04d7 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:14.070226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa53ac-cf80-4303-85bc-8395c0e3ce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:14.070883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa53ac-cf80-4303-85bc-8395c0e3ce9b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:14.071163 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa53ac-cf80-4303-85bc-8395c0e3ce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:14.071475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa53ac-cf80-4303-85bc-8395c0e3ce9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:14.072342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa53ac-cf80-4303-85bc-8395c0e3ce9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:34:14.072670 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa53ac-cf80-4303-85bc-8395c0e3ce9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:14.074468 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa53ac-cf80-4303-85bc-8395c0e3ce9b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:14.086481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1121/2253] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:34:14.090847 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e686a-599d-461f-ba13-bc60331520c5 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:14.100514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e686a-599d-461f-ba13-bc60331520c5 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:14.105286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e86fe-72f2-49e9-a20d-7b2b22b912ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:14.106074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e86fe-72f2-49e9-a20d-7b2b22b912ed admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:14.106352 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e86fe-72f2-49e9-a20d-7b2b22b912ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:14.106627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e86fe-72f2-49e9-a20d-7b2b22b912ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:14.107266 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e86fe-72f2-49e9-a20d-7b2b22b912ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:14.109205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e86fe-72f2-49e9-a20d-7b2b22b912ed admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:14.235650 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1133/2254] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:34:14 2022] POST /identity/v3/projects => generated 389 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:34:14.236196 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa53ac-cf80-4303-85bc-8395c0e3ce9b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:14.274335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa53ac-cf80-4303-85bc-8395c0e3ce9b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:14.360810 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23624-1d89-4d52-b137-e33e1d2c9d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:14.363805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23624-1d89-4d52-b137-e33e1d2c9d9d admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:14.364155 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23624-1d89-4d52-b137-e33e1d2c9d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:14.364441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa23624-1d89-4d52-b137-e33e1d2c9d9d admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:14.365513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa23624-1d89-4d52-b137-e33e1d2c9d9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:14.374247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa23624-1d89-4d52-b137-e33e1d2c9d9d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:14.501722 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e86fe-72f2-49e9-a20d-7b2b22b912ed admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:14.509030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1122/2255] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:34:14 2022] POST /identity/v3/users => generated 295 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:34:14.512908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e86fe-72f2-49e9-a20d-7b2b22b912ed admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:14.518942 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496e345-568c-4ffb-8f70-86119e065cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:14.519655 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496e345-568c-4ffb-8f70-86119e065cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:14.519991 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496e345-568c-4ffb-8f70-86119e065cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:14.530557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496e345-568c-4ffb-8f70-86119e065cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:14.530557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496e345-568c-4ffb-8f70-86119e065cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:14.530557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496e345-568c-4ffb-8f70-86119e065cc9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:14.539774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23624-1d89-4d52-b137-e33e1d2c9d9d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:14.546089 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1134/2256] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:34:14.550815 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa23624-1d89-4d52-b137-e33e1d2c9d9d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:14.560325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cac2d0-d935-4105-97c1-1296502d3ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:14.567394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cac2d0-d935-4105-97c1-1296502d3ddf admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:14.567394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cac2d0-d935-4105-97c1-1296502d3ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:14.567394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cac2d0-d935-4105-97c1-1296502d3ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:14.567394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cac2d0-d935-4105-97c1-1296502d3ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:14.567394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cac2d0-d935-4105-97c1-1296502d3ddf admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:14.579645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1123/2257] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:34:14.582856 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496e345-568c-4ffb-8f70-86119e065cc9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:14.607401 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496e345-568c-4ffb-8f70-86119e065cc9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:14.611579 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5d6b1-539e-4c1d-94b6-b81f4b2cc54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:14.612442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5d6b1-539e-4c1d-94b6-b81f4b2cc54e admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:14.613318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5d6b1-539e-4c1d-94b6-b81f4b2cc54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:14.613678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5d6b1-539e-4c1d-94b6-b81f4b2cc54e admin admin] PATH_INFO: `/v3/projects/96870263b2fa4ef1910ce7fd6eb23e58/users/c6fb75853895484493a22fe6609f68ac/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:14.633499 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5d6b1-539e-4c1d-94b6-b81f4b2cc54e admin admin] RBAC: Authorizing `identity:create_grant(project_id=96870263b2fa4ef1910ce7fd6eb23e58, user_id=c6fb75853895484493a22fe6609f68ac, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:14.636494 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5d6b1-539e-4c1d-94b6-b81f4b2cc54e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:14.793662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1135/2258] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:34:14 2022] PUT /identity/v3/projects/96870263b2fa4ef1910ce7fd6eb23e58/users/c6fb75853895484493a22fe6609f68ac/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:14.810617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0fd54-7774-4f5a-bd5b-d2af922b0026 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:14.811009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0fd54-7774-4f5a-bd5b-d2af922b0026 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:14.811349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0fd54-7774-4f5a-bd5b-d2af922b0026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:14.848462 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1ee0fd54-7774-4f5a-bd5b-d2af922b0026 None None] MFA Rules not processed for user `c6fb75853895484493a22fe6609f68ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:14.855338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1ee0fd54-7774-4f5a-bd5b-d2af922b0026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:14.920156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1124/2259] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:14.931716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5d6b1-539e-4c1d-94b6-b81f4b2cc54e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:14.933486 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3ae5d6b1-539e-4c1d-94b6-b81f4b2cc54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:14.999196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5d6b1-539e-4c1d-94b6-b81f4b2cc54e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:15.007059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3fe3d-8910-4f5a-92f3-dca316880dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:15.007980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3fe3d-8910-4f5a-92f3-dca316880dcb service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:15.008259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3fe3d-8910-4f5a-92f3-dca316880dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:15.008605 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3fe3d-8910-4f5a-92f3-dca316880dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:15.018240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3fe3d-8910-4f5a-92f3-dca316880dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:15.019866 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3fe3d-8910-4f5a-92f3-dca316880dcb service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:15.030108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1136/2260] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:34:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:34:15.703105 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:16.223422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5de6d-8f17-4311-80ef-69c73c782049 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:16.223893 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5de6d-8f17-4311-80ef-69c73c782049 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:16.224101 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5de6d-8f17-4311-80ef-69c73c782049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:16.244300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-14d5de6d-8f17-4311-80ef-69c73c782049 None None] MFA Rules not processed for user `b84dc5da6ae0443f92daf141837057d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:16.245494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-14d5de6d-8f17-4311-80ef-69c73c782049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:16.310851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1125/2261] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:17.342014 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:20.810678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:21.719295 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:23.323842 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:23.437900 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3fe3d-8910-4f5a-92f3-dca316880dcb service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:23.439326 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7dd3fe3d-8910-4f5a-92f3-dca316880dcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:23.511147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3fe3d-8910-4f5a-92f3-dca316880dcb service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:23.515926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b54c02-4ba9-4752-9e38-c605f51dabff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:23.516502 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b54c02-4ba9-4752-9e38-c605f51dabff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:23.516809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b54c02-4ba9-4752-9e38-c605f51dabff admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:23.517076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b54c02-4ba9-4752-9e38-c605f51dabff admin admin] PATH_INFO: `/v3/users/dd5cbb9563e6442080b5fcc2cbe9c7f2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:23.518184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b54c02-4ba9-4752-9e38-c605f51dabff admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd5cbb9563e6442080b5fcc2cbe9c7f2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:23.520129 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b54c02-4ba9-4752-9e38-c605f51dabff admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:23.813528 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e5b54c02-4ba9-4752-9e38-c605f51dabff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd5cbb9563e6442080b5fcc2cbe9c7f2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:23.828149 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e5b54c02-4ba9-4752-9e38-c605f51dabff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd5cbb9563e6442080b5fcc2cbe9c7f2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:23.837333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e5b54c02-4ba9-4752-9e38-c605f51dabff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd5cbb9563e6442080b5fcc2cbe9c7f2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:23.838608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e5b54c02-4ba9-4752-9e38-c605f51dabff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd5cbb9563e6442080b5fcc2cbe9c7f2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:23.935986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e5b54c02-4ba9-4752-9e38-c605f51dabff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd5cbb9563e6442080b5fcc2cbe9c7f2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:23.957959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1137/2262] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:34:23 2022] DELETE /identity/v3/users/dd5cbb9563e6442080b5fcc2cbe9c7f2 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:23.959941 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf263e62-6716-4b6e-8b96-86d1641c49b3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:23.960329 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf263e62-6716-4b6e-8b96-86d1641c49b3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:23.960703 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf263e62-6716-4b6e-8b96-86d1641c49b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:23.964313 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:23.984210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-cf263e62-6716-4b6e-8b96-86d1641c49b3 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:23.985484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cf263e62-6716-4b6e-8b96-86d1641c49b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:24.044339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1126/2263] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:24.054154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b54c02-4ba9-4752-9e38-c605f51dabff admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:24.055621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e5b54c02-4ba9-4752-9e38-c605f51dabff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:24.121857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b54c02-4ba9-4752-9e38-c605f51dabff admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:24.125788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ab0f6-5b2b-48a4-a0f4-6fcb9e4bbc82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:24.126399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ab0f6-5b2b-48a4-a0f4-6fcb9e4bbc82 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:24.126674 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ab0f6-5b2b-48a4-a0f4-6fcb9e4bbc82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:24.126943 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ab0f6-5b2b-48a4-a0f4-6fcb9e4bbc82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:24.136778 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ab0f6-5b2b-48a4-a0f4-6fcb9e4bbc82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:24.138287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ab0f6-5b2b-48a4-a0f4-6fcb9e4bbc82 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:24.148860 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1138/2264] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:34:24.891454 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf263e62-6716-4b6e-8b96-86d1641c49b3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:24.895761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cf263e62-6716-4b6e-8b96-86d1641c49b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:24.905434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf263e62-6716-4b6e-8b96-86d1641c49b3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:24.912022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5e16f-3c43-44b6-a01b-3a5747dce3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:24.912908 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5e16f-3c43-44b6-a01b-3a5747dce3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:24.913427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5e16f-3c43-44b6-a01b-3a5747dce3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:24.913829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5e16f-3c43-44b6-a01b-3a5747dce3be admin admin] PATH_INFO: `/v3/projects/a95a456c55ef41259d870aa12f06a1a4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:24.915137 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5e16f-3c43-44b6-a01b-3a5747dce3be admin admin] RBAC: Authorizing `identity:delete_project(project_id=a95a456c55ef41259d870aa12f06a1a4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:24.917149 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5e16f-3c43-44b6-a01b-3a5747dce3be admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:25.037231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41d5e16f-3c43-44b6-a01b-3a5747dce3be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a95a456c55ef41259d870aa12f06a1a4', 'request_id': 'req-41d5e16f-3c43-44b6-a01b-3a5747dce3be'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:25.169592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41d5e16f-3c43-44b6-a01b-3a5747dce3be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a95a456c55ef41259d870aa12f06a1a4', 'request_id': 'req-41d5e16f-3c43-44b6-a01b-3a5747dce3be'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:25.178718 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41d5e16f-3c43-44b6-a01b-3a5747dce3be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a95a456c55ef41259d870aa12f06a1a4', 'request_id': 'req-41d5e16f-3c43-44b6-a01b-3a5747dce3be'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:25.194625 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41d5e16f-3c43-44b6-a01b-3a5747dce3be admin admin] The token cache is being invalidate because project a95a456c55ef41259d870aa12f06a1a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:34:25.195223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41d5e16f-3c43-44b6-a01b-3a5747dce3be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:25.196056 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41d5e16f-3c43-44b6-a01b-3a5747dce3be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:25.203670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9a905-12f9-4a4a-af3e-76ff06d5c91d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:25.204540 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9a905-12f9-4a4a-af3e-76ff06d5c91d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:25.204960 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9a905-12f9-4a4a-af3e-76ff06d5c91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:25.208856 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1127/2265] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:34:24 2022] DELETE /identity/v3/projects/a95a456c55ef41259d870aa12f06a1a4 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:25.226366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0aa9a905-12f9-4a4a-af3e-76ff06d5c91d None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:25.229547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0aa9a905-12f9-4a4a-af3e-76ff06d5c91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:25.310646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1139/2266] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:25.321469 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d083b-4acc-4e02-b5c3-2b38240b85d8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:25.321774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d083b-4acc-4e02-b5c3-2b38240b85d8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:25.322042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d083b-4acc-4e02-b5c3-2b38240b85d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:25.347893 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5f7d083b-4acc-4e02-b5c3-2b38240b85d8 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:25.349264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5f7d083b-4acc-4e02-b5c3-2b38240b85d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:25.360444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1128/2267] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:34:25.365349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9a905-12f9-4a4a-af3e-76ff06d5c91d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:25.375522 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9a905-12f9-4a4a-af3e-76ff06d5c91d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:25.381776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501693fc-81be-4559-9542-7c5030b8723a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:25.382395 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501693fc-81be-4559-9542-7c5030b8723a admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:25.382777 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501693fc-81be-4559-9542-7c5030b8723a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:25.383261 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501693fc-81be-4559-9542-7c5030b8723a admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:25.384108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501693fc-81be-4559-9542-7c5030b8723a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:34:25.384666 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501693fc-81be-4559-9542-7c5030b8723a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:25.386873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501693fc-81be-4559-9542-7c5030b8723a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:25.400397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1140/2268] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:34:25.405187 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d083b-4acc-4e02-b5c3-2b38240b85d8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:25.415116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d083b-4acc-4e02-b5c3-2b38240b85d8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:25.427467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d23153-6b53-4587-a21a-9cd466f69a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:25.429307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d23153-6b53-4587-a21a-9cd466f69a8a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:25.429955 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d23153-6b53-4587-a21a-9cd466f69a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:25.429955 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d23153-6b53-4587-a21a-9cd466f69a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:25.430625 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d23153-6b53-4587-a21a-9cd466f69a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:25.432791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d23153-6b53-4587-a21a-9cd466f69a8a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:25.618446 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1129/2269] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:34:25 2022] POST /identity/v3/projects => generated 375 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:34:25.623987 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501693fc-81be-4559-9542-7c5030b8723a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:25.642366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501693fc-81be-4559-9542-7c5030b8723a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:25.714598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c03a1-bfe3-4fa4-b6fb-cb8c793bbc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:25.726805 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c03a1-bfe3-4fa4-b6fb-cb8c793bbc10 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:25.727163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c03a1-bfe3-4fa4-b6fb-cb8c793bbc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:25.727442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c03a1-bfe3-4fa4-b6fb-cb8c793bbc10 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:25.728401 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c03a1-bfe3-4fa4-b6fb-cb8c793bbc10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:25.730327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c03a1-bfe3-4fa4-b6fb-cb8c793bbc10 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:25.837488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1141/2270] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:34:25 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:34:25.850558 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d23153-6b53-4587-a21a-9cd466f69a8a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:25.878552 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d23153-6b53-4587-a21a-9cd466f69a8a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:25.897805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b97614-7078-453f-ad64-5bef96f1264f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:25.899244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b97614-7078-453f-ad64-5bef96f1264f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:25.899733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b97614-7078-453f-ad64-5bef96f1264f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:25.900868 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b97614-7078-453f-ad64-5bef96f1264f admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:25.901842 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b97614-7078-453f-ad64-5bef96f1264f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:25.904252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b97614-7078-453f-ad64-5bef96f1264f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:25.930979 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c03a1-bfe3-4fa4-b6fb-cb8c793bbc10 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:25.931558 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1130/2271] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:34:25.941101 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c03a1-bfe3-4fa4-b6fb-cb8c793bbc10 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:25.946656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5685811-6018-4a89-b1da-ff81eedf13ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:25.947487 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5685811-6018-4a89-b1da-ff81eedf13ba admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:25.947779 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5685811-6018-4a89-b1da-ff81eedf13ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:25.948117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5685811-6018-4a89-b1da-ff81eedf13ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:25.948835 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5685811-6018-4a89-b1da-ff81eedf13ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:25.950676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5685811-6018-4a89-b1da-ff81eedf13ba admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:25.968595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1142/2272] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:34:25.970807 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b97614-7078-453f-ad64-5bef96f1264f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:25.987000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b97614-7078-453f-ad64-5bef96f1264f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:25.994758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f33c32-8381-4df6-b1dd-f753b50bf67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:25.995619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f33c32-8381-4df6-b1dd-f753b50bf67e admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:25.996047 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f33c32-8381-4df6-b1dd-f753b50bf67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:25.996471 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f33c32-8381-4df6-b1dd-f753b50bf67e admin admin] PATH_INFO: `/v3/projects/4bdb001826404854b22a8a2d2e4ac3e1/users/886acf3572324212a4dde7432969fab9/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:26.032282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f33c32-8381-4df6-b1dd-f753b50bf67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bdb001826404854b22a8a2d2e4ac3e1, user_id=886acf3572324212a4dde7432969fab9, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:26.035698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f33c32-8381-4df6-b1dd-f753b50bf67e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:26.213798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1131/2273] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:34:25 2022] PUT /identity/v3/projects/4bdb001826404854b22a8a2d2e4ac3e1/users/886acf3572324212a4dde7432969fab9/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:26.225165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b17ef3-c233-42a7-a1bb-805b482a3dea None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:26.225818 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b17ef3-c233-42a7-a1bb-805b482a3dea None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:26.225938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b17ef3-c233-42a7-a1bb-805b482a3dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:26.267723 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-48b17ef3-c233-42a7-a1bb-805b482a3dea None None] MFA Rules not processed for user `886acf3572324212a4dde7432969fab9`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:26.269669 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-48b17ef3-c233-42a7-a1bb-805b482a3dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:26.290373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:26.427293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:26.427293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1143/2274] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:26.428660 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f33c32-8381-4df6-b1dd-f753b50bf67e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:26.542503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f33c32-8381-4df6-b1dd-f753b50bf67e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:26.565082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d1030-c145-4f76-87ba-23802fc0e421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:26.565709 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d1030-c145-4f76-87ba-23802fc0e421 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:26.566011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d1030-c145-4f76-87ba-23802fc0e421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:26.566276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d1030-c145-4f76-87ba-23802fc0e421 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:26.567073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d1030-c145-4f76-87ba-23802fc0e421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:26.569164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d1030-c145-4f76-87ba-23802fc0e421 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:26.674681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1132/2275] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:34:26 2022] POST /identity/v3/projects => generated 375 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:34:26.679389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b17ef3-c233-42a7-a1bb-805b482a3dea None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:26.702645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b17ef3-c233-42a7-a1bb-805b482a3dea None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:26.815912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb1e53-921e-4946-8daf-26dc454b1e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:26.816639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb1e53-921e-4946-8daf-26dc454b1e00 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:26.816976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb1e53-921e-4946-8daf-26dc454b1e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:26.817333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb1e53-921e-4946-8daf-26dc454b1e00 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:26.818090 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb1e53-921e-4946-8daf-26dc454b1e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:26.828269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb1e53-921e-4946-8daf-26dc454b1e00 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:26.979286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1144/2276] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:34:26 2022] POST /identity/v3/users => generated 294 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:34:26.985476 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d1030-c145-4f76-87ba-23802fc0e421 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:27.004502 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d1030-c145-4f76-87ba-23802fc0e421 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:27.010085 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cac0e-2b61-4e68-a102-0c50be76242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:27.010751 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cac0e-2b61-4e68-a102-0c50be76242c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:27.011033 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cac0e-2b61-4e68-a102-0c50be76242c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:27.011304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cac0e-2b61-4e68-a102-0c50be76242c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:27.022789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cac0e-2b61-4e68-a102-0c50be76242c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:27.024480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cac0e-2b61-4e68-a102-0c50be76242c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:27.038982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1133/2277] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:34:27.043551 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb1e53-921e-4946-8daf-26dc454b1e00 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:27.054601 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb1e53-921e-4946-8daf-26dc454b1e00 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:27.060980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a447218-95c3-4fff-80ef-c57db72f6783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:27.061674 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a447218-95c3-4fff-80ef-c57db72f6783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:27.062002 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a447218-95c3-4fff-80ef-c57db72f6783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:27.062279 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a447218-95c3-4fff-80ef-c57db72f6783 admin admin] PATH_INFO: `/v3/projects/28424693fa4242e0ba944a26baa0e8a9/users/8ad4d20ccead435f8de878e27a8b4512/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:27.079898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a447218-95c3-4fff-80ef-c57db72f6783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28424693fa4242e0ba944a26baa0e8a9, user_id=8ad4d20ccead435f8de878e27a8b4512, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:27.083222 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a447218-95c3-4fff-80ef-c57db72f6783 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:27.223432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1145/2278] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:34:27 2022] PUT /identity/v3/projects/28424693fa4242e0ba944a26baa0e8a9/users/8ad4d20ccead435f8de878e27a8b4512/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:27.227559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cac0e-2b61-4e68-a102-0c50be76242c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:27.238390 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cac0e-2b61-4e68-a102-0c50be76242c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:27.323141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfac413-6fa2-4463-b4b2-7d820af12571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:27.323765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfac413-6fa2-4463-b4b2-7d820af12571 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:27.324047 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfac413-6fa2-4463-b4b2-7d820af12571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:27.324323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfac413-6fa2-4463-b4b2-7d820af12571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:27.325422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfac413-6fa2-4463-b4b2-7d820af12571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:27.327074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfac413-6fa2-4463-b4b2-7d820af12571 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:27.338334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1134/2279] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:34:27.342625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a447218-95c3-4fff-80ef-c57db72f6783 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:27.356255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a447218-95c3-4fff-80ef-c57db72f6783 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:27.361225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b934055-22a9-457a-a294-ece10ecce69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:27.361919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b934055-22a9-457a-a294-ece10ecce69a admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:27.362332 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b934055-22a9-457a-a294-ece10ecce69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:27.365571 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b934055-22a9-457a-a294-ece10ecce69a admin admin] PATH_INFO: `/v3/projects/28424693fa4242e0ba944a26baa0e8a9/users/8ad4d20ccead435f8de878e27a8b4512/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:27.368528 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b934055-22a9-457a-a294-ece10ecce69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=28424693fa4242e0ba944a26baa0e8a9, user_id=8ad4d20ccead435f8de878e27a8b4512, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:27.371316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b934055-22a9-457a-a294-ece10ecce69a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:27.382955 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1146/2280] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:34:27 2022] PUT /identity/v3/projects/28424693fa4242e0ba944a26baa0e8a9/users/8ad4d20ccead435f8de878e27a8b4512/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:27.398480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cbdbd-3ef0-45eb-a08f-63e1f88b71d5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:27.398784 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cbdbd-3ef0-45eb-a08f-63e1f88b71d5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:27.399061 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cbdbd-3ef0-45eb-a08f-63e1f88b71d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:27.437895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a30cbdbd-3ef0-45eb-a08f-63e1f88b71d5 None None] MFA Rules not processed for user `8ad4d20ccead435f8de878e27a8b4512`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:27.439380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a30cbdbd-3ef0-45eb-a08f-63e1f88b71d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:27.539701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1135/2281] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:27.552977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b934055-22a9-457a-a294-ece10ecce69a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:27.559407 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1b934055-22a9-457a-a294-ece10ecce69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:27.618450 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b934055-22a9-457a-a294-ece10ecce69a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:27.622619 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a671f-79b3-4a28-86cd-916970569d44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:27.623235 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a671f-79b3-4a28-86cd-916970569d44 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:27.623510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a671f-79b3-4a28-86cd-916970569d44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:27.623930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a671f-79b3-4a28-86cd-916970569d44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:27.682211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a671f-79b3-4a28-86cd-916970569d44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:27.683591 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a671f-79b3-4a28-86cd-916970569d44 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:27.693038 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1147/2282] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:34:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:34:27.741245 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:28.148176 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:29.615442 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:30.112751 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:31.792821 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:31.873116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cbdbd-3ef0-45eb-a08f-63e1f88b71d5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:31.874554 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a30cbdbd-3ef0-45eb-a08f-63e1f88b71d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:31.906862 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a671f-79b3-4a28-86cd-916970569d44 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:31.949786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cbdbd-3ef0-45eb-a08f-63e1f88b71d5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:31.954701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310f38c-4290-4249-9e00-a86c9bf2af1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:31.955356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310f38c-4290-4249-9e00-a86c9bf2af1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:31.955638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310f38c-4290-4249-9e00-a86c9bf2af1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:31.955910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310f38c-4290-4249-9e00-a86c9bf2af1d admin admin] PATH_INFO: `/v3/users/c6fb75853895484493a22fe6609f68ac` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:31.957308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310f38c-4290-4249-9e00-a86c9bf2af1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6fb75853895484493a22fe6609f68ac)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:31.959253 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310f38c-4290-4249-9e00-a86c9bf2af1d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:31.974377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a671f-79b3-4a28-86cd-916970569d44 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:31.980456 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3052c4e-f010-4df3-a6b8-4754742fe1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:31.980456 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3052c4e-f010-4df3-a6b8-4754742fe1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:31.980456 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3052c4e-f010-4df3-a6b8-4754742fe1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:31.980456 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3052c4e-f010-4df3-a6b8-4754742fe1f2 admin admin] PATH_INFO: `/v3/users/886acf3572324212a4dde7432969fab9` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:31.982100 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3052c4e-f010-4df3-a6b8-4754742fe1f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=886acf3572324212a4dde7432969fab9)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:31.984194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3052c4e-f010-4df3-a6b8-4754742fe1f2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:32.176564 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:32.243403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b310f38c-4290-4249-9e00-a86c9bf2af1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6fb75853895484493a22fe6609f68ac'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:32.256045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b310f38c-4290-4249-9e00-a86c9bf2af1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6fb75853895484493a22fe6609f68ac'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:32.263673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b310f38c-4290-4249-9e00-a86c9bf2af1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6fb75853895484493a22fe6609f68ac'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:32.264421 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b310f38c-4290-4249-9e00-a86c9bf2af1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6fb75853895484493a22fe6609f68ac'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:32.333784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a3052c4e-f010-4df3-a6b8-4754742fe1f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '886acf3572324212a4dde7432969fab9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:32.346040 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a3052c4e-f010-4df3-a6b8-4754742fe1f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '886acf3572324212a4dde7432969fab9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:32.353680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a3052c4e-f010-4df3-a6b8-4754742fe1f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '886acf3572324212a4dde7432969fab9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:32.354513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a3052c4e-f010-4df3-a6b8-4754742fe1f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '886acf3572324212a4dde7432969fab9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:32.370343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b310f38c-4290-4249-9e00-a86c9bf2af1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6fb75853895484493a22fe6609f68ac'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:32.379816 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1136/2283] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:34:31 2022] DELETE /identity/v3/users/c6fb75853895484493a22fe6609f68ac => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:32.384290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea8591-dc18-4eef-84db-bd90b5513ef5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:32.384822 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea8591-dc18-4eef-84db-bd90b5513ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:32.385249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea8591-dc18-4eef-84db-bd90b5513ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:32.454170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-33ea8591-dc18-4eef-84db-bd90b5513ef5 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:32.455424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-33ea8591-dc18-4eef-84db-bd90b5513ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:32.483755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a3052c4e-f010-4df3-a6b8-4754742fe1f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '886acf3572324212a4dde7432969fab9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:32.490559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1148/2284] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:34:31 2022] DELETE /identity/v3/users/886acf3572324212a4dde7432969fab9 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:32.495334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc4a75-b1aa-4ab0-9443-893a248e93e9 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:32.495683 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc4a75-b1aa-4ab0-9443-893a248e93e9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:32.496021 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc4a75-b1aa-4ab0-9443-893a248e93e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:32.527074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cfbc4a75-b1aa-4ab0-9443-893a248e93e9 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:32.530904 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cfbc4a75-b1aa-4ab0-9443-893a248e93e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:32.581767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1137/2285] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:34:32.601686 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea8591-dc18-4eef-84db-bd90b5513ef5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:32.601686 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-33ea8591-dc18-4eef-84db-bd90b5513ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:32.620535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1149/2286] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:34:32.633716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc4a75-b1aa-4ab0-9443-893a248e93e9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:32.636349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cfbc4a75-b1aa-4ab0-9443-893a248e93e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:32.728298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea8591-dc18-4eef-84db-bd90b5513ef5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:32.730269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d719ca-f46c-4492-a183-2d193e0c6632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:32.730993 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d719ca-f46c-4492-a183-2d193e0c6632 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:32.731398 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d719ca-f46c-4492-a183-2d193e0c6632 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:32.732666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d719ca-f46c-4492-a183-2d193e0c6632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:32.737585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc4a75-b1aa-4ab0-9443-893a248e93e9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:32.743129 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcd229-18cb-4783-832b-c47d4c35ba8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:32.744526 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcd229-18cb-4783-832b-c47d4c35ba8f service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:32.746253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcd229-18cb-4783-832b-c47d4c35ba8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:32.746859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcd229-18cb-4783-832b-c47d4c35ba8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:32.747560 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d719ca-f46c-4492-a183-2d193e0c6632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:32.749429 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d719ca-f46c-4492-a183-2d193e0c6632 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:32.761179 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcd229-18cb-4783-832b-c47d4c35ba8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:32.763708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcd229-18cb-4783-832b-c47d4c35ba8f service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:32.789874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1150/2287] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:34:32.790210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1138/2288] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:34:33.448792 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcd229-18cb-4783-832b-c47d4c35ba8f service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:33.449266 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-63fcd229-18cb-4783-832b-c47d4c35ba8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:33.459711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d719ca-f46c-4492-a183-2d193e0c6632 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:33.461795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-95d719ca-f46c-4492-a183-2d193e0c6632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:33.475393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcd229-18cb-4783-832b-c47d4c35ba8f service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:33.483482 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddeed2-49e3-4d22-8028-d312d7125630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:33.484589 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddeed2-49e3-4d22-8028-d312d7125630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:33.485137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddeed2-49e3-4d22-8028-d312d7125630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:33.485703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddeed2-49e3-4d22-8028-d312d7125630 admin admin] PATH_INFO: `/v3/projects/4bdb001826404854b22a8a2d2e4ac3e1` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:33.488003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddeed2-49e3-4d22-8028-d312d7125630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bdb001826404854b22a8a2d2e4ac3e1)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:33.491069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddeed2-49e3-4d22-8028-d312d7125630 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:33.526764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d719ca-f46c-4492-a183-2d193e0c6632 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:33.551842 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011ce36-2410-4b36-b865-ea4f6703cb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:33.552800 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011ce36-2410-4b36-b865-ea4f6703cb24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:33.553297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011ce36-2410-4b36-b865-ea4f6703cb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:33.553792 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011ce36-2410-4b36-b865-ea4f6703cb24 admin admin] PATH_INFO: `/v3/projects/96870263b2fa4ef1910ce7fd6eb23e58` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:33.555388 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011ce36-2410-4b36-b865-ea4f6703cb24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96870263b2fa4ef1910ce7fd6eb23e58)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:33.558182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011ce36-2410-4b36-b865-ea4f6703cb24 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:33.742351 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8bddeed2-49e3-4d22-8028-d312d7125630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bdb001826404854b22a8a2d2e4ac3e1', 'request_id': 'req-8bddeed2-49e3-4d22-8028-d312d7125630'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:33.764755 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1011ce36-2410-4b36-b865-ea4f6703cb24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96870263b2fa4ef1910ce7fd6eb23e58', 'request_id': 'req-1011ce36-2410-4b36-b865-ea4f6703cb24'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:33.879342 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8bddeed2-49e3-4d22-8028-d312d7125630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bdb001826404854b22a8a2d2e4ac3e1', 'request_id': 'req-8bddeed2-49e3-4d22-8028-d312d7125630'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:33.887180 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8bddeed2-49e3-4d22-8028-d312d7125630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bdb001826404854b22a8a2d2e4ac3e1', 'request_id': 'req-8bddeed2-49e3-4d22-8028-d312d7125630'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:33.899289 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8bddeed2-49e3-4d22-8028-d312d7125630 admin admin] The token cache is being invalidate because project 4bdb001826404854b22a8a2d2e4ac3e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:34:33.899735 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8bddeed2-49e3-4d22-8028-d312d7125630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:33.900520 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8bddeed2-49e3-4d22-8028-d312d7125630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:33.905431 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1151/2289] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:34:33 2022] DELETE /identity/v3/projects/4bdb001826404854b22a8a2d2e4ac3e1 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:33.906559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddeed2-49e3-4d22-8028-d312d7125630 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:33.908180 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8bddeed2-49e3-4d22-8028-d312d7125630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:33.918188 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1011ce36-2410-4b36-b865-ea4f6703cb24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96870263b2fa4ef1910ce7fd6eb23e58', 'request_id': 'req-1011ce36-2410-4b36-b865-ea4f6703cb24'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:33.924462 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1011ce36-2410-4b36-b865-ea4f6703cb24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96870263b2fa4ef1910ce7fd6eb23e58', 'request_id': 'req-1011ce36-2410-4b36-b865-ea4f6703cb24'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:33.947879 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1011ce36-2410-4b36-b865-ea4f6703cb24 admin admin] The token cache is being invalidate because project 96870263b2fa4ef1910ce7fd6eb23e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:34:33.948621 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1011ce36-2410-4b36-b865-ea4f6703cb24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:33.949695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1011ce36-2410-4b36-b865-ea4f6703cb24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:33.953775 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1139/2290] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:34:33 2022] DELETE /identity/v3/projects/96870263b2fa4ef1910ce7fd6eb23e58 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:34.004835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:34.007421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddeed2-49e3-4d22-8028-d312d7125630 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:34.091513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3724a-d20d-4335-97c5-d9dca78bebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:34.091513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3724a-d20d-4335-97c5-d9dca78bebd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:34.091513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3724a-d20d-4335-97c5-d9dca78bebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:34.091513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3724a-d20d-4335-97c5-d9dca78bebd3 admin admin] PATH_INFO: `/v3/users/8ad4d20ccead435f8de878e27a8b4512` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:34.094498 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3724a-d20d-4335-97c5-d9dca78bebd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ad4d20ccead435f8de878e27a8b4512)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:34.096933 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3724a-d20d-4335-97c5-d9dca78bebd3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:34.324581 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-eee3724a-d20d-4335-97c5-d9dca78bebd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ad4d20ccead435f8de878e27a8b4512'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:34.335487 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-eee3724a-d20d-4335-97c5-d9dca78bebd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ad4d20ccead435f8de878e27a8b4512'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:34.342827 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-eee3724a-d20d-4335-97c5-d9dca78bebd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ad4d20ccead435f8de878e27a8b4512'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:34.343644 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-eee3724a-d20d-4335-97c5-d9dca78bebd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ad4d20ccead435f8de878e27a8b4512'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:34.386897 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:34.414726 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-eee3724a-d20d-4335-97c5-d9dca78bebd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ad4d20ccead435f8de878e27a8b4512'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:34.421202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1152/2291] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:34:33 2022] DELETE /identity/v3/users/8ad4d20ccead435f8de878e27a8b4512 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:35.091536 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011ce36-2410-4b36-b865-ea4f6703cb24 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:35.094138 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1011ce36-2410-4b36-b865-ea4f6703cb24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:35.123951 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011ce36-2410-4b36-b865-ea4f6703cb24 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:35.199147 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df9ee4-bf92-4c13-9400-2bb37190b2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:35.199791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df9ee4-bf92-4c13-9400-2bb37190b2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:35.200072 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df9ee4-bf92-4c13-9400-2bb37190b2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:35.200342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df9ee4-bf92-4c13-9400-2bb37190b2f2 admin admin] PATH_INFO: `/v3/projects/28424693fa4242e0ba944a26baa0e8a9` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:35.201616 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df9ee4-bf92-4c13-9400-2bb37190b2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28424693fa4242e0ba944a26baa0e8a9)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:35.203767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df9ee4-bf92-4c13-9400-2bb37190b2f2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:35.332822 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-44df9ee4-bf92-4c13-9400-2bb37190b2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28424693fa4242e0ba944a26baa0e8a9', 'request_id': 'req-44df9ee4-bf92-4c13-9400-2bb37190b2f2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:35.403330 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-44df9ee4-bf92-4c13-9400-2bb37190b2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28424693fa4242e0ba944a26baa0e8a9', 'request_id': 'req-44df9ee4-bf92-4c13-9400-2bb37190b2f2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:35.409851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-44df9ee4-bf92-4c13-9400-2bb37190b2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28424693fa4242e0ba944a26baa0e8a9', 'request_id': 'req-44df9ee4-bf92-4c13-9400-2bb37190b2f2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:35.421693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-44df9ee4-bf92-4c13-9400-2bb37190b2f2 admin admin] The token cache is being invalidate because project 28424693fa4242e0ba944a26baa0e8a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:34:35.422020 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-44df9ee4-bf92-4c13-9400-2bb37190b2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:35.422705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-44df9ee4-bf92-4c13-9400-2bb37190b2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:34:35.424184 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1140/2292] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:34:35 2022] DELETE /identity/v3/projects/28424693fa4242e0ba944a26baa0e8a9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:34:35.438280 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:36.360067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:36.444358 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:37.211013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:37.398400 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:37.781114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:38.175224 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:38.820668 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:39.112940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:39.672368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:39.883515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:40.106070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4447cd-3609-4a75-8f5a-723ba2716938 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:40.106478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4447cd-3609-4a75-8f5a-723ba2716938 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:40.106768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4447cd-3609-4a75-8f5a-723ba2716938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:40.127315 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ac4447cd-3609-4a75-8f5a-723ba2716938 None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:40.128703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ac4447cd-3609-4a75-8f5a-723ba2716938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:40.186270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1153/2293] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Sep 23 15:34:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:40.344369 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df9ee4-bf92-4c13-9400-2bb37190b2f2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:40.347516 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-44df9ee4-bf92-4c13-9400-2bb37190b2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:40.413443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df9ee4-bf92-4c13-9400-2bb37190b2f2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:40.418820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638c74c-7b39-419a-8cff-8c7d757992ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:40.419431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638c74c-7b39-419a-8cff-8c7d757992ba service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:40.419715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638c74c-7b39-419a-8cff-8c7d757992ba service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:40.419984 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638c74c-7b39-419a-8cff-8c7d757992ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:40.428414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638c74c-7b39-419a-8cff-8c7d757992ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:40.430040 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638c74c-7b39-419a-8cff-8c7d757992ba service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:40.438092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1141/2294] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:34:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 15:34:40.586760 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:40.770223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:41.569132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:41.654886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:42.371421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:44.871885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:45.107054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:45.449979 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:45.951755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:46.484062 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:47.269053 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4447cd-3609-4a75-8f5a-723ba2716938 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:47.270599 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ac4447cd-3609-4a75-8f5a-723ba2716938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:47.333508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:47.339080 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4447cd-3609-4a75-8f5a-723ba2716938 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:47.343219 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b6b50-1264-4172-a604-1aeaba404a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:47.343869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b6b50-1264-4172-a604-1aeaba404a90 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:47.344138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b6b50-1264-4172-a604-1aeaba404a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:47.344411 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b6b50-1264-4172-a604-1aeaba404a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:47.346267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3a3b6b50-1264-4172-a604-1aeaba404a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:47.375128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:47.415944 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b6b50-1264-4172-a604-1aeaba404a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:47.417505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b6b50-1264-4172-a604-1aeaba404a90 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:47.427401 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1154/2295] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:34:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:34:47.906347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:48.044018 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:48.369824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:48.700983 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:49.587460 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:49.789959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:51.137447 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61e955-8aa5-4eb3-842e-f6ddbec11dc1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:51.138501 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61e955-8aa5-4eb3-842e-f6ddbec11dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:51.138996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61e955-8aa5-4eb3-842e-f6ddbec11dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:51.166230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4c61e955-8aa5-4eb3-842e-f6ddbec11dc1 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:51.169812 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4c61e955-8aa5-4eb3-842e-f6ddbec11dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:51.244076 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1142/2296] 10.222.0.91 () {58 vars in 1016 bytes} [Fri Sep 23 15:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:51.267598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b6b50-1264-4172-a604-1aeaba404a90 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:51.270139 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3a3b6b50-1264-4172-a604-1aeaba404a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:51.394931 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b6b50-1264-4172-a604-1aeaba404a90 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:51.401308 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c2706-01cd-4e8c-807a-25e428ab2269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:51.402097 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c2706-01cd-4e8c-807a-25e428ab2269 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:51.402380 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c2706-01cd-4e8c-807a-25e428ab2269 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:51.402650 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c2706-01cd-4e8c-807a-25e428ab2269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:51.412728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c2706-01cd-4e8c-807a-25e428ab2269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:51.415365 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c2706-01cd-4e8c-807a-25e428ab2269 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:51.425659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1155/2297] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:34:51.526067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:51.803005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:52.003716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:52.060722 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:52.356789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:52.414215 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:52.814003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:52.894917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:53.231282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:53.436954 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:53.939926 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:54.134176 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:54.648547 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:55.191829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:55.482831 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:55.562481 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:56.208445 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:56.243570 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:56.734380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:56.825594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:56.882091 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aae1a-83c0-46d9-9204-9bda373be006 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:56.882377 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aae1a-83c0-46d9-9204-9bda373be006 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:56.882688 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aae1a-83c0-46d9-9204-9bda373be006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:56.902224 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6a1aae1a-83c0-46d9-9204-9bda373be006 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:34:56.903427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6a1aae1a-83c0-46d9-9204-9bda373be006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:56.911149 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1143/2298] 10.222.0.91 () {58 vars in 1016 bytes} [Fri Sep 23 15:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:34:56.933155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c2706-01cd-4e8c-807a-25e428ab2269 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:34:56.934617 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-138c2706-01cd-4e8c-807a-25e428ab2269 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:34:56.949705 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c2706-01cd-4e8c-807a-25e428ab2269 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:34:56.955656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55393106-e2d8-4cf4-b51f-fc175dd1a369 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:34:56.956239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55393106-e2d8-4cf4-b51f-fc175dd1a369 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:34:56.956515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55393106-e2d8-4cf4-b51f-fc175dd1a369 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:34:56.956786 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55393106-e2d8-4cf4-b51f-fc175dd1a369 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:34:56.964758 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55393106-e2d8-4cf4-b51f-fc175dd1a369 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:34:56.966381 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55393106-e2d8-4cf4-b51f-fc175dd1a369 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:34:56.976009 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1156/2299] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:34:57.008251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:57.088499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:57.122841 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:57.437374 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:57.528434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:57.859447 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:57.876527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:57.962231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:57.979448 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:58.088291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:58.231272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:58.390660 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:34:58.500028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:35:00.158539 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0470cd2-923d-4c6a-b63c-c5e41f23bc14 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:00.159129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0470cd2-923d-4c6a-b63c-c5e41f23bc14 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:00.159256 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0470cd2-923d-4c6a-b63c-c5e41f23bc14 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:00.161195 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1144/2300] 10.222.0.82 () {54 vars in 921 bytes} [Fri Sep 23 15:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:35:00.167382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f824c-ccfd-4878-8ecf-4db2bb6c522a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:00.167880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f824c-ccfd-4878-8ecf-4db2bb6c522a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:00.167986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f824c-ccfd-4878-8ecf-4db2bb6c522a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:00.190007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-343f824c-ccfd-4878-8ecf-4db2bb6c522a None None] MFA Rules not processed for user `6dbf682960cc447099c11862afa3206b`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:35:00.194505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-343f824c-ccfd-4878-8ecf-4db2bb6c522a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:35:00.204489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1157/2301] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Sep 23 15:35:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:35:00.217401 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0470cd2-923d-4c6a-b63c-c5e41f23bc14 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:35:00.222131 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a0470cd2-923d-4c6a-b63c-c5e41f23bc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:35:00.308230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0470cd2-923d-4c6a-b63c-c5e41f23bc14 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:35:00.312073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99c896-4b74-45b2-8c24-bc168100ae40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1879a3ad7be74303b9feceff75f62979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:35:00.312761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c896-4b74-45b2-8c24-bc168100ae40 service glance] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:00.313040 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c896-4b74-45b2-8c24-bc168100ae40 service glance] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:00.313313 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c896-4b74-45b2-8c24-bc168100ae40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:00.323660 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99c896-4b74-45b2-8c24-bc168100ae40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:35:00.325122 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99c896-4b74-45b2-8c24-bc168100ae40 service glance] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:35:00.337181 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1145/2302] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:35:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:35:00.638736 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352d735-11bf-4f55-9f54-4d9131b2d357 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:00.639098 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352d735-11bf-4f55-9f54-4d9131b2d357 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:00.639374 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352d735-11bf-4f55-9f54-4d9131b2d357 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:00.640838 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1158/2303] 10.222.0.82 () {54 vars in 921 bytes} [Fri Sep 23 15:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:35:00.646481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98107b62-f3e6-49cf-878f-9e3db1bf6b79 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:00.646851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98107b62-f3e6-49cf-878f-9e3db1bf6b79 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:00.647192 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98107b62-f3e6-49cf-878f-9e3db1bf6b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:00.667913 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-98107b62-f3e6-49cf-878f-9e3db1bf6b79 None None] MFA Rules not processed for user `defbff3e8f934dab9c800c7207c1d539`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:35:00.669140 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-98107b62-f3e6-49cf-878f-9e3db1bf6b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:35:00.676091 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1146/2304] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Sep 23 15:35:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:35:00.688161 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352d735-11bf-4f55-9f54-4d9131b2d357 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:35:00.699334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352d735-11bf-4f55-9f54-4d9131b2d357 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:35:00.702923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef2547-8e06-4688-812a-49f5bdc9a1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:35:00.703563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef2547-8e06-4688-812a-49f5bdc9a1df service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:00.703846 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef2547-8e06-4688-812a-49f5bdc9a1df service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:00.704119 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef2547-8e06-4688-812a-49f5bdc9a1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:00.711611 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef2547-8e06-4688-812a-49f5bdc9a1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:35:00.713076 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef2547-8e06-4688-812a-49f5bdc9a1df service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:35:00.720929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1159/2305] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:35:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:35:00.804601 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d21e58-5377-4168-9344-05e49119cf24 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:00.804887 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d21e58-5377-4168-9344-05e49119cf24 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:00.805163 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d21e58-5377-4168-9344-05e49119cf24 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:00.806544 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1147/2306] 10.222.0.82 () {54 vars in 921 bytes} [Fri Sep 23 15:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:35:00.812019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b57f81-5c06-4304-b212-75120a2f1496 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:00.812324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b57f81-5c06-4304-b212-75120a2f1496 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:00.812609 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b57f81-5c06-4304-b212-75120a2f1496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:00.833088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d8b57f81-5c06-4304-b212-75120a2f1496 None None] MFA Rules not processed for user `6dbf682960cc447099c11862afa3206b`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:35:00.834315 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d8b57f81-5c06-4304-b212-75120a2f1496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:35:00.843634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1160/2307] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Sep 23 15:35:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:35:00.854236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d21e58-5377-4168-9344-05e49119cf24 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:35:00.865070 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d21e58-5377-4168-9344-05e49119cf24 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:35:00.868760 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df17e1-ba55-413d-bf53-333848fd575f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:35:00.869373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df17e1-ba55-413d-bf53-333848fd575f service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:00.869653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df17e1-ba55-413d-bf53-333848fd575f service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:00.869954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df17e1-ba55-413d-bf53-333848fd575f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:00.881010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df17e1-ba55-413d-bf53-333848fd575f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:35:00.882505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df17e1-ba55-413d-bf53-333848fd575f service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:35:00.893221 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1148/2308] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:35:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:35:02.305253 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8aff8-e9fe-445b-afb4-0aabca15d648 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:02.305715 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8aff8-e9fe-445b-afb4-0aabca15d648 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:02.305857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8aff8-e9fe-445b-afb4-0aabca15d648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:02.325530 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-67b8aff8-e9fe-445b-afb4-0aabca15d648 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:35:02.326878 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-67b8aff8-e9fe-445b-afb4-0aabca15d648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:35:02.334716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1161/2309] 10.222.0.91 () {58 vars in 1016 bytes} [Fri Sep 23 15:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:35:02.362254 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df17e1-ba55-413d-bf53-333848fd575f service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:35:02.373685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df17e1-ba55-413d-bf53-333848fd575f service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:35:02.379052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69df0dd-79b0-4a83-960b-b6e1578ab9f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:35:02.379664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69df0dd-79b0-4a83-960b-b6e1578ab9f0 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:02.379942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69df0dd-79b0-4a83-960b-b6e1578ab9f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:02.380210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69df0dd-79b0-4a83-960b-b6e1578ab9f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:02.388131 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69df0dd-79b0-4a83-960b-b6e1578ab9f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:35:02.389702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69df0dd-79b0-4a83-960b-b6e1578ab9f0 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:35:02.399328 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1149/2310] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:35:06.199420 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf0530-b5a3-4a73-9188-fa5756bce833 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:06.199916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf0530-b5a3-4a73-9188-fa5756bce833 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:06.200028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf0530-b5a3-4a73-9188-fa5756bce833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:06.218924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-44cf0530-b5a3-4a73-9188-fa5756bce833 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:35:06.220152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-44cf0530-b5a3-4a73-9188-fa5756bce833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:35:06.228459 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1162/2311] 10.222.0.91 () {58 vars in 1016 bytes} [Fri Sep 23 15:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:35:06.250394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69df0dd-79b0-4a83-960b-b6e1578ab9f0 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:35:06.261215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69df0dd-79b0-4a83-960b-b6e1578ab9f0 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:35:06.266639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48f2de-4b24-43c8-9fa8-a5943ef6544b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:35:06.267219 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48f2de-4b24-43c8-9fa8-a5943ef6544b service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:06.267495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48f2de-4b24-43c8-9fa8-a5943ef6544b service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:06.267763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48f2de-4b24-43c8-9fa8-a5943ef6544b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:06.275857 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48f2de-4b24-43c8-9fa8-a5943ef6544b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:35:06.277375 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48f2de-4b24-43c8-9fa8-a5943ef6544b service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:35:06.287264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1150/2312] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:35:09.200225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19a997-cef1-47c9-a449-e7dd731536be None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:09.200679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19a997-cef1-47c9-a449-e7dd731536be None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:09.200767 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19a997-cef1-47c9-a449-e7dd731536be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:09.221406 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5b19a997-cef1-47c9-a449-e7dd731536be None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:35:09.222650 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5b19a997-cef1-47c9-a449-e7dd731536be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:35:09.230018 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1163/2313] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Sep 23 15:35:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:35:09.242931 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48f2de-4b24-43c8-9fa8-a5943ef6544b service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:35:09.254686 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48f2de-4b24-43c8-9fa8-a5943ef6544b service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:35:09.259626 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8cedb-5e97-4cb2-8e7c-9a45ad289a22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:35:09.260207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8cedb-5e97-4cb2-8e7c-9a45ad289a22 service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:09.260481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8cedb-5e97-4cb2-8e7c-9a45ad289a22 service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:09.260786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8cedb-5e97-4cb2-8e7c-9a45ad289a22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:09.268490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8cedb-5e97-4cb2-8e7c-9a45ad289a22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:35:09.271024 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8cedb-5e97-4cb2-8e7c-9a45ad289a22 service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:35:09.278702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1151/2314] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:35:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 15:35:10.474084 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4be92c-f052-463c-82fd-c4ec7429caea None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:10.474713 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4be92c-f052-463c-82fd-c4ec7429caea None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:10.474713 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4be92c-f052-463c-82fd-c4ec7429caea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:10.495729 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-eb4be92c-f052-463c-82fd-c4ec7429caea None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:35:10.496883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-eb4be92c-f052-463c-82fd-c4ec7429caea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:35:10.505464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1164/2315] 10.222.0.91 () {58 vars in 1016 bytes} [Fri Sep 23 15:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:35:10.555183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8cedb-5e97-4cb2-8e7c-9a45ad289a22 service swift] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:35:10.567260 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8cedb-5e97-4cb2-8e7c-9a45ad289a22 service swift] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:35:10.572817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1185c-bade-47cc-a07d-5349e010db7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:35:10.573408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1185c-bade-47cc-a07d-5349e010db7e service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:10.573689 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1185c-bade-47cc-a07d-5349e010db7e service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:10.573992 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1185c-bade-47cc-a07d-5349e010db7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:10.582019 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1185c-bade-47cc-a07d-5349e010db7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:35:10.583616 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1185c-bade-47cc-a07d-5349e010db7e service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:35:10.593479 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1152/2316] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:35:20.490152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=62 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:35:20.592267 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:35:29.238303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4be92c-f052-463c-82fd-c4ec7429caea None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:35:29.239854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-eb4be92c-f052-463c-82fd-c4ec7429caea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:35:29.244736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa412828-d70d-42ed-8332-4652f903baa3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:29.247985 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa412828-d70d-42ed-8332-4652f903baa3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:29.247985 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa412828-d70d-42ed-8332-4652f903baa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:29.271673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fa412828-d70d-42ed-8332-4652f903baa3 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:35:29.276833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fa412828-d70d-42ed-8332-4652f903baa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:35:29.283533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1153/2317] 10.222.0.91 () {58 vars in 1016 bytes} [Fri Sep 23 15:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:35:29.307598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa412828-d70d-42ed-8332-4652f903baa3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:35:29.323934 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa412828-d70d-42ed-8332-4652f903baa3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:35:29.324120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4be92c-f052-463c-82fd-c4ec7429caea None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:35:29.328944 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0581b73-d236-4df1-9ff4-83d892f0dd83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25109eeb1b34b3689b10e3f7c44a6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:35:29.329548 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0581b73-d236-4df1-9ff4-83d892f0dd83 service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:29.329858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0581b73-d236-4df1-9ff4-83d892f0dd83 service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:29.330133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0581b73-d236-4df1-9ff4-83d892f0dd83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:29.331852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f0581b73-d236-4df1-9ff4-83d892f0dd83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:35:29.333615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08582e96-441d-4dc6-aca6-6f1e2900ba05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:35:29.334384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582e96-441d-4dc6-aca6-6f1e2900ba05 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:29.334727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582e96-441d-4dc6-aca6-6f1e2900ba05 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:29.335065 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08582e96-441d-4dc6-aca6-6f1e2900ba05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:29.344116 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0581b73-d236-4df1-9ff4-83d892f0dd83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:35:29.344428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08582e96-441d-4dc6-aca6-6f1e2900ba05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:35:29.345790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0581b73-d236-4df1-9ff4-83d892f0dd83 service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:35:29.346519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08582e96-441d-4dc6-aca6-6f1e2900ba05 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:35:29.357399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1165/2318] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:35:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:35:29.357947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1154/2319] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:35:30.524292 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeedf3-f6ce-45b7-821b-f99751bb0ac6 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:30.525341 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeedf3-f6ce-45b7-821b-f99751bb0ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:30.525491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeedf3-f6ce-45b7-821b-f99751bb0ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:30.544537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-eebeedf3-f6ce-45b7-821b-f99751bb0ac6 None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:35:30.545752 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-eebeedf3-f6ce-45b7-821b-f99751bb0ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:35:30.553018 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1166/2320] 10.222.0.82 () {58 vars in 967 bytes} [Fri Sep 23 15:35:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:35:30.564931 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08582e96-441d-4dc6-aca6-6f1e2900ba05 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:35:30.576536 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08582e96-441d-4dc6-aca6-6f1e2900ba05 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:35:30.581385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e72033-157c-4f42-85b0-f9d22fad65ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:35:30.581996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e72033-157c-4f42-85b0-f9d22fad65ed service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:30.582273 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e72033-157c-4f42-85b0-f9d22fad65ed service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:30.582545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e72033-157c-4f42-85b0-f9d22fad65ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:30.590896 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e72033-157c-4f42-85b0-f9d22fad65ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:35:30.592452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e72033-157c-4f42-85b0-f9d22fad65ed service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:35:30.600271 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1155/2321] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:35:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 15:35:40.538937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=35 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:35:40.597154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=15 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:35:52.825064 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b126b6-ba15-4eef-ab53-e3119a74f2d6 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:52.830045 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b126b6-ba15-4eef-ab53-e3119a74f2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:52.830045 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b126b6-ba15-4eef-ab53-e3119a74f2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:52.845645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-98b126b6-ba15-4eef-ab53-e3119a74f2d6 None None] MFA Rules not processed for user `503e8319c29a465eb51941083b69d9b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:35:52.846890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-98b126b6-ba15-4eef-ab53-e3119a74f2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:35:52.901653 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1167/2322] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:35:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:35:53.057038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be010d8d-be71-4b23-ad06-bb40907c6181 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:35:53.057537 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be010d8d-be71-4b23-ad06-bb40907c6181 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:35:53.057646 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be010d8d-be71-4b23-ad06-bb40907c6181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:35:53.077651 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-be010d8d-be71-4b23-ad06-bb40907c6181 None None] MFA Rules not processed for user `2ff41052ee8747cb8039347a41f4e3f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:35:53.078911 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-be010d8d-be71-4b23-ad06-bb40907c6181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:35:53.141142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1156/2323] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:35:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:36:02.893608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=25 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:36:03.134007 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=25 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:36:13.059741 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14638e3a-7da4-481a-8570-7ed16c8f04ca None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:36:13.060290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14638e3a-7da4-481a-8570-7ed16c8f04ca None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:36:13.060529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14638e3a-7da4-481a-8570-7ed16c8f04ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:36:13.080823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-14638e3a-7da4-481a-8570-7ed16c8f04ca None None] MFA Rules not processed for user `b84dc5da6ae0443f92daf141837057d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:36:13.082208 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-14638e3a-7da4-481a-8570-7ed16c8f04ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:36:13.138748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1168/2324] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:36:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:36:16.485183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9687a-329b-4f28-9ea3-19b44af87063 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:36:16.485789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9687a-329b-4f28-9ea3-19b44af87063 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:36:16.485789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9687a-329b-4f28-9ea3-19b44af87063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:36:16.506297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-94e9687a-329b-4f28-9ea3-19b44af87063 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:36:16.507325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-94e9687a-329b-4f28-9ea3-19b44af87063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:36:16.516138 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1157/2325] 10.222.0.91 () {58 vars in 1016 bytes} [Fri Sep 23 15:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:36:16.537271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14638e3a-7da4-481a-8570-7ed16c8f04ca None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:36:16.550667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14638e3a-7da4-481a-8570-7ed16c8f04ca None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:36:16.556066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d72fb-34a1-4faa-9beb-264b7e38bb2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:36:16.556688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d72fb-34a1-4faa-9beb-264b7e38bb2b service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:36:16.556963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d72fb-34a1-4faa-9beb-264b7e38bb2b service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:36:16.557233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d72fb-34a1-4faa-9beb-264b7e38bb2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:36:16.565851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d72fb-34a1-4faa-9beb-264b7e38bb2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:36:16.567442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d72fb-34a1-4faa-9beb-264b7e38bb2b service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:36:16.577245 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1169/2326] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:36:23.132324 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e3ae-4328-4e82-b3d3-5723a2816c41 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:36:23.132896 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e3ae-4328-4e82-b3d3-5723a2816c41 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:36:23.133127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e3ae-4328-4e82-b3d3-5723a2816c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:36:23.154384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fc01e3ae-4328-4e82-b3d3-5723a2816c41 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:36:23.155644 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fc01e3ae-4328-4e82-b3d3-5723a2816c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:36:23.164167 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1158/2327] 10.222.0.91 () {58 vars in 1016 bytes} [Fri Sep 23 15:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:36:23.184813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d72fb-34a1-4faa-9beb-264b7e38bb2b service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:36:23.199242 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d72fb-34a1-4faa-9beb-264b7e38bb2b service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:36:23.205489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835fc6f-d972-4e87-baba-0a9c653228c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:36:23.206157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835fc6f-d972-4e87-baba-0a9c653228c9 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:36:23.206442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835fc6f-d972-4e87-baba-0a9c653228c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:36:23.206717 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835fc6f-d972-4e87-baba-0a9c653228c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:36:23.215562 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835fc6f-d972-4e87-baba-0a9c653228c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:36:23.217282 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835fc6f-d972-4e87-baba-0a9c653228c9 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:36:23.227334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1170/2328] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:36:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:36:27.001154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645d7a6-a69b-4980-90de-08267d6da5d3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:36:27.001642 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645d7a6-a69b-4980-90de-08267d6da5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:36:27.001904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645d7a6-a69b-4980-90de-08267d6da5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:36:27.022146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0645d7a6-a69b-4980-90de-08267d6da5d3 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:36:27.023378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0645d7a6-a69b-4980-90de-08267d6da5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:36:27.031621 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1159/2329] 10.222.0.91 () {58 vars in 1016 bytes} [Fri Sep 23 15:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:36:27.069015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835fc6f-d972-4e87-baba-0a9c653228c9 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:36:27.080661 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835fc6f-d972-4e87-baba-0a9c653228c9 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:36:27.086880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db623e92-ebc1-4bf4-b71f-1cf11052662e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:36:27.087839 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db623e92-ebc1-4bf4-b71f-1cf11052662e service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:36:27.087839 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db623e92-ebc1-4bf4-b71f-1cf11052662e service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:36:27.088063 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db623e92-ebc1-4bf4-b71f-1cf11052662e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:36:27.096522 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db623e92-ebc1-4bf4-b71f-1cf11052662e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:36:27.098133 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db623e92-ebc1-4bf4-b71f-1cf11052662e service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:36:27.107688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1171/2330] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:36:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:36:30.463297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b69a7-b147-44a9-95f0-50c9b93202bd None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:36:30.463783 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b69a7-b147-44a9-95f0-50c9b93202bd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:36:30.463892 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b69a7-b147-44a9-95f0-50c9b93202bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:36:30.483399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ed0b69a7-b147-44a9-95f0-50c9b93202bd None None] MFA Rules not processed for user `65e23f2d5c78471b87eb64d7a9c07b86`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:36:30.484585 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ed0b69a7-b147-44a9-95f0-50c9b93202bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:36:30.539303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1160/2331] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:36:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:36:32.314888 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63647f67-cd44-47e6-8d41-786e7f7aeed9 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:36:32.315366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63647f67-cd44-47e6-8d41-786e7f7aeed9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:36:32.315366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63647f67-cd44-47e6-8d41-786e7f7aeed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:36:32.350861 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-63647f67-cd44-47e6-8d41-786e7f7aeed9 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:36:32.352547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-63647f67-cd44-47e6-8d41-786e7f7aeed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:36:32.364366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1172/2332] 10.222.0.91 () {58 vars in 1016 bytes} [Fri Sep 23 15:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:36:32.387381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b69a7-b147-44a9-95f0-50c9b93202bd None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:36:32.416769 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b69a7-b147-44a9-95f0-50c9b93202bd None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:36:32.423126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61bff8-7524-4dd8-b5c1-23015203f9a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:36:32.423760 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61bff8-7524-4dd8-b5c1-23015203f9a7 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:36:32.424043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61bff8-7524-4dd8-b5c1-23015203f9a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:36:32.424318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61bff8-7524-4dd8-b5c1-23015203f9a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:36:32.433458 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61bff8-7524-4dd8-b5c1-23015203f9a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:36:32.435135 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61bff8-7524-4dd8-b5c1-23015203f9a7 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:36:32.451241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1161/2333] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:36:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:36:36.632532 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2f486-b69b-4c81-b37b-086be17536b7 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:36:36.633507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2f486-b69b-4c81-b37b-086be17536b7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:36:36.633964 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2f486-b69b-4c81-b37b-086be17536b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:36:36.655013 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cde2f486-b69b-4c81-b37b-086be17536b7 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:36:36.656345 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cde2f486-b69b-4c81-b37b-086be17536b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:36:36.664398 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1173/2334] 10.222.0.91 () {58 vars in 1016 bytes} [Fri Sep 23 15:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:36:36.687226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61bff8-7524-4dd8-b5c1-23015203f9a7 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:36:36.698528 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61bff8-7524-4dd8-b5c1-23015203f9a7 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:36:36.705169 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f5128-a681-40ba-8f3f-8b3306ecdd1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:36:36.705829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f5128-a681-40ba-8f3f-8b3306ecdd1e service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:36:36.706119 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f5128-a681-40ba-8f3f-8b3306ecdd1e service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:36:36.706397 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f5128-a681-40ba-8f3f-8b3306ecdd1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:36:36.714972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f5128-a681-40ba-8f3f-8b3306ecdd1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:36:36.716549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f5128-a681-40ba-8f3f-8b3306ecdd1e service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:36:36.726090 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1162/2335] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:36:39.430261 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a0d79-a7a7-4635-9e07-7100ab17954a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:36:39.430765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a0d79-a7a7-4635-9e07-7100ab17954a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:36:39.430860 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a0d79-a7a7-4635-9e07-7100ab17954a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:36:39.450073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-545a0d79-a7a7-4635-9e07-7100ab17954a None None] MFA Rules not processed for user `916f85e42444497ca4d4993f233d63c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:36:39.457835 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-545a0d79-a7a7-4635-9e07-7100ab17954a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:36:39.508912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1174/2336] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:36:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:36:46.721846 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=46 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:36:49.502156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=74 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:36:59.914300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f5128-a681-40ba-8f3f-8b3306ecdd1e service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:36:59.915795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8b2f5128-a681-40ba-8f3f-8b3306ecdd1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:36:59.927749 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f5128-a681-40ba-8f3f-8b3306ecdd1e service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:36:59.932351 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cb136-397d-429e-b926-e8a4eb373e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:36:59.932970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cb136-397d-429e-b926-e8a4eb373e5d service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:36:59.933250 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cb136-397d-429e-b926-e8a4eb373e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:36:59.933523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cb136-397d-429e-b926-e8a4eb373e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:36:59.935457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-007cb136-397d-429e-b926-e8a4eb373e5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:36:59.951968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007cb136-397d-429e-b926-e8a4eb373e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:36:59.953948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007cb136-397d-429e-b926-e8a4eb373e5d service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:36:59.967553 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1163/2337] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:36:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:03.645326 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a0d79-a7a7-4635-9e07-7100ab17954a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:03.655129 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a0d79-a7a7-4635-9e07-7100ab17954a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:03.658682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ea48d-a02a-404d-9de3-d6d775ad5694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:03.659271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ea48d-a02a-404d-9de3-d6d775ad5694 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:03.659544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ea48d-a02a-404d-9de3-d6d775ad5694 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:03.659811 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ea48d-a02a-404d-9de3-d6d775ad5694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:03.664777 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-574ea48d-a02a-404d-9de3-d6d775ad5694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:03.679047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ea48d-a02a-404d-9de3-d6d775ad5694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:03.680476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ea48d-a02a-404d-9de3-d6d775ad5694 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:03.692030 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1175/2338] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:09.960075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:13.213260 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cb136-397d-429e-b926-e8a4eb373e5d service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:13.215216 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-007cb136-397d-429e-b926-e8a4eb373e5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:13.231175 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cb136-397d-429e-b926-e8a4eb373e5d service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:13.236025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc6fcd-e74d-48d2-a707-af07520174cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:13.236725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc6fcd-e74d-48d2-a707-af07520174cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:13.237081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc6fcd-e74d-48d2-a707-af07520174cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:13.237433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc6fcd-e74d-48d2-a707-af07520174cb admin admin] PATH_INFO: `/v3/users/503e8319c29a465eb51941083b69d9b6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:13.238692 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc6fcd-e74d-48d2-a707-af07520174cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=503e8319c29a465eb51941083b69d9b6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:13.241192 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc6fcd-e74d-48d2-a707-af07520174cb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:13.546601 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-82fc6fcd-e74d-48d2-a707-af07520174cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '503e8319c29a465eb51941083b69d9b6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:13.579927 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-82fc6fcd-e74d-48d2-a707-af07520174cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '503e8319c29a465eb51941083b69d9b6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:13.582458 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-82fc6fcd-e74d-48d2-a707-af07520174cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '503e8319c29a465eb51941083b69d9b6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:13.583799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-82fc6fcd-e74d-48d2-a707-af07520174cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '503e8319c29a465eb51941083b69d9b6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:13.686912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=6 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:13.696417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-82fc6fcd-e74d-48d2-a707-af07520174cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '503e8319c29a465eb51941083b69d9b6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:13.708143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1164/2339] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:37:13 2022] DELETE /identity/v3/users/503e8319c29a465eb51941083b69d9b6 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:14.095519 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ea48d-a02a-404d-9de3-d6d775ad5694 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:14.098293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ea48d-a02a-404d-9de3-d6d775ad5694 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:14.163345 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f82a91-79f1-4016-b775-40f77c05004a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:14.163978 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f82a91-79f1-4016-b775-40f77c05004a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:14.164254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f82a91-79f1-4016-b775-40f77c05004a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:14.164527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f82a91-79f1-4016-b775-40f77c05004a admin admin] PATH_INFO: `/v3/projects/a277bf3bda26450aad008bf1204100fe` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:14.165638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f82a91-79f1-4016-b775-40f77c05004a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a277bf3bda26450aad008bf1204100fe)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:14.167586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f82a91-79f1-4016-b775-40f77c05004a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:14.351910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b6f82a91-79f1-4016-b775-40f77c05004a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a277bf3bda26450aad008bf1204100fe', 'request_id': 'req-b6f82a91-79f1-4016-b775-40f77c05004a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:14.451170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b6f82a91-79f1-4016-b775-40f77c05004a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a277bf3bda26450aad008bf1204100fe', 'request_id': 'req-b6f82a91-79f1-4016-b775-40f77c05004a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:14.469325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b6f82a91-79f1-4016-b775-40f77c05004a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a277bf3bda26450aad008bf1204100fe', 'request_id': 'req-b6f82a91-79f1-4016-b775-40f77c05004a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:14.480981 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b6f82a91-79f1-4016-b775-40f77c05004a admin admin] The token cache is being invalidate because project a277bf3bda26450aad008bf1204100fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:37:14.481294 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b6f82a91-79f1-4016-b775-40f77c05004a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:14.481985 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b6f82a91-79f1-4016-b775-40f77c05004a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:14.483500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1176/2340] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:37:14 2022] DELETE /identity/v3/projects/a277bf3bda26450aad008bf1204100fe => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:15.887495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc6fcd-e74d-48d2-a707-af07520174cb admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:15.888940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-82fc6fcd-e74d-48d2-a707-af07520174cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:16.011160 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc6fcd-e74d-48d2-a707-af07520174cb admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:16.075790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c904dd-574a-4c6a-b699-1445a4c23820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:16.076407 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c904dd-574a-4c6a-b699-1445a4c23820 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:16.076685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c904dd-574a-4c6a-b699-1445a4c23820 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:16.076978 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c904dd-574a-4c6a-b699-1445a4c23820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:16.079368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f4c904dd-574a-4c6a-b699-1445a4c23820 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:16.085669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:16.139187 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c904dd-574a-4c6a-b699-1445a4c23820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:16.140860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c904dd-574a-4c6a-b699-1445a4c23820 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:16.150540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1165/2341] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:17.721930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f85fb-1b4f-46a5-969a-e3cef9df3e45 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:17.722518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f85fb-1b4f-46a5-969a-e3cef9df3e45 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:17.722631 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f85fb-1b4f-46a5-969a-e3cef9df3e45 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:17.724335 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1177/2342] 10.222.0.82 () {54 vars in 921 bytes} [Fri Sep 23 15:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:37:17.734161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7090499-7c76-4de8-af91-977fd669ec2b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:17.734161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7090499-7c76-4de8-af91-977fd669ec2b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:17.734161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7090499-7c76-4de8-af91-977fd669ec2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:17.758678 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d7090499-7c76-4de8-af91-977fd669ec2b None None] MFA Rules not processed for user `defbff3e8f934dab9c800c7207c1d539`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:17.762620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d7090499-7c76-4de8-af91-977fd669ec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:17.816494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1166/2343] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Sep 23 15:37:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:37:17.829114 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f85fb-1b4f-46a5-969a-e3cef9df3e45 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:17.831507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-029f85fb-1b4f-46a5-969a-e3cef9df3e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:17.844485 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f85fb-1b4f-46a5-969a-e3cef9df3e45 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:17.848236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee3208-2b19-4a0e-a890-63f7b972b9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:17.848826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee3208-2b19-4a0e-a890-63f7b972b9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:17.849106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee3208-2b19-4a0e-a890-63f7b972b9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:17.849378 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee3208-2b19-4a0e-a890-63f7b972b9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:17.856527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee3208-2b19-4a0e-a890-63f7b972b9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:17.858048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee3208-2b19-4a0e-a890-63f7b972b9b2 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:17.874522 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1178/2344] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:18.014885 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb672c2-61a6-42a3-8714-44d40cecbd0a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:18.015204 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb672c2-61a6-42a3-8714-44d40cecbd0a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:18.015484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb672c2-61a6-42a3-8714-44d40cecbd0a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:18.016894 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1167/2345] 10.222.0.82 () {54 vars in 921 bytes} [Fri Sep 23 15:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 15:37:18.022843 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f048386-a404-46e6-a4e6-7789da58cbc3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:18.023126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f048386-a404-46e6-a4e6-7789da58cbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:18.023398 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f048386-a404-46e6-a4e6-7789da58cbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:18.043464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8f048386-a404-46e6-a4e6-7789da58cbc3 None None] MFA Rules not processed for user `6dbf682960cc447099c11862afa3206b`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:18.044717 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8f048386-a404-46e6-a4e6-7789da58cbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:18.053996 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1179/2346] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Sep 23 15:37:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:37:18.064283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb672c2-61a6-42a3-8714-44d40cecbd0a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:18.067216 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-edb672c2-61a6-42a3-8714-44d40cecbd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:18.080989 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb672c2-61a6-42a3-8714-44d40cecbd0a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:18.084587 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4cfb1-c3c8-4a30-b4d4-1e71c79656a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:18.085178 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4cfb1-c3c8-4a30-b4d4-1e71c79656a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:18.085459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4cfb1-c3c8-4a30-b4d4-1e71c79656a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:18.085745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4cfb1-c3c8-4a30-b4d4-1e71c79656a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:18.097403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4cfb1-c3c8-4a30-b4d4-1e71c79656a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:18.099232 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4cfb1-c3c8-4a30-b4d4-1e71c79656a4 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:18.110653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1168/2347] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:19.801893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad197b-cc23-4c87-abd7-391b0da62cd2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:19.802427 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad197b-cc23-4c87-abd7-391b0da62cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:19.802427 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad197b-cc23-4c87-abd7-391b0da62cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:19.824595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0dad197b-cc23-4c87-abd7-391b0da62cd2 None None] MFA Rules not processed for user `2ff41052ee8747cb8039347a41f4e3f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:19.824595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0dad197b-cc23-4c87-abd7-391b0da62cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:19.830706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1180/2348] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:37:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:37:20.601865 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4cfb1-c3c8-4a30-b4d4-1e71c79656a4 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:20.603400 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1aa4cfb1-c3c8-4a30-b4d4-1e71c79656a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:20.618466 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4cfb1-c3c8-4a30-b4d4-1e71c79656a4 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:20.623920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa9101-1957-45f6-914a-b6b6ed737ec4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:20.624516 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa9101-1957-45f6-914a-b6b6ed737ec4 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:20.624787 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa9101-1957-45f6-914a-b6b6ed737ec4 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:20.625056 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa9101-1957-45f6-914a-b6b6ed737ec4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:20.626786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-acfa9101-1957-45f6-914a-b6b6ed737ec4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:20.692921 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa9101-1957-45f6-914a-b6b6ed737ec4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:20.694711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa9101-1957-45f6-914a-b6b6ed737ec4 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:20.703562 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c2b7d-3223-4b3b-bc07-88939009c3f3 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:20.704055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c2b7d-3223-4b3b-bc07-88939009c3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:20.704527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c2b7d-3223-4b3b-bc07-88939009c3f3 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:20.705727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1169/2349] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:20.706872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1181/2350] 10.222.0.82 () {54 vars in 961 bytes} [Fri Sep 23 15:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:37:20.713384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367af18-e7f8-4a2b-a366-fd525df7393e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:20.713706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367af18-e7f8-4a2b-a366-fd525df7393e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:20.714031 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367af18-e7f8-4a2b-a366-fd525df7393e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:20.744994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e367af18-e7f8-4a2b-a366-fd525df7393e None None] MFA Rules not processed for user `a25109eeb1b34b3689b10e3f7c44a6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:20.746264 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e367af18-e7f8-4a2b-a366-fd525df7393e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:20.806300 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:20.816074 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1182/2351] 10.222.0.82 () {58 vars in 1058 bytes} [Fri Sep 23 15:37:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:37:20.823929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa9101-1957-45f6-914a-b6b6ed737ec4 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:20.835529 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa9101-1957-45f6-914a-b6b6ed737ec4 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:20.840696 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a535f4-4c47-4fc8-85f1-4ed85f6d8ba1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25109eeb1b34b3689b10e3f7c44a6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:20.841287 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a535f4-4c47-4fc8-85f1-4ed85f6d8ba1 service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:20.841567 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a535f4-4c47-4fc8-85f1-4ed85f6d8ba1 service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:20.841877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a535f4-4c47-4fc8-85f1-4ed85f6d8ba1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:20.843606 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e5a535f4-4c47-4fc8-85f1-4ed85f6d8ba1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:20.854735 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a535f4-4c47-4fc8-85f1-4ed85f6d8ba1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:20.856291 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a535f4-4c47-4fc8-85f1-4ed85f6d8ba1 service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:20.866005 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1170/2352] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:29.151440 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367af18-e7f8-4a2b-a366-fd525df7393e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:29.161535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367af18-e7f8-4a2b-a366-fd525df7393e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:29.165069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b629a-8959-44b7-8b1f-5c7c1f87fef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:29.165694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b629a-8959-44b7-8b1f-5c7c1f87fef5 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:29.166058 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b629a-8959-44b7-8b1f-5c7c1f87fef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:29.166327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b629a-8959-44b7-8b1f-5c7c1f87fef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:29.168036 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8a6b629a-8959-44b7-8b1f-5c7c1f87fef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:29.236115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b629a-8959-44b7-8b1f-5c7c1f87fef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:29.237551 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b629a-8959-44b7-8b1f-5c7c1f87fef5 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:29.248269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1183/2353] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:30.861878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=87 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:32.155691 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a535f4-4c47-4fc8-85f1-4ed85f6d8ba1 service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:32.167471 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a535f4-4c47-4fc8-85f1-4ed85f6d8ba1 service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:32.171631 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165b9af-5f6f-45df-ae0f-d7bf6bd7fbf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:32.172309 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165b9af-5f6f-45df-ae0f-d7bf6bd7fbf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:32.172585 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165b9af-5f6f-45df-ae0f-d7bf6bd7fbf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:32.172853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165b9af-5f6f-45df-ae0f-d7bf6bd7fbf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:32.174955 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e165b9af-5f6f-45df-ae0f-d7bf6bd7fbf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:32.191576 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165b9af-5f6f-45df-ae0f-d7bf6bd7fbf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:32.193541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165b9af-5f6f-45df-ae0f-d7bf6bd7fbf2 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:32.204882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1171/2354] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:37:33.589051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b629a-8959-44b7-8b1f-5c7c1f87fef5 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:33.591052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8a6b629a-8959-44b7-8b1f-5c7c1f87fef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:33.609213 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b629a-8959-44b7-8b1f-5c7c1f87fef5 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:33.614850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ecd6b-f48e-493a-b2e5-e26b0bb2083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:33.615610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ecd6b-f48e-493a-b2e5-e26b0bb2083a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:33.615981 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ecd6b-f48e-493a-b2e5-e26b0bb2083a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:33.616510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ecd6b-f48e-493a-b2e5-e26b0bb2083a admin admin] PATH_INFO: `/v3/users/b84dc5da6ae0443f92daf141837057d2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:33.617658 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ecd6b-f48e-493a-b2e5-e26b0bb2083a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b84dc5da6ae0443f92daf141837057d2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:33.619664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ecd6b-f48e-493a-b2e5-e26b0bb2083a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:33.915053 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a21ecd6b-f48e-493a-b2e5-e26b0bb2083a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b84dc5da6ae0443f92daf141837057d2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:33.927234 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a21ecd6b-f48e-493a-b2e5-e26b0bb2083a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b84dc5da6ae0443f92daf141837057d2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:33.934346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a21ecd6b-f48e-493a-b2e5-e26b0bb2083a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b84dc5da6ae0443f92daf141837057d2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:33.935027 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a21ecd6b-f48e-493a-b2e5-e26b0bb2083a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b84dc5da6ae0443f92daf141837057d2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:33.997784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a21ecd6b-f48e-493a-b2e5-e26b0bb2083a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b84dc5da6ae0443f92daf141837057d2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:34.004211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1184/2355] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:37:33 2022] DELETE /identity/v3/users/b84dc5da6ae0443f92daf141837057d2 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:34.304162 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165b9af-5f6f-45df-ae0f-d7bf6bd7fbf2 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:34.321017 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165b9af-5f6f-45df-ae0f-d7bf6bd7fbf2 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:34.379253 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1b8ec-0ea3-416b-b1dd-46d86fee4f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:34.380344 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1b8ec-0ea3-416b-b1dd-46d86fee4f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:34.380619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1b8ec-0ea3-416b-b1dd-46d86fee4f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:34.380901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1b8ec-0ea3-416b-b1dd-46d86fee4f30 admin admin] PATH_INFO: `/v3/projects/d62e735ac8ed4d7580eacc3ca5b20451` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:34.382155 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1b8ec-0ea3-416b-b1dd-46d86fee4f30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d62e735ac8ed4d7580eacc3ca5b20451)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:34.384114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1b8ec-0ea3-416b-b1dd-46d86fee4f30 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:34.498980 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f6c1b8ec-0ea3-416b-b1dd-46d86fee4f30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd62e735ac8ed4d7580eacc3ca5b20451', 'request_id': 'req-f6c1b8ec-0ea3-416b-b1dd-46d86fee4f30'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:34.576769 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f6c1b8ec-0ea3-416b-b1dd-46d86fee4f30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd62e735ac8ed4d7580eacc3ca5b20451', 'request_id': 'req-f6c1b8ec-0ea3-416b-b1dd-46d86fee4f30'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:34.585314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f6c1b8ec-0ea3-416b-b1dd-46d86fee4f30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd62e735ac8ed4d7580eacc3ca5b20451', 'request_id': 'req-f6c1b8ec-0ea3-416b-b1dd-46d86fee4f30'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:34.596783 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f6c1b8ec-0ea3-416b-b1dd-46d86fee4f30 admin admin] The token cache is being invalidate because project d62e735ac8ed4d7580eacc3ca5b20451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:37:34.605086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f6c1b8ec-0ea3-416b-b1dd-46d86fee4f30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:34.605086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f6c1b8ec-0ea3-416b-b1dd-46d86fee4f30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:34.605086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1172/2356] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:37:34 2022] DELETE /identity/v3/projects/d62e735ac8ed4d7580eacc3ca5b20451 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:34.605370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d341b-7ce1-423d-b462-9eb6ed7e2c01 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:34.605370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d341b-7ce1-423d-b462-9eb6ed7e2c01 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:34.605370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d341b-7ce1-423d-b462-9eb6ed7e2c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:34.625015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-113d341b-7ce1-423d-b462-9eb6ed7e2c01 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:34.626425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-113d341b-7ce1-423d-b462-9eb6ed7e2c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:34.685871 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1185/2357] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:37:34.693914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fa0ab-a1e6-40b4-81fb-7b001d151b66 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:34.694204 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fa0ab-a1e6-40b4-81fb-7b001d151b66 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:34.694481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fa0ab-a1e6-40b4-81fb-7b001d151b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:34.714078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a84fa0ab-a1e6-40b4-81fb-7b001d151b66 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:34.715283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a84fa0ab-a1e6-40b4-81fb-7b001d151b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:34.723141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1173/2358] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:37:34.727229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d341b-7ce1-423d-b462-9eb6ed7e2c01 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:34.736704 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d341b-7ce1-423d-b462-9eb6ed7e2c01 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:34.741832 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfb4c4-4de6-4446-81c1-4b1e39e244f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:34.742431 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfb4c4-4de6-4446-81c1-4b1e39e244f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:34.742712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfb4c4-4de6-4446-81c1-4b1e39e244f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:34.742988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfb4c4-4de6-4446-81c1-4b1e39e244f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:34.743626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfb4c4-4de6-4446-81c1-4b1e39e244f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:37:34.743929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfb4c4-4de6-4446-81c1-4b1e39e244f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:34.745588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfb4c4-4de6-4446-81c1-4b1e39e244f6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:34.747048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:34.758009 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1186/2359] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:37:34.769001 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fa0ab-a1e6-40b4-81fb-7b001d151b66 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:34.778748 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fa0ab-a1e6-40b4-81fb-7b001d151b66 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:34.783794 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7dc6f-5c86-4aec-9487-552840f8e4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:34.784378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7dc6f-5c86-4aec-9487-552840f8e4eb admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:34.784655 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7dc6f-5c86-4aec-9487-552840f8e4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:34.784926 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7dc6f-5c86-4aec-9487-552840f8e4eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:34.785685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7dc6f-5c86-4aec-9487-552840f8e4eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:34.787748 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7dc6f-5c86-4aec-9487-552840f8e4eb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:34.906701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1174/2360] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:37:34 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:37:34.907870 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfb4c4-4de6-4446-81c1-4b1e39e244f6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:34.917627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfb4c4-4de6-4446-81c1-4b1e39e244f6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:34.974443 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2e8b3-fc90-46a0-a3b4-fad8cde0264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:34.975056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2e8b3-fc90-46a0-a3b4-fad8cde0264a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:34.975334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2e8b3-fc90-46a0-a3b4-fad8cde0264a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:34.975607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2e8b3-fc90-46a0-a3b4-fad8cde0264a admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:34.976231 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2e8b3-fc90-46a0-a3b4-fad8cde0264a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:34.978221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2e8b3-fc90-46a0-a3b4-fad8cde0264a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:35.051110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1187/2361] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:37:34 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:37:35.055791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7dc6f-5c86-4aec-9487-552840f8e4eb admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:35.065908 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7dc6f-5c86-4aec-9487-552840f8e4eb admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:35.070523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76742a9e-8d96-4217-9ea4-f0e0547d614d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:35.071112 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76742a9e-8d96-4217-9ea4-f0e0547d614d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:35.071391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76742a9e-8d96-4217-9ea4-f0e0547d614d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:35.071664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76742a9e-8d96-4217-9ea4-f0e0547d614d admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:35.072298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76742a9e-8d96-4217-9ea4-f0e0547d614d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:35.073930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76742a9e-8d96-4217-9ea4-f0e0547d614d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:35.083734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1175/2362] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:37:35.087524 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2e8b3-fc90-46a0-a3b4-fad8cde0264a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:35.097137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2e8b3-fc90-46a0-a3b4-fad8cde0264a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:35.102529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6f6c2-8daf-4c5f-8001-641fb5fb2f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:35.103117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6f6c2-8daf-4c5f-8001-641fb5fb2f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:35.103420 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6f6c2-8daf-4c5f-8001-641fb5fb2f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:35.103689 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6f6c2-8daf-4c5f-8001-641fb5fb2f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:35.104345 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6f6c2-8daf-4c5f-8001-641fb5fb2f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:35.106005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6f6c2-8daf-4c5f-8001-641fb5fb2f42 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:35.117206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1188/2363] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:37:35.121201 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76742a9e-8d96-4217-9ea4-f0e0547d614d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:35.131036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76742a9e-8d96-4217-9ea4-f0e0547d614d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:35.135705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7a7c2-fb8c-4733-b80d-78a5855ce401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:35.136344 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7a7c2-fb8c-4733-b80d-78a5855ce401 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:35.136625 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7a7c2-fb8c-4733-b80d-78a5855ce401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:35.136899 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7a7c2-fb8c-4733-b80d-78a5855ce401 admin admin] PATH_INFO: `/v3/projects/f7e81a7aed2f48c0be48e416a9beb12d/users/e759b8cc32884895a511c4c21c423f05/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:35.151177 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7a7c2-fb8c-4733-b80d-78a5855ce401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7e81a7aed2f48c0be48e416a9beb12d, user_id=e759b8cc32884895a511c4c21c423f05, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:35.154111 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7a7c2-fb8c-4733-b80d-78a5855ce401 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:35.195872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6f6c2-8daf-4c5f-8001-641fb5fb2f42 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:35.197596 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-dfd6f6c2-8daf-4c5f-8001-641fb5fb2f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:35.229153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1176/2364] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:37:35 2022] PUT /identity/v3/projects/f7e81a7aed2f48c0be48e416a9beb12d/users/e759b8cc32884895a511c4c21c423f05/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:35.240624 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0f539-bd01-4e55-9059-beee56719a17 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:35.241036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0f539-bd01-4e55-9059-beee56719a17 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:35.241683 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0f539-bd01-4e55-9059-beee56719a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:35.267858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:35.270753 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-03c0f539-bd01-4e55-9059-beee56719a17 None None] MFA Rules not processed for user `e759b8cc32884895a511c4c21c423f05`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:35.272071 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-03c0f539-bd01-4e55-9059-beee56719a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:35.276155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6f6c2-8daf-4c5f-8001-641fb5fb2f42 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:35.338305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1177/2365] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:37:35.342694 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0f539-bd01-4e55-9059-beee56719a17 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:35.348265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa9111-4af8-4bb1-9882-01f8ae44e7ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:35.349535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa9111-4af8-4bb1-9882-01f8ae44e7ee service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:35.349842 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa9111-4af8-4bb1-9882-01f8ae44e7ee service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:35.350109 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa9111-4af8-4bb1-9882-01f8ae44e7ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:35.351831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-47fa9111-4af8-4bb1-9882-01f8ae44e7ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:35.358019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:35.405066 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0f539-bd01-4e55-9059-beee56719a17 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:35.409431 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa9111-4af8-4bb1-9882-01f8ae44e7ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:35.409868 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94f9a8-6c4f-4d78-944a-d5ed8d01f8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:35.410474 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94f9a8-6c4f-4d78-944a-d5ed8d01f8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:35.411352 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94f9a8-6c4f-4d78-944a-d5ed8d01f8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:35.411608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa9111-4af8-4bb1-9882-01f8ae44e7ee service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:35.411723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94f9a8-6c4f-4d78-944a-d5ed8d01f8d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:35.412243 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94f9a8-6c4f-4d78-944a-d5ed8d01f8d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:35.414156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94f9a8-6c4f-4d78-944a-d5ed8d01f8d9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:35.420849 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1189/2366] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:35.534887 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1178/2367] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:37:35 2022] POST /identity/v3/projects => generated 369 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:37:35.539576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa9111-4af8-4bb1-9882-01f8ae44e7ee service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:35.552468 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa9111-4af8-4bb1-9882-01f8ae44e7ee service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:35.623868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a9d25-50e2-4168-9356-9677329ddfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:35.624589 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a9d25-50e2-4168-9356-9677329ddfb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:35.625183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a9d25-50e2-4168-9356-9677329ddfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:35.625183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a9d25-50e2-4168-9356-9677329ddfb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:35.625777 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a9d25-50e2-4168-9356-9677329ddfb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:35.627706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a9d25-50e2-4168-9356-9677329ddfb9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:35.729815 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1190/2368] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:37:35 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:37:35.734095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94f9a8-6c4f-4d78-944a-d5ed8d01f8d9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:35.744234 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94f9a8-6c4f-4d78-944a-d5ed8d01f8d9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:35.750117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1764222-d4d4-48f6-87ee-c2b5a9bf81f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:35.750916 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1764222-d4d4-48f6-87ee-c2b5a9bf81f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:35.751200 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1764222-d4d4-48f6-87ee-c2b5a9bf81f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:35.751578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1764222-d4d4-48f6-87ee-c2b5a9bf81f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:35.752171 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1764222-d4d4-48f6-87ee-c2b5a9bf81f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:35.753880 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1764222-d4d4-48f6-87ee-c2b5a9bf81f5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:35.765399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1179/2369] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:37:35.771872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a9d25-50e2-4168-9356-9677329ddfb9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:35.782746 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a9d25-50e2-4168-9356-9677329ddfb9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:35.790301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72a4e6-c562-4614-9cd5-becb2f9a8c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:35.790968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72a4e6-c562-4614-9cd5-becb2f9a8c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:35.792299 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72a4e6-c562-4614-9cd5-becb2f9a8c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:35.792587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72a4e6-c562-4614-9cd5-becb2f9a8c50 admin admin] PATH_INFO: `/v3/projects/1799f534ab4946c8a5e7efa15edab808/users/be6dc26281924e5fae8bdf878a69246d/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:35.815825 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72a4e6-c562-4614-9cd5-becb2f9a8c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1799f534ab4946c8a5e7efa15edab808, user_id=be6dc26281924e5fae8bdf878a69246d, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:35.819174 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72a4e6-c562-4614-9cd5-becb2f9a8c50 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:35.907023 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1191/2370] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:37:35 2022] PUT /identity/v3/projects/1799f534ab4946c8a5e7efa15edab808/users/be6dc26281924e5fae8bdf878a69246d/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:35.911048 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1764222-d4d4-48f6-87ee-c2b5a9bf81f5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:35.920974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1764222-d4d4-48f6-87ee-c2b5a9bf81f5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:35.994123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d7f92-0a1f-4ea5-a5ca-0bee41ef5dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:35.994464 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d7f92-0a1f-4ea5-a5ca-0bee41ef5dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:35.994741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d7f92-0a1f-4ea5-a5ca-0bee41ef5dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:35.995008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d7f92-0a1f-4ea5-a5ca-0bee41ef5dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:35.995673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d7f92-0a1f-4ea5-a5ca-0bee41ef5dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:35.997312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d7f92-0a1f-4ea5-a5ca-0bee41ef5dc9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:36.008058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1180/2371] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:37:36.012239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72a4e6-c562-4614-9cd5-becb2f9a8c50 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:36.036056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72a4e6-c562-4614-9cd5-becb2f9a8c50 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:36.044839 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4689e5e-3f1f-4a81-8412-ccd35b27bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:36.045497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4689e5e-3f1f-4a81-8412-ccd35b27bcfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:36.045798 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4689e5e-3f1f-4a81-8412-ccd35b27bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:36.046073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4689e5e-3f1f-4a81-8412-ccd35b27bcfc admin admin] PATH_INFO: `/v3/projects/1799f534ab4946c8a5e7efa15edab808/users/be6dc26281924e5fae8bdf878a69246d/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:36.048106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4689e5e-3f1f-4a81-8412-ccd35b27bcfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1799f534ab4946c8a5e7efa15edab808, user_id=be6dc26281924e5fae8bdf878a69246d, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:36.050808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4689e5e-3f1f-4a81-8412-ccd35b27bcfc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:36.062660 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1192/2372] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:37:36 2022] PUT /identity/v3/projects/1799f534ab4946c8a5e7efa15edab808/users/be6dc26281924e5fae8bdf878a69246d/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:36.073493 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda28b3-2e43-4bcd-b87a-023afb6866cc None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:36.073995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda28b3-2e43-4bcd-b87a-023afb6866cc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:36.074276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda28b3-2e43-4bcd-b87a-023afb6866cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:36.104558 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:36.108051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bbda28b3-2e43-4bcd-b87a-023afb6866cc None None] MFA Rules not processed for user `be6dc26281924e5fae8bdf878a69246d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:36.109639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bbda28b3-2e43-4bcd-b87a-023afb6866cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:36.185503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1181/2373] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:37:36.197857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4689e5e-3f1f-4a81-8412-ccd35b27bcfc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:36.199558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e4689e5e-3f1f-4a81-8412-ccd35b27bcfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:36.259799 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4689e5e-3f1f-4a81-8412-ccd35b27bcfc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:36.263835 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94b68a-0511-43db-b287-0b479a6d908c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:36.264443 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94b68a-0511-43db-b287-0b479a6d908c service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:36.264720 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94b68a-0511-43db-b287-0b479a6d908c service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:36.264990 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94b68a-0511-43db-b287-0b479a6d908c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:36.274031 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94b68a-0511-43db-b287-0b479a6d908c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:36.275464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94b68a-0511-43db-b287-0b479a6d908c service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:36.284976 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1193/2374] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:37.306516 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda28b3-2e43-4bcd-b87a-023afb6866cc None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:37.367587 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda28b3-2e43-4bcd-b87a-023afb6866cc None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:37.372028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fc900-d1ba-4ddd-9b99-8db85189e501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:37.372647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fc900-d1ba-4ddd-9b99-8db85189e501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:37.372925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fc900-d1ba-4ddd-9b99-8db85189e501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:37.373198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fc900-d1ba-4ddd-9b99-8db85189e501 admin admin] PATH_INFO: `/v3/users/e759b8cc32884895a511c4c21c423f05` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:37.374331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fc900-d1ba-4ddd-9b99-8db85189e501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e759b8cc32884895a511c4c21c423f05)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:37.376227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fc900-d1ba-4ddd-9b99-8db85189e501 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:37.619705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ba9fc900-d1ba-4ddd-9b99-8db85189e501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e759b8cc32884895a511c4c21c423f05'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:37.632301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ba9fc900-d1ba-4ddd-9b99-8db85189e501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e759b8cc32884895a511c4c21c423f05'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:37.639301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ba9fc900-d1ba-4ddd-9b99-8db85189e501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e759b8cc32884895a511c4c21c423f05'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:37.639980 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ba9fc900-d1ba-4ddd-9b99-8db85189e501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e759b8cc32884895a511c4c21c423f05'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:37.725156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ba9fc900-d1ba-4ddd-9b99-8db85189e501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e759b8cc32884895a511c4c21c423f05'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:37.731299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1182/2375] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:37:37 2022] DELETE /identity/v3/users/e759b8cc32884895a511c4c21c423f05 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:37.735721 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7b1b7-476c-4c08-8d6a-f803400ae9d1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:37.736224 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7b1b7-476c-4c08-8d6a-f803400ae9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:37.736516 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7b1b7-476c-4c08-8d6a-f803400ae9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:37.745026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:37.758219 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-69c7b1b7-476c-4c08-8d6a-f803400ae9d1 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:37.759430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-69c7b1b7-476c-4c08-8d6a-f803400ae9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:37.818741 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1194/2376] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:37:37.828578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fc900-d1ba-4ddd-9b99-8db85189e501 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:37.830020 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ba9fc900-d1ba-4ddd-9b99-8db85189e501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:37.851750 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:37.889193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fc900-d1ba-4ddd-9b99-8db85189e501 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:37.892743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcd101-eafa-4330-ad77-b9ab9741d621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:37.893338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcd101-eafa-4330-ad77-b9ab9741d621 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:37.893614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcd101-eafa-4330-ad77-b9ab9741d621 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:37.893922 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcd101-eafa-4330-ad77-b9ab9741d621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:37.904390 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcd101-eafa-4330-ad77-b9ab9741d621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:37.905874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcd101-eafa-4330-ad77-b9ab9741d621 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:37.916116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1183/2377] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:38.263936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7b1b7-476c-4c08-8d6a-f803400ae9d1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:38.267404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-69c7b1b7-476c-4c08-8d6a-f803400ae9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:38.350413 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7b1b7-476c-4c08-8d6a-f803400ae9d1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:38.357022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f27a74-3e87-432a-a84f-b1d6b6e1dab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:38.357640 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f27a74-3e87-432a-a84f-b1d6b6e1dab5 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:38.357959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f27a74-3e87-432a-a84f-b1d6b6e1dab5 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:38.358232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f27a74-3e87-432a-a84f-b1d6b6e1dab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:38.360112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d6f27a74-3e87-432a-a84f-b1d6b6e1dab5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:38.383647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcd101-eafa-4330-ad77-b9ab9741d621 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:38.385107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2cbcd101-eafa-4330-ad77-b9ab9741d621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:38.405371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcd101-eafa-4330-ad77-b9ab9741d621 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:38.421633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a47fb-65ed-4dbe-8073-fc5b38432710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:38.423510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a47fb-65ed-4dbe-8073-fc5b38432710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:38.423951 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a47fb-65ed-4dbe-8073-fc5b38432710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:38.424541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a47fb-65ed-4dbe-8073-fc5b38432710 admin admin] PATH_INFO: `/v3/projects/f7e81a7aed2f48c0be48e416a9beb12d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:38.426293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a47fb-65ed-4dbe-8073-fc5b38432710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7e81a7aed2f48c0be48e416a9beb12d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:38.429940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a47fb-65ed-4dbe-8073-fc5b38432710 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:38.447125 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f27a74-3e87-432a-a84f-b1d6b6e1dab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:38.448785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f27a74-3e87-432a-a84f-b1d6b6e1dab5 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:38.470769 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1195/2378] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:38.592883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0c9a47fb-65ed-4dbe-8073-fc5b38432710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7e81a7aed2f48c0be48e416a9beb12d', 'request_id': 'req-0c9a47fb-65ed-4dbe-8073-fc5b38432710'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:38.674649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0c9a47fb-65ed-4dbe-8073-fc5b38432710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7e81a7aed2f48c0be48e416a9beb12d', 'request_id': 'req-0c9a47fb-65ed-4dbe-8073-fc5b38432710'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:38.681080 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0c9a47fb-65ed-4dbe-8073-fc5b38432710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7e81a7aed2f48c0be48e416a9beb12d', 'request_id': 'req-0c9a47fb-65ed-4dbe-8073-fc5b38432710'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:38.693082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0c9a47fb-65ed-4dbe-8073-fc5b38432710 admin admin] The token cache is being invalidate because project f7e81a7aed2f48c0be48e416a9beb12d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:37:38.693368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0c9a47fb-65ed-4dbe-8073-fc5b38432710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:38.694035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0c9a47fb-65ed-4dbe-8073-fc5b38432710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:38.695510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1184/2379] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:37:38 2022] DELETE /identity/v3/projects/f7e81a7aed2f48c0be48e416a9beb12d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:38.699607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f27a74-3e87-432a-a84f-b1d6b6e1dab5 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:38.710595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f27a74-3e87-432a-a84f-b1d6b6e1dab5 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:38.749138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:38.769106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c94d7-afc0-446b-82da-1bc6dca81ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:38.769862 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c94d7-afc0-446b-82da-1bc6dca81ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:38.770209 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c94d7-afc0-446b-82da-1bc6dca81ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:38.771143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c94d7-afc0-446b-82da-1bc6dca81ecd admin admin] PATH_INFO: `/v3/users/be6dc26281924e5fae8bdf878a69246d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:38.772350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c94d7-afc0-446b-82da-1bc6dca81ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6dc26281924e5fae8bdf878a69246d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:38.774405 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c94d7-afc0-446b-82da-1bc6dca81ecd admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:38.997518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b47c94d7-afc0-446b-82da-1bc6dca81ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6dc26281924e5fae8bdf878a69246d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:39.010510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b47c94d7-afc0-446b-82da-1bc6dca81ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6dc26281924e5fae8bdf878a69246d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:39.017409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b47c94d7-afc0-446b-82da-1bc6dca81ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6dc26281924e5fae8bdf878a69246d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:39.018217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b47c94d7-afc0-446b-82da-1bc6dca81ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6dc26281924e5fae8bdf878a69246d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:39.096231 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b47c94d7-afc0-446b-82da-1bc6dca81ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6dc26281924e5fae8bdf878a69246d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:39.103146 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1196/2380] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:37:38 2022] DELETE /identity/v3/users/be6dc26281924e5fae8bdf878a69246d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:37:39.533490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a47fb-65ed-4dbe-8073-fc5b38432710 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:39.534959 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0c9a47fb-65ed-4dbe-8073-fc5b38432710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:39.627571 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a47fb-65ed-4dbe-8073-fc5b38432710 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:39.674042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:39.703886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92ecfd-2bba-4c90-a479-d59c3b3cc0bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:39.704618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92ecfd-2bba-4c90-a479-d59c3b3cc0bd service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:39.704900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92ecfd-2bba-4c90-a479-d59c3b3cc0bd service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:39.705168 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92ecfd-2bba-4c90-a479-d59c3b3cc0bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:39.707015 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2e92ecfd-2bba-4c90-a479-d59c3b3cc0bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:39.719859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92ecfd-2bba-4c90-a479-d59c3b3cc0bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:39.721655 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92ecfd-2bba-4c90-a479-d59c3b3cc0bd service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:39.735841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1185/2381] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:37:39.748176 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c94d7-afc0-446b-82da-1bc6dca81ecd admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:39.750202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b47c94d7-afc0-446b-82da-1bc6dca81ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:39.858987 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c94d7-afc0-446b-82da-1bc6dca81ecd admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:39.868398 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074b143-1a8d-4154-9928-8f656cfe3e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:39.869486 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074b143-1a8d-4154-9928-8f656cfe3e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:39.870070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074b143-1a8d-4154-9928-8f656cfe3e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:39.870564 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074b143-1a8d-4154-9928-8f656cfe3e13 admin admin] PATH_INFO: `/v3/projects/1799f534ab4946c8a5e7efa15edab808` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:39.872617 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074b143-1a8d-4154-9928-8f656cfe3e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1799f534ab4946c8a5e7efa15edab808)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:39.876451 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074b143-1a8d-4154-9928-8f656cfe3e13 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:40.014349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0074b143-1a8d-4154-9928-8f656cfe3e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1799f534ab4946c8a5e7efa15edab808', 'request_id': 'req-0074b143-1a8d-4154-9928-8f656cfe3e13'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:40.083686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0074b143-1a8d-4154-9928-8f656cfe3e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1799f534ab4946c8a5e7efa15edab808', 'request_id': 'req-0074b143-1a8d-4154-9928-8f656cfe3e13'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:40.090913 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0074b143-1a8d-4154-9928-8f656cfe3e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1799f534ab4946c8a5e7efa15edab808', 'request_id': 'req-0074b143-1a8d-4154-9928-8f656cfe3e13'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:40.094250 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:40.103778 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0074b143-1a8d-4154-9928-8f656cfe3e13 admin admin] The token cache is being invalidate because project 1799f534ab4946c8a5e7efa15edab808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:37:40.104069 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0074b143-1a8d-4154-9928-8f656cfe3e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:40.104727 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0074b143-1a8d-4154-9928-8f656cfe3e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:40.111300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730013d-d309-4507-91ea-ddec88301bc0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:40.111587 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730013d-d309-4507-91ea-ddec88301bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:40.111865 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730013d-d309-4507-91ea-ddec88301bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:40.115070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1197/2382] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:37:39 2022] DELETE /identity/v3/projects/1799f534ab4946c8a5e7efa15edab808 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:40.136360 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0730013d-d309-4507-91ea-ddec88301bc0 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:40.137581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0730013d-d309-4507-91ea-ddec88301bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:40.230550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1186/2383] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:37:40.232353 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdc821-7642-41d8-885b-89184c7cfbc8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:40.232644 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdc821-7642-41d8-885b-89184c7cfbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:40.234518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdc821-7642-41d8-885b-89184c7cfbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:40.257181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-70cdc821-7642-41d8-885b-89184c7cfbc8 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:40.259512 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-70cdc821-7642-41d8-885b-89184c7cfbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:40.276810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1198/2384] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:37:40.278063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730013d-d309-4507-91ea-ddec88301bc0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:40.288957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730013d-d309-4507-91ea-ddec88301bc0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:40.295157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ac83c-c1de-441a-89aa-a1e65d18d0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:40.296004 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ac83c-c1de-441a-89aa-a1e65d18d0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:40.296455 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ac83c-c1de-441a-89aa-a1e65d18d0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:40.296768 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ac83c-c1de-441a-89aa-a1e65d18d0d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:40.297431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ac83c-c1de-441a-89aa-a1e65d18d0d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:37:40.297762 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ac83c-c1de-441a-89aa-a1e65d18d0d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:40.299442 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ac83c-c1de-441a-89aa-a1e65d18d0d7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:40.315802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1187/2385] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:37:40.318019 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdc821-7642-41d8-885b-89184c7cfbc8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:40.327312 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdc821-7642-41d8-885b-89184c7cfbc8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:40.337918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf164e4-b1e4-446e-ab6e-10f833021f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:40.338694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf164e4-b1e4-446e-ab6e-10f833021f23 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:40.339066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf164e4-b1e4-446e-ab6e-10f833021f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:40.339438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf164e4-b1e4-446e-ab6e-10f833021f23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:40.340171 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf164e4-b1e4-446e-ab6e-10f833021f23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:40.342732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf164e4-b1e4-446e-ab6e-10f833021f23 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:40.429840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1199/2386] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:37:40 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:37:40.431441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ac83c-c1de-441a-89aa-a1e65d18d0d7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:40.441917 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ac83c-c1de-441a-89aa-a1e65d18d0d7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:40.502994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2aa848-9257-429d-ae25-b913b811592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:40.504243 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2aa848-9257-429d-ae25-b913b811592a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:40.504243 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2aa848-9257-429d-ae25-b913b811592a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:40.504243 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2aa848-9257-429d-ae25-b913b811592a admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:40.505233 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2aa848-9257-429d-ae25-b913b811592a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:40.507099 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2aa848-9257-429d-ae25-b913b811592a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:40.615938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1188/2387] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:37:40 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:37:40.620443 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf164e4-b1e4-446e-ab6e-10f833021f23 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:40.632455 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf164e4-b1e4-446e-ab6e-10f833021f23 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:40.637542 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b2f09-8744-4313-bbcc-43655ca2f77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:40.643460 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b2f09-8744-4313-bbcc-43655ca2f77a admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:40.643934 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b2f09-8744-4313-bbcc-43655ca2f77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:40.644275 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b2f09-8744-4313-bbcc-43655ca2f77a admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:40.645115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b2f09-8744-4313-bbcc-43655ca2f77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:40.647404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b2f09-8744-4313-bbcc-43655ca2f77a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:40.658765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1200/2388] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:37:40.663701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2aa848-9257-429d-ae25-b913b811592a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:40.678778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2aa848-9257-429d-ae25-b913b811592a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:40.682790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a3058-4a03-43a2-9453-821aa78bf164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:40.683627 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a3058-4a03-43a2-9453-821aa78bf164 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:40.683915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a3058-4a03-43a2-9453-821aa78bf164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:40.685882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a3058-4a03-43a2-9453-821aa78bf164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:40.686598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a3058-4a03-43a2-9453-821aa78bf164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:40.688237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a3058-4a03-43a2-9453-821aa78bf164 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:40.700217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1189/2389] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:37:40.704698 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b2f09-8744-4313-bbcc-43655ca2f77a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:40.715237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b2f09-8744-4313-bbcc-43655ca2f77a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:40.719840 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99721b7a-6418-4cba-b75b-a6a9f769fedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:40.720483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99721b7a-6418-4cba-b75b-a6a9f769fedd admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:40.720763 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99721b7a-6418-4cba-b75b-a6a9f769fedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:40.721034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99721b7a-6418-4cba-b75b-a6a9f769fedd admin admin] PATH_INFO: `/v3/projects/4bb538eb33ac4997a48d4d72150fc287/users/e8bc7171224c4dc38f8c43bce4cd5144/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:40.736260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99721b7a-6418-4cba-b75b-a6a9f769fedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb538eb33ac4997a48d4d72150fc287, user_id=e8bc7171224c4dc38f8c43bce4cd5144, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:40.738961 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99721b7a-6418-4cba-b75b-a6a9f769fedd admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:40.834793 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1201/2390] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:37:40 2022] PUT /identity/v3/projects/4bb538eb33ac4997a48d4d72150fc287/users/e8bc7171224c4dc38f8c43bce4cd5144/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:37:40.846291 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b78afc-d297-49f3-8437-b75566170ed5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:40.846578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b78afc-d297-49f3-8437-b75566170ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:40.846851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b78afc-d297-49f3-8437-b75566170ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:40.876261 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-46b78afc-d297-49f3-8437-b75566170ed5 None None] MFA Rules not processed for user `e8bc7171224c4dc38f8c43bce4cd5144`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:40.877484 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-46b78afc-d297-49f3-8437-b75566170ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:40.898750 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:40.959384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1190/2391] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:37:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:37:40.960005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99721b7a-6418-4cba-b75b-a6a9f769fedd admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:41.028851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99721b7a-6418-4cba-b75b-a6a9f769fedd admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:41.033641 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77fd9f-24dd-4d4e-84ea-3e4ef554b4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:41.034428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77fd9f-24dd-4d4e-84ea-3e4ef554b4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:41.034791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77fd9f-24dd-4d4e-84ea-3e4ef554b4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:41.035093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77fd9f-24dd-4d4e-84ea-3e4ef554b4f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:41.035730 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77fd9f-24dd-4d4e-84ea-3e4ef554b4f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:41.037668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77fd9f-24dd-4d4e-84ea-3e4ef554b4f0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:41.133876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1202/2392] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:37:40 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:37:41.138126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b78afc-d297-49f3-8437-b75566170ed5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:41.150138 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b78afc-d297-49f3-8437-b75566170ed5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:41.208490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9db4a-8bcf-49d9-b891-13141d2898c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:41.209193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9db4a-8bcf-49d9-b891-13141d2898c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:41.209396 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9db4a-8bcf-49d9-b891-13141d2898c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:41.209671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9db4a-8bcf-49d9-b891-13141d2898c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:41.210330 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9db4a-8bcf-49d9-b891-13141d2898c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:41.212627 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9db4a-8bcf-49d9-b891-13141d2898c3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:41.314735 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1191/2393] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:37:41 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:37:41.319418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77fd9f-24dd-4d4e-84ea-3e4ef554b4f0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:41.330421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77fd9f-24dd-4d4e-84ea-3e4ef554b4f0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:41.335287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b64e29-1439-4826-87cc-83c433d9e0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:41.335992 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b64e29-1439-4826-87cc-83c433d9e0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:41.336350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b64e29-1439-4826-87cc-83c433d9e0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:41.336632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b64e29-1439-4826-87cc-83c433d9e0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:41.337275 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b64e29-1439-4826-87cc-83c433d9e0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:41.338911 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b64e29-1439-4826-87cc-83c433d9e0b4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:41.349620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1203/2394] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:37:41.354016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9db4a-8bcf-49d9-b891-13141d2898c3 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:41.364722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9db4a-8bcf-49d9-b891-13141d2898c3 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:41.369447 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b66d2-931e-43ee-8155-152ae4a7a9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:41.370162 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b66d2-931e-43ee-8155-152ae4a7a9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:41.370440 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b66d2-931e-43ee-8155-152ae4a7a9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:41.370776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b66d2-931e-43ee-8155-152ae4a7a9e4 admin admin] PATH_INFO: `/v3/projects/d52b8c4aa44f4252807799cd94e1106f/users/4fc8a84792884753938f665ab98618fa/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:41.386034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b66d2-931e-43ee-8155-152ae4a7a9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52b8c4aa44f4252807799cd94e1106f, user_id=4fc8a84792884753938f665ab98618fa, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:41.388717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b66d2-931e-43ee-8155-152ae4a7a9e4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:41.474307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1192/2395] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:37:41 2022] PUT /identity/v3/projects/d52b8c4aa44f4252807799cd94e1106f/users/4fc8a84792884753938f665ab98618fa/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:37:41.478496 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b64e29-1439-4826-87cc-83c433d9e0b4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:41.488686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b64e29-1439-4826-87cc-83c433d9e0b4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:41.545563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c42c9e-fb76-4168-bb88-02d2088378dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:41.546227 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c42c9e-fb76-4168-bb88-02d2088378dc admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:41.546509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c42c9e-fb76-4168-bb88-02d2088378dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:41.546803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c42c9e-fb76-4168-bb88-02d2088378dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:41.547437 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c42c9e-fb76-4168-bb88-02d2088378dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:41.549042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c42c9e-fb76-4168-bb88-02d2088378dc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:41.550294 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:41.559192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1204/2396] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:37:41.563532 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b66d2-931e-43ee-8155-152ae4a7a9e4 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:41.573974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b66d2-931e-43ee-8155-152ae4a7a9e4 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:41.578595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29149936-ef3f-429a-a06f-1bf98bed0842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:41.579228 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29149936-ef3f-429a-a06f-1bf98bed0842 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:41.579503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29149936-ef3f-429a-a06f-1bf98bed0842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:41.579773 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29149936-ef3f-429a-a06f-1bf98bed0842 admin admin] PATH_INFO: `/v3/projects/d52b8c4aa44f4252807799cd94e1106f/users/4fc8a84792884753938f665ab98618fa/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:41.581638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29149936-ef3f-429a-a06f-1bf98bed0842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52b8c4aa44f4252807799cd94e1106f, user_id=4fc8a84792884753938f665ab98618fa, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:41.584798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29149936-ef3f-429a-a06f-1bf98bed0842 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:41.595416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1193/2397] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:37:41 2022] PUT /identity/v3/projects/d52b8c4aa44f4252807799cd94e1106f/users/4fc8a84792884753938f665ab98618fa/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:41.606182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a45e2c-623d-4435-a626-689ebee1d263 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:41.606466 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a45e2c-623d-4435-a626-689ebee1d263 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:41.606759 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a45e2c-623d-4435-a626-689ebee1d263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:41.634132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-57a45e2c-623d-4435-a626-689ebee1d263 None None] MFA Rules not processed for user `4fc8a84792884753938f665ab98618fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:41.635327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-57a45e2c-623d-4435-a626-689ebee1d263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:41.706907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1205/2398] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:37:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:37:41.716109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29149936-ef3f-429a-a06f-1bf98bed0842 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:41.718025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-29149936-ef3f-429a-a06f-1bf98bed0842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:41.775618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29149936-ef3f-429a-a06f-1bf98bed0842 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:41.779576 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8826c25-208b-4660-b1d3-eda88b1d9655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:41.780180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8826c25-208b-4660-b1d3-eda88b1d9655 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:41.780462 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8826c25-208b-4660-b1d3-eda88b1d9655 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:41.780733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8826c25-208b-4660-b1d3-eda88b1d9655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:41.790022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8826c25-208b-4660-b1d3-eda88b1d9655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:41.791558 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8826c25-208b-4660-b1d3-eda88b1d9655 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:41.801946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1194/2399] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:41.903333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a45e2c-623d-4435-a626-689ebee1d263 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:41.912833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a45e2c-623d-4435-a626-689ebee1d263 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:41.916455 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f3edf-9bd2-4efd-a08e-602b41796883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:41.917052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f3edf-9bd2-4efd-a08e-602b41796883 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:41.917356 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f3edf-9bd2-4efd-a08e-602b41796883 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:41.917625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f3edf-9bd2-4efd-a08e-602b41796883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:41.974621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f3edf-9bd2-4efd-a08e-602b41796883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:41.976109 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f3edf-9bd2-4efd-a08e-602b41796883 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:41.984864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1206/2400] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:45.102815 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8826c25-208b-4660-b1d3-eda88b1d9655 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:45.122954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:45.166350 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8826c25-208b-4660-b1d3-eda88b1d9655 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:45.171161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05e692-b12b-4126-98d5-622b632b6f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:45.171718 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05e692-b12b-4126-98d5-622b632b6f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:45.172019 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05e692-b12b-4126-98d5-622b632b6f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:45.172292 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05e692-b12b-4126-98d5-622b632b6f16 admin admin] PATH_INFO: `/v3/users/e8bc7171224c4dc38f8c43bce4cd5144` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:45.173415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05e692-b12b-4126-98d5-622b632b6f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8bc7171224c4dc38f8c43bce4cd5144)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:45.175357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05e692-b12b-4126-98d5-622b632b6f16 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:45.350338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3e05e692-b12b-4126-98d5-622b632b6f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8bc7171224c4dc38f8c43bce4cd5144'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:45.362587 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3e05e692-b12b-4126-98d5-622b632b6f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8bc7171224c4dc38f8c43bce4cd5144'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:45.369691 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3e05e692-b12b-4126-98d5-622b632b6f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8bc7171224c4dc38f8c43bce4cd5144'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:45.370412 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3e05e692-b12b-4126-98d5-622b632b6f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8bc7171224c4dc38f8c43bce4cd5144'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:45.444114 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3e05e692-b12b-4126-98d5-622b632b6f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8bc7171224c4dc38f8c43bce4cd5144'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:45.450860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1195/2401] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:37:45 2022] DELETE /identity/v3/users/e8bc7171224c4dc38f8c43bce4cd5144 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:45.455411 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073c499-642b-4780-8693-794856c11069 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:45.455879 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073c499-642b-4780-8693-794856c11069 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:45.456022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073c499-642b-4780-8693-794856c11069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:45.476661 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b073c499-642b-4780-8693-794856c11069 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:45.477917 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b073c499-642b-4780-8693-794856c11069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:45.536899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1207/2402] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:37:45.546751 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05e692-b12b-4126-98d5-622b632b6f16 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:45.548206 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3e05e692-b12b-4126-98d5-622b632b6f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:45.607236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05e692-b12b-4126-98d5-622b632b6f16 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:45.611013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ae78b-660b-4b9c-a04c-5a33087b0996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:45.611621 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ae78b-660b-4b9c-a04c-5a33087b0996 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:45.611900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ae78b-660b-4b9c-a04c-5a33087b0996 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:45.612174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ae78b-660b-4b9c-a04c-5a33087b0996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:45.621679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ae78b-660b-4b9c-a04c-5a33087b0996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:45.623139 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ae78b-660b-4b9c-a04c-5a33087b0996 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:45.633574 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1196/2403] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:37:46.179296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073c499-642b-4780-8693-794856c11069 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:46.180963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b073c499-642b-4780-8693-794856c11069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:46.193333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073c499-642b-4780-8693-794856c11069 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:46.198269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2eb48-73ec-4ec7-915f-beb854d737c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:46.203938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2eb48-73ec-4ec7-915f-beb854d737c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:46.203938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2eb48-73ec-4ec7-915f-beb854d737c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:46.203938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2eb48-73ec-4ec7-915f-beb854d737c8 admin admin] PATH_INFO: `/v3/projects/4bb538eb33ac4997a48d4d72150fc287` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:46.203938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2eb48-73ec-4ec7-915f-beb854d737c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb538eb33ac4997a48d4d72150fc287)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:46.203938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2eb48-73ec-4ec7-915f-beb854d737c8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:46.219323 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:46.302573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3eb2eb48-73ec-4ec7-915f-beb854d737c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb538eb33ac4997a48d4d72150fc287', 'request_id': 'req-3eb2eb48-73ec-4ec7-915f-beb854d737c8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:46.399569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3eb2eb48-73ec-4ec7-915f-beb854d737c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb538eb33ac4997a48d4d72150fc287', 'request_id': 'req-3eb2eb48-73ec-4ec7-915f-beb854d737c8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:46.406223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3eb2eb48-73ec-4ec7-915f-beb854d737c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb538eb33ac4997a48d4d72150fc287', 'request_id': 'req-3eb2eb48-73ec-4ec7-915f-beb854d737c8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:46.417242 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3eb2eb48-73ec-4ec7-915f-beb854d737c8 admin admin] The token cache is being invalidate because project 4bb538eb33ac4997a48d4d72150fc287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:37:46.417620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3eb2eb48-73ec-4ec7-915f-beb854d737c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:46.418270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3eb2eb48-73ec-4ec7-915f-beb854d737c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:46.419743 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1208/2404] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:37:46 2022] DELETE /identity/v3/projects/4bb538eb33ac4997a48d4d72150fc287 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:46.423883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ae78b-660b-4b9c-a04c-5a33087b0996 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:46.442936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ae78b-660b-4b9c-a04c-5a33087b0996 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:46.481099 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:46.500161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecf946-395e-4a02-b384-de0902067916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:46.500815 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecf946-395e-4a02-b384-de0902067916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:46.501098 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecf946-395e-4a02-b384-de0902067916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:46.501373 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecf946-395e-4a02-b384-de0902067916 admin admin] PATH_INFO: `/v3/users/4fc8a84792884753938f665ab98618fa` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:46.502554 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecf946-395e-4a02-b384-de0902067916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc8a84792884753938f665ab98618fa)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:46.504496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecf946-395e-4a02-b384-de0902067916 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:46.710871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-54ecf946-395e-4a02-b384-de0902067916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc8a84792884753938f665ab98618fa'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:46.722845 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-54ecf946-395e-4a02-b384-de0902067916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc8a84792884753938f665ab98618fa'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:46.730316 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-54ecf946-395e-4a02-b384-de0902067916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc8a84792884753938f665ab98618fa'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:46.731709 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-54ecf946-395e-4a02-b384-de0902067916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc8a84792884753938f665ab98618fa'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:46.799706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-54ecf946-395e-4a02-b384-de0902067916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc8a84792884753938f665ab98618fa'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:46.806384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1197/2405] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:37:46 2022] DELETE /identity/v3/users/4fc8a84792884753938f665ab98618fa => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:47.524874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2eb48-73ec-4ec7-915f-beb854d737c8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:47.526439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3eb2eb48-73ec-4ec7-915f-beb854d737c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:47.539878 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2eb48-73ec-4ec7-915f-beb854d737c8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:47.597676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36382ee-c4e3-43f8-b679-9c8fe7a6c18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:47.598330 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36382ee-c4e3-43f8-b679-9c8fe7a6c18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:47.598605 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36382ee-c4e3-43f8-b679-9c8fe7a6c18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:47.598872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36382ee-c4e3-43f8-b679-9c8fe7a6c18b admin admin] PATH_INFO: `/v3/projects/d52b8c4aa44f4252807799cd94e1106f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:47.599971 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36382ee-c4e3-43f8-b679-9c8fe7a6c18b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52b8c4aa44f4252807799cd94e1106f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:47.601920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36382ee-c4e3-43f8-b679-9c8fe7a6c18b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:47.697049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b36382ee-c4e3-43f8-b679-9c8fe7a6c18b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52b8c4aa44f4252807799cd94e1106f', 'request_id': 'req-b36382ee-c4e3-43f8-b679-9c8fe7a6c18b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:47.776895 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b36382ee-c4e3-43f8-b679-9c8fe7a6c18b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52b8c4aa44f4252807799cd94e1106f', 'request_id': 'req-b36382ee-c4e3-43f8-b679-9c8fe7a6c18b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:47.783350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b36382ee-c4e3-43f8-b679-9c8fe7a6c18b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52b8c4aa44f4252807799cd94e1106f', 'request_id': 'req-b36382ee-c4e3-43f8-b679-9c8fe7a6c18b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:47.794032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b36382ee-c4e3-43f8-b679-9c8fe7a6c18b admin admin] The token cache is being invalidate because project d52b8c4aa44f4252807799cd94e1106f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:37:47.794315 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b36382ee-c4e3-43f8-b679-9c8fe7a6c18b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:47.794941 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b36382ee-c4e3-43f8-b679-9c8fe7a6c18b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:47.796409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1209/2406] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:37:47 2022] DELETE /identity/v3/projects/d52b8c4aa44f4252807799cd94e1106f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:47.801714 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9003814-6182-44d0-9104-d7777f9fff32 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:47.802236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9003814-6182-44d0-9104-d7777f9fff32 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:47.802585 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9003814-6182-44d0-9104-d7777f9fff32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:47.822780 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c9003814-6182-44d0-9104-d7777f9fff32 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:47.824165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c9003814-6182-44d0-9104-d7777f9fff32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:47.881118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1198/2407] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:37:47.888917 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2113ee-a0ba-43e2-80f0-3cdc221e8ffb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:47.889196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2113ee-a0ba-43e2-80f0-3cdc221e8ffb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:47.889491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2113ee-a0ba-43e2-80f0-3cdc221e8ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:47.909795 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bf2113ee-a0ba-43e2-80f0-3cdc221e8ffb None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:47.911092 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bf2113ee-a0ba-43e2-80f0-3cdc221e8ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:47.920513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1210/2408] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:37:47.924740 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9003814-6182-44d0-9104-d7777f9fff32 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:47.935238 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9003814-6182-44d0-9104-d7777f9fff32 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:47.942231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25ccf7-32aa-499c-851c-82896170f188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:47.942231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25ccf7-32aa-499c-851c-82896170f188 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:47.942231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25ccf7-32aa-499c-851c-82896170f188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:47.942231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25ccf7-32aa-499c-851c-82896170f188 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:47.942629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25ccf7-32aa-499c-851c-82896170f188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:37:47.942629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25ccf7-32aa-499c-851c-82896170f188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:47.943698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25ccf7-32aa-499c-851c-82896170f188 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:47.955201 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1199/2409] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:37:47.959698 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2113ee-a0ba-43e2-80f0-3cdc221e8ffb None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:47.970534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2113ee-a0ba-43e2-80f0-3cdc221e8ffb None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:47.975818 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f61e5-233f-4d71-a84b-1fd2ea63726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:47.976450 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f61e5-233f-4d71-a84b-1fd2ea63726f admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:47.976726 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f61e5-233f-4d71-a84b-1fd2ea63726f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:47.976997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f61e5-233f-4d71-a84b-1fd2ea63726f admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:47.977637 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f61e5-233f-4d71-a84b-1fd2ea63726f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:47.979572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f61e5-233f-4d71-a84b-1fd2ea63726f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:48.105659 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1211/2410] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:37:47 2022] POST /identity/v3/projects => generated 409 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:37:48.114216 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25ccf7-32aa-499c-851c-82896170f188 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:48.121096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25ccf7-32aa-499c-851c-82896170f188 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:48.176684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:48.190314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87bff4e-e325-486a-a782-3fdc3777c7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:48.190925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bff4e-e325-486a-a782-3fdc3777c7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:48.191211 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bff4e-e325-486a-a782-3fdc3777c7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:48.191520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bff4e-e325-486a-a782-3fdc3777c7f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:48.192167 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87bff4e-e325-486a-a782-3fdc3777c7f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:48.194795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87bff4e-e325-486a-a782-3fdc3777c7f8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:48.275393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1200/2411] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:37:48 2022] POST /identity/v3/users => generated 305 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:37:48.276617 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f61e5-233f-4d71-a84b-1fd2ea63726f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:48.283635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:48.287389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f61e5-233f-4d71-a84b-1fd2ea63726f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:48.292315 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b7bf1-73b5-4562-9ca3-5ad83bbbf0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:48.292940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b7bf1-73b5-4562-9ca3-5ad83bbbf0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:48.293217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b7bf1-73b5-4562-9ca3-5ad83bbbf0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:48.293486 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b7bf1-73b5-4562-9ca3-5ad83bbbf0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:48.294194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b7bf1-73b5-4562-9ca3-5ad83bbbf0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:48.295794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b7bf1-73b5-4562-9ca3-5ad83bbbf0a6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:48.306066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1212/2412] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:37:48.310085 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87bff4e-e325-486a-a782-3fdc3777c7f8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:48.320601 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87bff4e-e325-486a-a782-3fdc3777c7f8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:48.325308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91efad9-b4e4-4f75-a686-f3d5c2c07841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:48.325935 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91efad9-b4e4-4f75-a686-f3d5c2c07841 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:48.326219 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91efad9-b4e4-4f75-a686-f3d5c2c07841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:48.326494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91efad9-b4e4-4f75-a686-f3d5c2c07841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:48.327133 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91efad9-b4e4-4f75-a686-f3d5c2c07841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:48.328752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91efad9-b4e4-4f75-a686-f3d5c2c07841 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:48.339141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1201/2413] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:37:48.343282 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b7bf1-73b5-4562-9ca3-5ad83bbbf0a6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:48.353173 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b7bf1-73b5-4562-9ca3-5ad83bbbf0a6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:48.357897 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e5f51-63db-4c85-b321-ee838ee26d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:48.358535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e5f51-63db-4c85-b321-ee838ee26d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:48.358818 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e5f51-63db-4c85-b321-ee838ee26d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:48.359089 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e5f51-63db-4c85-b321-ee838ee26d6f admin admin] PATH_INFO: `/v3/projects/2bb15359a83d4d06957dde5b8d714d85/users/a7a568d7f8ce40b2b5381bd8e8041e11/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:48.373937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e5f51-63db-4c85-b321-ee838ee26d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb15359a83d4d06957dde5b8d714d85, user_id=a7a568d7f8ce40b2b5381bd8e8041e11, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:48.376712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e5f51-63db-4c85-b321-ee838ee26d6f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:48.483823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1213/2414] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:37:48 2022] PUT /identity/v3/projects/2bb15359a83d4d06957dde5b8d714d85/users/a7a568d7f8ce40b2b5381bd8e8041e11/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:37:48.495693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d962c-9adb-4f72-8882-42df07c3d825 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:48.495984 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d962c-9adb-4f72-8882-42df07c3d825 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:48.496266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d962c-9adb-4f72-8882-42df07c3d825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:48.525712 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-794d962c-9adb-4f72-8882-42df07c3d825 None None] MFA Rules not processed for user `a7a568d7f8ce40b2b5381bd8e8041e11`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:48.527040 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-794d962c-9adb-4f72-8882-42df07c3d825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:48.591567 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1202/2415] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:37:48.596001 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e5f51-63db-4c85-b321-ee838ee26d6f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:48.656364 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e5f51-63db-4c85-b321-ee838ee26d6f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:48.661327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb10d0-a6ee-4ce5-9288-b5c13b48d22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:48.661983 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb10d0-a6ee-4ce5-9288-b5c13b48d22b admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:48.662270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb10d0-a6ee-4ce5-9288-b5c13b48d22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:48.662544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb10d0-a6ee-4ce5-9288-b5c13b48d22b admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:48.663189 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb10d0-a6ee-4ce5-9288-b5c13b48d22b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:48.665666 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb10d0-a6ee-4ce5-9288-b5c13b48d22b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:48.744392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1214/2416] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:37:48 2022] POST /identity/v3/projects => generated 409 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:37:48.748599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d962c-9adb-4f72-8882-42df07c3d825 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:48.759019 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d962c-9adb-4f72-8882-42df07c3d825 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:48.813930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde2e72-1551-481b-b2bf-23a5757afd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:48.814593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde2e72-1551-481b-b2bf-23a5757afd95 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:48.814835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde2e72-1551-481b-b2bf-23a5757afd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:48.815105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde2e72-1551-481b-b2bf-23a5757afd95 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:48.815732 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde2e72-1551-481b-b2bf-23a5757afd95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:48.817641 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde2e72-1551-481b-b2bf-23a5757afd95 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:48.920327 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1203/2417] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:37:48 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:37:48.924314 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb10d0-a6ee-4ce5-9288-b5c13b48d22b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:48.934713 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb10d0-a6ee-4ce5-9288-b5c13b48d22b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:48.939290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109d70-142b-4943-9315-3e22a35b407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:48.939882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109d70-142b-4943-9315-3e22a35b407e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:48.940153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109d70-142b-4943-9315-3e22a35b407e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:48.940416 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109d70-142b-4943-9315-3e22a35b407e admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:48.941047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c109d70-142b-4943-9315-3e22a35b407e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:48.942764 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c109d70-142b-4943-9315-3e22a35b407e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:48.953813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1215/2418] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:37:48.957881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde2e72-1551-481b-b2bf-23a5757afd95 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:48.968841 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde2e72-1551-481b-b2bf-23a5757afd95 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:48.973651 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f971ba7-bd3c-412e-b086-26bde9fd33ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:48.974338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f971ba7-bd3c-412e-b086-26bde9fd33ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:48.974641 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f971ba7-bd3c-412e-b086-26bde9fd33ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:48.974920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f971ba7-bd3c-412e-b086-26bde9fd33ee admin admin] PATH_INFO: `/v3/projects/89185055883e4cc6b0f5d5033606a934/users/a24efc2b83a44b308a09fc40f95e03d6/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:48.990480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f971ba7-bd3c-412e-b086-26bde9fd33ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=89185055883e4cc6b0f5d5033606a934, user_id=a24efc2b83a44b308a09fc40f95e03d6, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:48.993213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f971ba7-bd3c-412e-b086-26bde9fd33ee admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:49.056830 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1204/2419] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:37:48 2022] PUT /identity/v3/projects/89185055883e4cc6b0f5d5033606a934/users/a24efc2b83a44b308a09fc40f95e03d6/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:49.061155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109d70-142b-4943-9315-3e22a35b407e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:49.071412 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109d70-142b-4943-9315-3e22a35b407e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:49.127355 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c0b46-143d-440a-8a48-2082d187fcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:49.127958 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c0b46-143d-440a-8a48-2082d187fcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:49.128238 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c0b46-143d-440a-8a48-2082d187fcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:49.128510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c0b46-143d-440a-8a48-2082d187fcc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:49.129141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c0b46-143d-440a-8a48-2082d187fcc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:49.130774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c0b46-143d-440a-8a48-2082d187fcc8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:49.141400 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1216/2420] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:37:49.145659 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f971ba7-bd3c-412e-b086-26bde9fd33ee admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:49.157067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f971ba7-bd3c-412e-b086-26bde9fd33ee admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:49.161844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d9cbb-a043-4484-b864-657b1677bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:49.162597 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d9cbb-a043-4484-b864-657b1677bbd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:49.162940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d9cbb-a043-4484-b864-657b1677bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:49.163278 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d9cbb-a043-4484-b864-657b1677bbd6 admin admin] PATH_INFO: `/v3/projects/89185055883e4cc6b0f5d5033606a934/users/a24efc2b83a44b308a09fc40f95e03d6/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:49.165429 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d9cbb-a043-4484-b864-657b1677bbd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89185055883e4cc6b0f5d5033606a934, user_id=a24efc2b83a44b308a09fc40f95e03d6, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:49.168179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d9cbb-a043-4484-b864-657b1677bbd6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:49.178679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1205/2421] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:37:49 2022] PUT /identity/v3/projects/89185055883e4cc6b0f5d5033606a934/users/a24efc2b83a44b308a09fc40f95e03d6/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:49.188769 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d7d91-7a8b-4fdb-a1ce-b6429c48501a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:49.189050 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d7d91-7a8b-4fdb-a1ce-b6429c48501a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:49.189328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d7d91-7a8b-4fdb-a1ce-b6429c48501a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:49.219127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-267d7d91-7a8b-4fdb-a1ce-b6429c48501a None None] MFA Rules not processed for user `a24efc2b83a44b308a09fc40f95e03d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:49.220306 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-267d7d91-7a8b-4fdb-a1ce-b6429c48501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:49.265137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:49.300031 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1217/2422] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:37:49 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:37:49.314417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d9cbb-a043-4484-b864-657b1677bbd6 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:49.316496 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cb1d9cbb-a043-4484-b864-657b1677bbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:49.331807 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:49.385129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d9cbb-a043-4484-b864-657b1677bbd6 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:49.388907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b05c92-cdd9-4557-8b9c-39bc9c6dc974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:49.389551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b05c92-cdd9-4557-8b9c-39bc9c6dc974 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:49.389863 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b05c92-cdd9-4557-8b9c-39bc9c6dc974 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:49.390164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b05c92-cdd9-4557-8b9c-39bc9c6dc974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:49.401948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b05c92-cdd9-4557-8b9c-39bc9c6dc974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:49.403650 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b05c92-cdd9-4557-8b9c-39bc9c6dc974 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:49.413994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1206/2423] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:49 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:49.802493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d7d91-7a8b-4fdb-a1ce-b6429c48501a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:49.812513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d7d91-7a8b-4fdb-a1ce-b6429c48501a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:49.816200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab801f-09c7-4863-a333-530bfafd20ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:49.816781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab801f-09c7-4863-a333-530bfafd20ba service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:49.817052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab801f-09c7-4863-a333-530bfafd20ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:49.817315 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab801f-09c7-4863-a333-530bfafd20ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:49.879108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab801f-09c7-4863-a333-530bfafd20ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:49.880654 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab801f-09c7-4863-a333-530bfafd20ba service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:49.889657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1218/2424] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:49 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:37:57.010464 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b05c92-cdd9-4557-8b9c-39bc9c6dc974 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:57.076678 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b05c92-cdd9-4557-8b9c-39bc9c6dc974 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:57.081290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dd651-d01b-4494-8d36-e45790cacb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:57.081949 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dd651-d01b-4494-8d36-e45790cacb7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:57.082229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dd651-d01b-4494-8d36-e45790cacb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:57.082497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dd651-d01b-4494-8d36-e45790cacb7d admin admin] PATH_INFO: `/v3/users/a7a568d7f8ce40b2b5381bd8e8041e11` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:57.083900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98dd651-d01b-4494-8d36-e45790cacb7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a568d7f8ce40b2b5381bd8e8041e11)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:57.085908 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98dd651-d01b-4494-8d36-e45790cacb7d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:57.294026 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e98dd651-d01b-4494-8d36-e45790cacb7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a568d7f8ce40b2b5381bd8e8041e11'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:57.306827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e98dd651-d01b-4494-8d36-e45790cacb7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a568d7f8ce40b2b5381bd8e8041e11'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:57.313598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e98dd651-d01b-4494-8d36-e45790cacb7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a568d7f8ce40b2b5381bd8e8041e11'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:57.317338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e98dd651-d01b-4494-8d36-e45790cacb7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a568d7f8ce40b2b5381bd8e8041e11'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:57.417836 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e98dd651-d01b-4494-8d36-e45790cacb7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a568d7f8ce40b2b5381bd8e8041e11'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:57.424968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1207/2425] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:37:57 2022] DELETE /identity/v3/users/a7a568d7f8ce40b2b5381bd8e8041e11 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:57.435598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523e2c-844b-4669-a4bb-6101c4ee26fa None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:57.436185 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523e2c-844b-4669-a4bb-6101c4ee26fa None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:57.436389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523e2c-844b-4669-a4bb-6101c4ee26fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:57.456391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ed523e2c-844b-4669-a4bb-6101c4ee26fa None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:57.457714 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ed523e2c-844b-4669-a4bb-6101c4ee26fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:57.518956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1219/2426] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:37:57.529088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dd651-d01b-4494-8d36-e45790cacb7d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:57.530594 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e98dd651-d01b-4494-8d36-e45790cacb7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:57.565425 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:57.588964 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a70648-ace5-4ab7-9fb1-c9eb86793693 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:57.589247 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a70648-ace5-4ab7-9fb1-c9eb86793693 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:57.589521 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a70648-ace5-4ab7-9fb1-c9eb86793693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:57.593918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dd651-d01b-4494-8d36-e45790cacb7d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:57.597783 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695b8ca-9983-4731-99f8-934a27e6560a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:57.599366 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695b8ca-9983-4731-99f8-934a27e6560a service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:57.599716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695b8ca-9983-4731-99f8-934a27e6560a service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:57.600062 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695b8ca-9983-4731-99f8-934a27e6560a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:57.609926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-43a70648-ace5-4ab7-9fb1-c9eb86793693 None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:37:57.618018 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695b8ca-9983-4731-99f8-934a27e6560a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:57.618616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-43a70648-ace5-4ab7-9fb1-c9eb86793693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:57.618714 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695b8ca-9983-4731-99f8-934a27e6560a service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:57.624347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1208/2427] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:57.676191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1220/2428] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Sep 23 15:37:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:37:57.706112 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695b8ca-9983-4731-99f8-934a27e6560a service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:57.707971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6695b8ca-9983-4731-99f8-934a27e6560a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:57.832470 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695b8ca-9983-4731-99f8-934a27e6560a service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:57.840564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e452a-e771-4c93-9cba-3e8ad0414cfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:57.841314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e452a-e771-4c93-9cba-3e8ad0414cfc service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:57.841822 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e452a-e771-4c93-9cba-3e8ad0414cfc service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:57.842213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e452a-e771-4c93-9cba-3e8ad0414cfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:57.844365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-887e452a-e771-4c93-9cba-3e8ad0414cfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:57.859241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e452a-e771-4c93-9cba-3e8ad0414cfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:57.862280 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e452a-e771-4c93-9cba-3e8ad0414cfc service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:57.880450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1209/2429] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:57.880742 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a70648-ace5-4ab7-9fb1-c9eb86793693 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:57.883665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-43a70648-ace5-4ab7-9fb1-c9eb86793693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:57.902336 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:58.038112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a70648-ace5-4ab7-9fb1-c9eb86793693 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:58.045376 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef82ca-33f0-4a11-a2ef-f67149830d54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:58.046114 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef82ca-33f0-4a11-a2ef-f67149830d54 service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:58.046493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef82ca-33f0-4a11-a2ef-f67149830d54 service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:58.046839 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef82ca-33f0-4a11-a2ef-f67149830d54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:58.056558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef82ca-33f0-4a11-a2ef-f67149830d54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:58.059634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef82ca-33f0-4a11-a2ef-f67149830d54 service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:58.068699 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1221/2430] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:37:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 15:37:58.222025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e452a-e771-4c93-9cba-3e8ad0414cfc service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:58.225663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-887e452a-e771-4c93-9cba-3e8ad0414cfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:58.246601 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e452a-e771-4c93-9cba-3e8ad0414cfc service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:58.253383 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89222f33-ec22-4393-bf4c-e5af51b04717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:58.254075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89222f33-ec22-4393-bf4c-e5af51b04717 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:58.254550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89222f33-ec22-4393-bf4c-e5af51b04717 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:58.255001 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89222f33-ec22-4393-bf4c-e5af51b04717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:58.257056 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-89222f33-ec22-4393-bf4c-e5af51b04717 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:58.283227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89222f33-ec22-4393-bf4c-e5af51b04717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:58.284986 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89222f33-ec22-4393-bf4c-e5af51b04717 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:58.309841 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef82ca-33f0-4a11-a2ef-f67149830d54 service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:58.311476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-30ef82ca-33f0-4a11-a2ef-f67149830d54 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:58.321545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1210/2431] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:37:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:37:58.341915 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef82ca-33f0-4a11-a2ef-f67149830d54 service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:58.360475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:58.361461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:58.361769 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:58.362047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b admin admin] PATH_INFO: `/v3/projects/2bb15359a83d4d06957dde5b8d714d85` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:58.365901 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb15359a83d4d06957dde5b8d714d85)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:58.370383 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:58.569625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb15359a83d4d06957dde5b8d714d85', 'request_id': 'req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:58.695565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb15359a83d4d06957dde5b8d714d85', 'request_id': 'req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:58.702616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb15359a83d4d06957dde5b8d714d85', 'request_id': 'req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:58.717090 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b admin admin] The token cache is being invalidate because project 2bb15359a83d4d06957dde5b8d714d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:37:58.717425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:58.718145 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:58.719972 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1222/2432] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:37:58 2022] DELETE /identity/v3/projects/2bb15359a83d4d06957dde5b8d714d85 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:58.724451 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89222f33-ec22-4393-bf4c-e5af51b04717 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:58.736563 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89222f33-ec22-4393-bf4c-e5af51b04717 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:58.868672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19a969-3162-49aa-9687-e12594b8782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:58.869757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19a969-3162-49aa-9687-e12594b8782b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:58.870284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19a969-3162-49aa-9687-e12594b8782b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:58.870654 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19a969-3162-49aa-9687-e12594b8782b admin admin] PATH_INFO: `/v3/users/a24efc2b83a44b308a09fc40f95e03d6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:58.871949 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19a969-3162-49aa-9687-e12594b8782b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a24efc2b83a44b308a09fc40f95e03d6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:58.874486 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19a969-3162-49aa-9687-e12594b8782b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:59.098001 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:37:59.103929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-df19a969-3162-49aa-9687-e12594b8782b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a24efc2b83a44b308a09fc40f95e03d6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:59.146898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-df19a969-3162-49aa-9687-e12594b8782b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a24efc2b83a44b308a09fc40f95e03d6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:59.160461 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-df19a969-3162-49aa-9687-e12594b8782b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a24efc2b83a44b308a09fc40f95e03d6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:59.163535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-df19a969-3162-49aa-9687-e12594b8782b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a24efc2b83a44b308a09fc40f95e03d6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:59.285660 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-df19a969-3162-49aa-9687-e12594b8782b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a24efc2b83a44b308a09fc40f95e03d6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:37:59.298410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1211/2433] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:37:58 2022] DELETE /identity/v3/users/a24efc2b83a44b308a09fc40f95e03d6 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:37:59.777432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:37:59.779168 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:37:59.820524 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32c5ff-ab6b-4c65-aaf9-a474d952826b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:37:59.884857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68456803-761a-4170-a246-52866faacfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:37:59.885857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68456803-761a-4170-a246-52866faacfd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:37:59.886134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68456803-761a-4170-a246-52866faacfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:37:59.886574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68456803-761a-4170-a246-52866faacfd1 admin admin] PATH_INFO: `/v3/projects/89185055883e4cc6b0f5d5033606a934` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:37:59.887708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68456803-761a-4170-a246-52866faacfd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89185055883e4cc6b0f5d5033606a934)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:37:59.889692 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68456803-761a-4170-a246-52866faacfd1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:37:59.916170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:00.001665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-68456803-761a-4170-a246-52866faacfd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89185055883e4cc6b0f5d5033606a934', 'request_id': 'req-68456803-761a-4170-a246-52866faacfd1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:00.057519 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-68456803-761a-4170-a246-52866faacfd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89185055883e4cc6b0f5d5033606a934', 'request_id': 'req-68456803-761a-4170-a246-52866faacfd1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:00.065174 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-68456803-761a-4170-a246-52866faacfd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89185055883e4cc6b0f5d5033606a934', 'request_id': 'req-68456803-761a-4170-a246-52866faacfd1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:00.079048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-68456803-761a-4170-a246-52866faacfd1 admin admin] The token cache is being invalidate because project 89185055883e4cc6b0f5d5033606a934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:38:00.079557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-68456803-761a-4170-a246-52866faacfd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:00.080382 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-68456803-761a-4170-a246-52866faacfd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:00.082279 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1223/2434] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:37:59 2022] DELETE /identity/v3/projects/89185055883e4cc6b0f5d5033606a934 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:00.090261 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abca3e-06bb-478a-9303-eda7961ff460 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:00.090545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abca3e-06bb-478a-9303-eda7961ff460 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:00.090816 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abca3e-06bb-478a-9303-eda7961ff460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:00.113288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-97abca3e-06bb-478a-9303-eda7961ff460 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:00.114690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-97abca3e-06bb-478a-9303-eda7961ff460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:00.187038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1212/2435] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:00.196523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13528d8-d84b-41a9-b811-7fa755af447f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:00.196829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13528d8-d84b-41a9-b811-7fa755af447f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:00.197103 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13528d8-d84b-41a9-b811-7fa755af447f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:00.224392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c13528d8-d84b-41a9-b811-7fa755af447f None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:00.225613 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c13528d8-d84b-41a9-b811-7fa755af447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:00.237775 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1224/2436] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:00.239867 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abca3e-06bb-478a-9303-eda7961ff460 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:00.253949 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abca3e-06bb-478a-9303-eda7961ff460 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:00.259529 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4e43c-0767-481a-b325-d2b2ec15d017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:00.260020 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4e43c-0767-481a-b325-d2b2ec15d017 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:00.260298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4e43c-0767-481a-b325-d2b2ec15d017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:00.260913 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4e43c-0767-481a-b325-d2b2ec15d017 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:00.261698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4e43c-0767-481a-b325-d2b2ec15d017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:38:00.262033 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4e43c-0767-481a-b325-d2b2ec15d017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:00.263667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4e43c-0767-481a-b325-d2b2ec15d017 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:00.285396 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1213/2437] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:38:00.286658 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13528d8-d84b-41a9-b811-7fa755af447f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:00.297346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13528d8-d84b-41a9-b811-7fa755af447f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:00.308135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dfc92-215d-4558-ad57-a7edafbc3867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:00.308756 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dfc92-215d-4558-ad57-a7edafbc3867 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:00.309046 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dfc92-215d-4558-ad57-a7edafbc3867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:00.309316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dfc92-215d-4558-ad57-a7edafbc3867 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:00.310005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dfc92-215d-4558-ad57-a7edafbc3867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:00.312160 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dfc92-215d-4558-ad57-a7edafbc3867 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:00.445349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1225/2438] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:38:00 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:00.448314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4e43c-0767-481a-b325-d2b2ec15d017 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:00.462585 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4e43c-0767-481a-b325-d2b2ec15d017 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:00.536630 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313013c9-4dd1-4ab3-91c7-cc35f6335f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:00.537265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313013c9-4dd1-4ab3-91c7-cc35f6335f46 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:00.537554 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313013c9-4dd1-4ab3-91c7-cc35f6335f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:00.537860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313013c9-4dd1-4ab3-91c7-cc35f6335f46 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:00.538513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313013c9-4dd1-4ab3-91c7-cc35f6335f46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:00.541079 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313013c9-4dd1-4ab3-91c7-cc35f6335f46 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:00.652201 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1214/2439] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:38:00 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:00.656585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dfc92-215d-4558-ad57-a7edafbc3867 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:00.667839 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dfc92-215d-4558-ad57-a7edafbc3867 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:00.672936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c02840-70d9-4930-a14e-e525906a6799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:00.673560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c02840-70d9-4930-a14e-e525906a6799 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:00.673906 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c02840-70d9-4930-a14e-e525906a6799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:00.674180 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c02840-70d9-4930-a14e-e525906a6799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:00.674869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c02840-70d9-4930-a14e-e525906a6799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:00.676526 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c02840-70d9-4930-a14e-e525906a6799 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:00.688493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1226/2440] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:00.692591 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313013c9-4dd1-4ab3-91c7-cc35f6335f46 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:00.703996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313013c9-4dd1-4ab3-91c7-cc35f6335f46 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:00.714766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d47b0-9d9f-46f6-82d7-ba98f33d0be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:00.719433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d47b0-9d9f-46f6-82d7-ba98f33d0be7 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:00.719433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d47b0-9d9f-46f6-82d7-ba98f33d0be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:00.719433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d47b0-9d9f-46f6-82d7-ba98f33d0be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:00.719433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d47b0-9d9f-46f6-82d7-ba98f33d0be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:00.719433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d47b0-9d9f-46f6-82d7-ba98f33d0be7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:00.736600 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1215/2441] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:38:00.738015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c02840-70d9-4930-a14e-e525906a6799 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:00.755493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c02840-70d9-4930-a14e-e525906a6799 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:00.760664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de4565-ea7c-4517-9d4c-91df227a906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:00.761326 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de4565-ea7c-4517-9d4c-91df227a906f admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:00.761611 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de4565-ea7c-4517-9d4c-91df227a906f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:00.761930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de4565-ea7c-4517-9d4c-91df227a906f admin admin] PATH_INFO: `/v3/projects/7c9e8d0e83244941ad5eff013d678959/users/cd2c8044813e49b5ab0aa6f1016092a2/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:00.783238 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de4565-ea7c-4517-9d4c-91df227a906f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9e8d0e83244941ad5eff013d678959, user_id=cd2c8044813e49b5ab0aa6f1016092a2, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:00.786691 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de4565-ea7c-4517-9d4c-91df227a906f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:00.856767 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1227/2442] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:00 2022] PUT /identity/v3/projects/7c9e8d0e83244941ad5eff013d678959/users/cd2c8044813e49b5ab0aa6f1016092a2/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:38:00.867215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de697f9-9672-40b6-ae3d-8f36b199b909 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:00.867488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de697f9-9672-40b6-ae3d-8f36b199b909 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:00.867760 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de697f9-9672-40b6-ae3d-8f36b199b909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:00.901589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2de697f9-9672-40b6-ae3d-8f36b199b909 None None] MFA Rules not processed for user `cd2c8044813e49b5ab0aa6f1016092a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:00.903204 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2de697f9-9672-40b6-ae3d-8f36b199b909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:00.927909 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:01.001757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1216/2443] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:01.009963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de4565-ea7c-4517-9d4c-91df227a906f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:01.012094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a2de4565-ea7c-4517-9d4c-91df227a906f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:01.104369 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de4565-ea7c-4517-9d4c-91df227a906f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:01.108379 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11765a9e-62d6-4551-8de6-1882edef6a9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:01.109021 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11765a9e-62d6-4551-8de6-1882edef6a9d service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:01.109317 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11765a9e-62d6-4551-8de6-1882edef6a9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:01.109622 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11765a9e-62d6-4551-8de6-1882edef6a9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:01.119868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11765a9e-62d6-4551-8de6-1882edef6a9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:01.128001 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11765a9e-62d6-4551-8de6-1882edef6a9d service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:01.133497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1228/2444] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:06.217638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de697f9-9672-40b6-ae3d-8f36b199b909 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:06.219170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2de697f9-9672-40b6-ae3d-8f36b199b909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:06.289471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11765a9e-62d6-4551-8de6-1882edef6a9d service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:06.297638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de697f9-9672-40b6-ae3d-8f36b199b909 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:06.302391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa807c8-13a5-4cb0-a3c6-b0ae16b560b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:06.305910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa807c8-13a5-4cb0-a3c6-b0ae16b560b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:06.305910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa807c8-13a5-4cb0-a3c6-b0ae16b560b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:06.305910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa807c8-13a5-4cb0-a3c6-b0ae16b560b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:06.305910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2fa807c8-13a5-4cb0-a3c6-b0ae16b560b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:06.352471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:06.369801 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11765a9e-62d6-4551-8de6-1882edef6a9d service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:06.374697 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86419880-899c-4e23-9c74-6b198d5fb8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:06.375290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86419880-899c-4e23-9c74-6b198d5fb8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:06.375574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86419880-899c-4e23-9c74-6b198d5fb8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:06.378201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86419880-899c-4e23-9c74-6b198d5fb8e7 admin admin] PATH_INFO: `/v3/users/cd2c8044813e49b5ab0aa6f1016092a2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:06.378201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86419880-899c-4e23-9c74-6b198d5fb8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2c8044813e49b5ab0aa6f1016092a2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:06.380196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86419880-899c-4e23-9c74-6b198d5fb8e7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:06.387140 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa807c8-13a5-4cb0-a3c6-b0ae16b560b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:06.388804 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa807c8-13a5-4cb0-a3c6-b0ae16b560b4 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:06.402701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1217/2445] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:06.630916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-86419880-899c-4e23-9c74-6b198d5fb8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2c8044813e49b5ab0aa6f1016092a2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:06.666902 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-86419880-899c-4e23-9c74-6b198d5fb8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2c8044813e49b5ab0aa6f1016092a2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:06.676954 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-86419880-899c-4e23-9c74-6b198d5fb8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2c8044813e49b5ab0aa6f1016092a2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:06.678139 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-86419880-899c-4e23-9c74-6b198d5fb8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2c8044813e49b5ab0aa6f1016092a2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:06.761111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-86419880-899c-4e23-9c74-6b198d5fb8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2c8044813e49b5ab0aa6f1016092a2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:06.771068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1229/2446] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:38:06 2022] DELETE /identity/v3/users/cd2c8044813e49b5ab0aa6f1016092a2 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:38:06.772699 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338174e7-d980-4481-8543-cb62c72b57d3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:06.772988 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338174e7-d980-4481-8543-cb62c72b57d3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:06.773272 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338174e7-d980-4481-8543-cb62c72b57d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:06.802448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-338174e7-d980-4481-8543-cb62c72b57d3 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:06.804629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-338174e7-d980-4481-8543-cb62c72b57d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:06.889375 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1218/2447] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:06.899046 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86419880-899c-4e23-9c74-6b198d5fb8e7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:06.901219 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-86419880-899c-4e23-9c74-6b198d5fb8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:06.977373 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86419880-899c-4e23-9c74-6b198d5fb8e7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:06.982167 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fb126-a745-4cf0-967b-7bccefe44c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:06.982751 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fb126-a745-4cf0-967b-7bccefe44c50 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:06.983022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fb126-a745-4cf0-967b-7bccefe44c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:06.983289 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fb126-a745-4cf0-967b-7bccefe44c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:06.994869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fb126-a745-4cf0-967b-7bccefe44c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:06.996115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fb126-a745-4cf0-967b-7bccefe44c50 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:07.006706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1230/2448] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:07.518648 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338174e7-d980-4481-8543-cb62c72b57d3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:07.520034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-338174e7-d980-4481-8543-cb62c72b57d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:07.539502 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338174e7-d980-4481-8543-cb62c72b57d3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:07.553440 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf5ef7-2d3e-44d8-a309-60cf797139bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:07.554121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf5ef7-2d3e-44d8-a309-60cf797139bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:07.554399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf5ef7-2d3e-44d8-a309-60cf797139bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:07.554669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf5ef7-2d3e-44d8-a309-60cf797139bf admin admin] PATH_INFO: `/v3/projects/7c9e8d0e83244941ad5eff013d678959` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:07.556916 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf5ef7-2d3e-44d8-a309-60cf797139bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9e8d0e83244941ad5eff013d678959)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:07.559618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf5ef7-2d3e-44d8-a309-60cf797139bf admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:07.563967 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:07.697703 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cadf5ef7-2d3e-44d8-a309-60cf797139bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9e8d0e83244941ad5eff013d678959', 'request_id': 'req-cadf5ef7-2d3e-44d8-a309-60cf797139bf'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:07.824307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cadf5ef7-2d3e-44d8-a309-60cf797139bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9e8d0e83244941ad5eff013d678959', 'request_id': 'req-cadf5ef7-2d3e-44d8-a309-60cf797139bf'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:07.833455 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cadf5ef7-2d3e-44d8-a309-60cf797139bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9e8d0e83244941ad5eff013d678959', 'request_id': 'req-cadf5ef7-2d3e-44d8-a309-60cf797139bf'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:07.846254 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cadf5ef7-2d3e-44d8-a309-60cf797139bf admin admin] The token cache is being invalidate because project 7c9e8d0e83244941ad5eff013d678959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:38:07.846694 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cadf5ef7-2d3e-44d8-a309-60cf797139bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:07.847387 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cadf5ef7-2d3e-44d8-a309-60cf797139bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:07.849120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1219/2449] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:38:07 2022] DELETE /identity/v3/projects/7c9e8d0e83244941ad5eff013d678959 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:07.856391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8636c-fbb6-4a7b-9812-1b8a161a6851 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:07.857096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8636c-fbb6-4a7b-9812-1b8a161a6851 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:07.857096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8636c-fbb6-4a7b-9812-1b8a161a6851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:07.892826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9be8636c-fbb6-4a7b-9812-1b8a161a6851 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:07.894159 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9be8636c-fbb6-4a7b-9812-1b8a161a6851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:08.001228 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1231/2450] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:08.008931 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6011b2-bd5f-4b62-8160-4c2926d1acae None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:08.009497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6011b2-bd5f-4b62-8160-4c2926d1acae None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:08.010001 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6011b2-bd5f-4b62-8160-4c2926d1acae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:08.032952 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-dd6011b2-bd5f-4b62-8160-4c2926d1acae None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:08.034218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dd6011b2-bd5f-4b62-8160-4c2926d1acae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:08.046751 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1220/2451] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:38:08.047957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8636c-fbb6-4a7b-9812-1b8a161a6851 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:08.062123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8636c-fbb6-4a7b-9812-1b8a161a6851 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:08.071758 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9f001-a96d-4baf-b9d6-a88b5ced52fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:08.120829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9f001-a96d-4baf-b9d6-a88b5ced52fb admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:08.120829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9f001-a96d-4baf-b9d6-a88b5ced52fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:08.120829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9f001-a96d-4baf-b9d6-a88b5ced52fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:08.120829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9f001-a96d-4baf-b9d6-a88b5ced52fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:38:08.120829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9f001-a96d-4baf-b9d6-a88b5ced52fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:08.120829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9f001-a96d-4baf-b9d6-a88b5ced52fb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:08.121991 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:08.121991 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1232/2452] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:38:08.122178 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6011b2-bd5f-4b62-8160-4c2926d1acae None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:08.124877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6011b2-bd5f-4b62-8160-4c2926d1acae None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:08.130322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd2bbf-da76-47e1-bbc0-5dd44c65dbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:08.131120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd2bbf-da76-47e1-bbc0-5dd44c65dbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:08.131571 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd2bbf-da76-47e1-bbc0-5dd44c65dbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:08.131996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd2bbf-da76-47e1-bbc0-5dd44c65dbd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:08.132994 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd2bbf-da76-47e1-bbc0-5dd44c65dbd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:08.135289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd2bbf-da76-47e1-bbc0-5dd44c65dbd8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:08.645768 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1221/2453] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:38:08 2022] POST /identity/v3/projects => generated 399 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:08.648402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9f001-a96d-4baf-b9d6-a88b5ced52fb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:08.660241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9f001-a96d-4baf-b9d6-a88b5ced52fb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:08.731655 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfeb16-6910-41a9-865c-d4dec1d40f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:08.732585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfeb16-6910-41a9-865c-d4dec1d40f11 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:08.733077 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfeb16-6910-41a9-865c-d4dec1d40f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:08.733761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfeb16-6910-41a9-865c-d4dec1d40f11 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:08.734756 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfeb16-6910-41a9-865c-d4dec1d40f11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:08.736912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfeb16-6910-41a9-865c-d4dec1d40f11 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:08.847374 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1233/2454] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:38:08 2022] POST /identity/v3/users => generated 300 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:38:08.848831 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd2bbf-da76-47e1-bbc0-5dd44c65dbd8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:08.862699 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd2bbf-da76-47e1-bbc0-5dd44c65dbd8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:08.877019 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb4ae9-2458-40d7-9f31-ece2cc05d41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:08.877769 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb4ae9-2458-40d7-9f31-ece2cc05d41c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:08.878124 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb4ae9-2458-40d7-9f31-ece2cc05d41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:08.878472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb4ae9-2458-40d7-9f31-ece2cc05d41c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:08.879209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb4ae9-2458-40d7-9f31-ece2cc05d41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:08.880903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb4ae9-2458-40d7-9f31-ece2cc05d41c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:08.917208 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1222/2455] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:08.922195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfeb16-6910-41a9-865c-d4dec1d40f11 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:08.937158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfeb16-6910-41a9-865c-d4dec1d40f11 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:08.947603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f742e-4a64-4c3e-ac7d-7764adfaa7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:08.950141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f742e-4a64-4c3e-ac7d-7764adfaa7ab admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:08.950660 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f742e-4a64-4c3e-ac7d-7764adfaa7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:08.951103 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f742e-4a64-4c3e-ac7d-7764adfaa7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:08.952122 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f742e-4a64-4c3e-ac7d-7764adfaa7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:08.954497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f742e-4a64-4c3e-ac7d-7764adfaa7ab admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:08.989281 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1234/2456] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:08.991610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb4ae9-2458-40d7-9f31-ece2cc05d41c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:09.019843 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb4ae9-2458-40d7-9f31-ece2cc05d41c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:09.028739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1ba4f-7816-4cc7-bccb-088e8489b8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:09.029599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1ba4f-7816-4cc7-bccb-088e8489b8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:09.030182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1ba4f-7816-4cc7-bccb-088e8489b8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:09.031441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1ba4f-7816-4cc7-bccb-088e8489b8e7 admin admin] PATH_INFO: `/v3/projects/13c437280ac940ed98072a3dab732cb9/users/09d633bc5aed441daad5b9bf30455e9f/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:09.066128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1ba4f-7816-4cc7-bccb-088e8489b8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c437280ac940ed98072a3dab732cb9, user_id=09d633bc5aed441daad5b9bf30455e9f, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:09.069123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1ba4f-7816-4cc7-bccb-088e8489b8e7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:09.151299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1223/2457] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:08 2022] PUT /identity/v3/projects/13c437280ac940ed98072a3dab732cb9/users/09d633bc5aed441daad5b9bf30455e9f/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:09.167860 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c67ae-23aa-4ec9-a0f3-55c2162002b2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:09.168506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c67ae-23aa-4ec9-a0f3-55c2162002b2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:09.168999 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c67ae-23aa-4ec9-a0f3-55c2162002b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:09.266454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b10c67ae-23aa-4ec9-a0f3-55c2162002b2 None None] MFA Rules not processed for user `09d633bc5aed441daad5b9bf30455e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:09.269424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b10c67ae-23aa-4ec9-a0f3-55c2162002b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:09.397774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1235/2458] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:09.411035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1ba4f-7816-4cc7-bccb-088e8489b8e7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:09.414262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-90c1ba4f-7816-4cc7-bccb-088e8489b8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:09.474948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1ba4f-7816-4cc7-bccb-088e8489b8e7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:09.479680 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410aee99-0a7b-4a08-9a9b-70cfabc9985a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:09.480293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aee99-0a7b-4a08-9a9b-70cfabc9985a service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:09.480614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aee99-0a7b-4a08-9a9b-70cfabc9985a service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:09.480928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aee99-0a7b-4a08-9a9b-70cfabc9985a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:09.490396 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410aee99-0a7b-4a08-9a9b-70cfabc9985a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:09.492426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410aee99-0a7b-4a08-9a9b-70cfabc9985a service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:09.505182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1224/2459] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:10.898403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c67ae-23aa-4ec9-a0f3-55c2162002b2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:10.902449 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b10c67ae-23aa-4ec9-a0f3-55c2162002b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:10.982092 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c67ae-23aa-4ec9-a0f3-55c2162002b2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:10.986865 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a680df9-0178-41d8-95c9-66c31b627261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:10.987740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a680df9-0178-41d8-95c9-66c31b627261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:10.987937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a680df9-0178-41d8-95c9-66c31b627261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:10.988256 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a680df9-0178-41d8-95c9-66c31b627261 admin admin] PATH_INFO: `/v3/users/916f85e42444497ca4d4993f233d63c2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:10.989331 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a680df9-0178-41d8-95c9-66c31b627261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=916f85e42444497ca4d4993f233d63c2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:10.992259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a680df9-0178-41d8-95c9-66c31b627261 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:11.003608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:11.226698 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4a680df9-0178-41d8-95c9-66c31b627261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '916f85e42444497ca4d4993f233d63c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:11.239720 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4a680df9-0178-41d8-95c9-66c31b627261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '916f85e42444497ca4d4993f233d63c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:11.246691 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4a680df9-0178-41d8-95c9-66c31b627261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '916f85e42444497ca4d4993f233d63c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:11.247400 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4a680df9-0178-41d8-95c9-66c31b627261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '916f85e42444497ca4d4993f233d63c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:11.303516 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4a680df9-0178-41d8-95c9-66c31b627261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '916f85e42444497ca4d4993f233d63c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:11.309812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1236/2460] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:38:10 2022] DELETE /identity/v3/users/916f85e42444497ca4d4993f233d63c2 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:11.565633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410aee99-0a7b-4a08-9a9b-70cfabc9985a service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:11.580507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410aee99-0a7b-4a08-9a9b-70cfabc9985a service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:11.614388 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:11.643958 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93486cb2-77a6-4820-9331-595d70a2c3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:11.644696 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93486cb2-77a6-4820-9331-595d70a2c3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:11.644971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93486cb2-77a6-4820-9331-595d70a2c3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:11.645296 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93486cb2-77a6-4820-9331-595d70a2c3c7 admin admin] PATH_INFO: `/v3/projects/d5836149591f474ca4d0590f6b54aeb6` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:11.646793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93486cb2-77a6-4820-9331-595d70a2c3c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5836149591f474ca4d0590f6b54aeb6)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:11.648866 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93486cb2-77a6-4820-9331-595d70a2c3c7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:11.798259 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-93486cb2-77a6-4820-9331-595d70a2c3c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5836149591f474ca4d0590f6b54aeb6', 'request_id': 'req-93486cb2-77a6-4820-9331-595d70a2c3c7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:11.912210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-93486cb2-77a6-4820-9331-595d70a2c3c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5836149591f474ca4d0590f6b54aeb6', 'request_id': 'req-93486cb2-77a6-4820-9331-595d70a2c3c7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:11.922330 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-93486cb2-77a6-4820-9331-595d70a2c3c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5836149591f474ca4d0590f6b54aeb6', 'request_id': 'req-93486cb2-77a6-4820-9331-595d70a2c3c7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:11.929470 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-93486cb2-77a6-4820-9331-595d70a2c3c7 admin admin] The token cache is being invalidate because project d5836149591f474ca4d0590f6b54aeb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:38:11.929786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-93486cb2-77a6-4820-9331-595d70a2c3c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:11.930444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-93486cb2-77a6-4820-9331-595d70a2c3c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:11.932513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1225/2461] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:38:11 2022] DELETE /identity/v3/projects/d5836149591f474ca4d0590f6b54aeb6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:11.937421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc0a45-2148-4ff3-bbed-fe08c5d034df None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:11.937930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc0a45-2148-4ff3-bbed-fe08c5d034df None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:11.938043 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc0a45-2148-4ff3-bbed-fe08c5d034df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:11.966740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b3cc0a45-2148-4ff3-bbed-fe08c5d034df None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:11.968170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b3cc0a45-2148-4ff3-bbed-fe08c5d034df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:12.033001 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1237/2462] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:12.040983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2040b-1b3d-48af-87b3-2980f8e519da None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:12.041311 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2040b-1b3d-48af-87b3-2980f8e519da None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:12.041590 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2040b-1b3d-48af-87b3-2980f8e519da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:12.061363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-77f2040b-1b3d-48af-87b3-2980f8e519da None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:12.062638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-77f2040b-1b3d-48af-87b3-2980f8e519da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:12.070876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1226/2463] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:12.075809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc0a45-2148-4ff3-bbed-fe08c5d034df None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:12.085246 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc0a45-2148-4ff3-bbed-fe08c5d034df None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:12.089890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165602a3-1a72-42b2-a1d5-712d204d7273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:12.090478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165602a3-1a72-42b2-a1d5-712d204d7273 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:12.090756 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165602a3-1a72-42b2-a1d5-712d204d7273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:12.091025 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165602a3-1a72-42b2-a1d5-712d204d7273 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:12.091654 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165602a3-1a72-42b2-a1d5-712d204d7273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:38:12.091951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165602a3-1a72-42b2-a1d5-712d204d7273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:12.093535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165602a3-1a72-42b2-a1d5-712d204d7273 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:12.105260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1238/2464] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:38:12.109586 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2040b-1b3d-48af-87b3-2980f8e519da None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:12.119081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2040b-1b3d-48af-87b3-2980f8e519da None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:12.123648 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4dfb6-1001-4612-b6f0-90d0de2cf5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:12.124232 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4dfb6-1001-4612-b6f0-90d0de2cf5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:12.124505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4dfb6-1001-4612-b6f0-90d0de2cf5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:12.124774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4dfb6-1001-4612-b6f0-90d0de2cf5e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:12.125403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4dfb6-1001-4612-b6f0-90d0de2cf5e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:12.127292 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4dfb6-1001-4612-b6f0-90d0de2cf5e1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:12.255999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1227/2465] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:38:12 2022] POST /identity/v3/projects => generated 363 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:12.260886 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165602a3-1a72-42b2-a1d5-712d204d7273 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:12.271145 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165602a3-1a72-42b2-a1d5-712d204d7273 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:12.328318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957b6ad-90e7-4fbc-91c0-f4819e87ef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:12.328922 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957b6ad-90e7-4fbc-91c0-f4819e87ef8f admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:12.329201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957b6ad-90e7-4fbc-91c0-f4819e87ef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:12.329475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957b6ad-90e7-4fbc-91c0-f4819e87ef8f admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:12.330132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957b6ad-90e7-4fbc-91c0-f4819e87ef8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:12.332115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957b6ad-90e7-4fbc-91c0-f4819e87ef8f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:12.423535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1239/2466] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:38:12 2022] POST /identity/v3/users => generated 282 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:12.430751 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4dfb6-1001-4612-b6f0-90d0de2cf5e1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:12.441810 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4dfb6-1001-4612-b6f0-90d0de2cf5e1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:12.446524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3f700-5d92-4ba3-9691-453c31154b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:12.447144 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3f700-5d92-4ba3-9691-453c31154b26 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:12.447461 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3f700-5d92-4ba3-9691-453c31154b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:12.447738 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3f700-5d92-4ba3-9691-453c31154b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:12.448379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3f700-5d92-4ba3-9691-453c31154b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:12.450044 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3f700-5d92-4ba3-9691-453c31154b26 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:12.460746 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1228/2467] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:12.465081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957b6ad-90e7-4fbc-91c0-f4819e87ef8f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:12.472547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:12.476461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957b6ad-90e7-4fbc-91c0-f4819e87ef8f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:12.481698 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a09fb1-0cab-4496-9cfe-13c7494be074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:12.482318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a09fb1-0cab-4496-9cfe-13c7494be074 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:12.482590 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a09fb1-0cab-4496-9cfe-13c7494be074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:12.482855 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a09fb1-0cab-4496-9cfe-13c7494be074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:12.483517 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a09fb1-0cab-4496-9cfe-13c7494be074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:12.485106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a09fb1-0cab-4496-9cfe-13c7494be074 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:12.496051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1240/2468] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:12.500568 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3f700-5d92-4ba3-9691-453c31154b26 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:12.510606 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3f700-5d92-4ba3-9691-453c31154b26 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:12.515249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15214cf5-ad1f-46b5-9890-7022a4407909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:12.515884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15214cf5-ad1f-46b5-9890-7022a4407909 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:12.516162 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15214cf5-ad1f-46b5-9890-7022a4407909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:12.516430 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15214cf5-ad1f-46b5-9890-7022a4407909 admin admin] PATH_INFO: `/v3/projects/c737eac497dd44c381098604e7560912/users/a1710859b52d484186878de9f844affa/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:12.530946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15214cf5-ad1f-46b5-9890-7022a4407909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c737eac497dd44c381098604e7560912, user_id=a1710859b52d484186878de9f844affa, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:12.536862 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15214cf5-ad1f-46b5-9890-7022a4407909 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:12.626598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1229/2469] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:12 2022] PUT /identity/v3/projects/c737eac497dd44c381098604e7560912/users/a1710859b52d484186878de9f844affa/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:12.640995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4417b7-09d1-4be6-a57b-d6fe256926d8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:12.641282 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4417b7-09d1-4be6-a57b-d6fe256926d8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:12.641559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4417b7-09d1-4be6-a57b-d6fe256926d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:12.669741 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-dd4417b7-09d1-4be6-a57b-d6fe256926d8 None None] MFA Rules not processed for user `a1710859b52d484186878de9f844affa`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:12.671041 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-dd4417b7-09d1-4be6-a57b-d6fe256926d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:12.735115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1241/2470] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:12.739698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15214cf5-ad1f-46b5-9890-7022a4407909 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:12.798123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:12.801811 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15214cf5-ad1f-46b5-9890-7022a4407909 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:12.806517 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c735e-e647-4bee-b74d-40437244e7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:12.807117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c735e-e647-4bee-b74d-40437244e7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:12.807396 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c735e-e647-4bee-b74d-40437244e7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:12.807669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c735e-e647-4bee-b74d-40437244e7d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:12.808289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c735e-e647-4bee-b74d-40437244e7d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:12.810224 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c735e-e647-4bee-b74d-40437244e7d4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:12.886585 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1230/2471] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:38:12 2022] POST /identity/v3/projects => generated 363 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:12.891806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4417b7-09d1-4be6-a57b-d6fe256926d8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:12.902974 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4417b7-09d1-4be6-a57b-d6fe256926d8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:12.958539 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab729e2-a7cf-45bc-9b5c-777af82a87f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:12.959160 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab729e2-a7cf-45bc-9b5c-777af82a87f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:12.959439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab729e2-a7cf-45bc-9b5c-777af82a87f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:12.959711 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab729e2-a7cf-45bc-9b5c-777af82a87f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:12.960355 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab729e2-a7cf-45bc-9b5c-777af82a87f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:12.962341 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab729e2-a7cf-45bc-9b5c-777af82a87f3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:13.046888 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1242/2472] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:38:12 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:13.050681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c735e-e647-4bee-b74d-40437244e7d4 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:13.064347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c735e-e647-4bee-b74d-40437244e7d4 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:13.072495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa05f36-05fd-4280-afb7-23d137e713f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:13.073149 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa05f36-05fd-4280-afb7-23d137e713f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:13.073431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa05f36-05fd-4280-afb7-23d137e713f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:13.073704 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa05f36-05fd-4280-afb7-23d137e713f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:13.074395 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa05f36-05fd-4280-afb7-23d137e713f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:13.075972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa05f36-05fd-4280-afb7-23d137e713f9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:13.089848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1231/2473] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:13.091717 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab729e2-a7cf-45bc-9b5c-777af82a87f3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:13.104815 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab729e2-a7cf-45bc-9b5c-777af82a87f3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:13.109563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2582e0-6e77-48f0-82f7-a1f0d2be797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:13.110276 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2582e0-6e77-48f0-82f7-a1f0d2be797f admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:13.110725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2582e0-6e77-48f0-82f7-a1f0d2be797f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:13.111004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2582e0-6e77-48f0-82f7-a1f0d2be797f admin admin] PATH_INFO: `/v3/projects/9d85f6e23f7948b58d58c453e9897e42/users/808dfdc7374b4635bcdc907898ceea7a/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:13.136192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2582e0-6e77-48f0-82f7-a1f0d2be797f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d85f6e23f7948b58d58c453e9897e42, user_id=808dfdc7374b4635bcdc907898ceea7a, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:13.138876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2582e0-6e77-48f0-82f7-a1f0d2be797f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:13.221066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1243/2474] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:13 2022] PUT /identity/v3/projects/9d85f6e23f7948b58d58c453e9897e42/users/808dfdc7374b4635bcdc907898ceea7a/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:13.225035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa05f36-05fd-4280-afb7-23d137e713f9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:13.235704 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa05f36-05fd-4280-afb7-23d137e713f9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:13.290053 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecbc13-e2db-4efb-a33d-160b2d368748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:13.291081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecbc13-e2db-4efb-a33d-160b2d368748 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:13.291360 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecbc13-e2db-4efb-a33d-160b2d368748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:13.291632 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecbc13-e2db-4efb-a33d-160b2d368748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:13.292263 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecbc13-e2db-4efb-a33d-160b2d368748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:13.293869 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecbc13-e2db-4efb-a33d-160b2d368748 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:13.303290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1232/2475] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:13.308119 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2582e0-6e77-48f0-82f7-a1f0d2be797f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:13.318530 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2582e0-6e77-48f0-82f7-a1f0d2be797f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:13.323432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56715341-8e2a-447e-8bd9-5da99041d49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:13.324088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56715341-8e2a-447e-8bd9-5da99041d49d admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:13.324365 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56715341-8e2a-447e-8bd9-5da99041d49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:13.324636 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56715341-8e2a-447e-8bd9-5da99041d49d admin admin] PATH_INFO: `/v3/projects/9d85f6e23f7948b58d58c453e9897e42/users/808dfdc7374b4635bcdc907898ceea7a/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:13.326606 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56715341-8e2a-447e-8bd9-5da99041d49d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d85f6e23f7948b58d58c453e9897e42, user_id=808dfdc7374b4635bcdc907898ceea7a, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:13.329207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56715341-8e2a-447e-8bd9-5da99041d49d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:13.339761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1244/2476] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:13 2022] PUT /identity/v3/projects/9d85f6e23f7948b58d58c453e9897e42/users/808dfdc7374b4635bcdc907898ceea7a/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:13.350230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddcc32-4f68-4ab8-b15e-b8ce00e78d66 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:13.350516 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddcc32-4f68-4ab8-b15e-b8ce00e78d66 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:13.350791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddcc32-4f68-4ab8-b15e-b8ce00e78d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:13.379538 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-41ddcc32-4f68-4ab8-b15e-b8ce00e78d66 None None] MFA Rules not processed for user `808dfdc7374b4635bcdc907898ceea7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:13.380739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-41ddcc32-4f68-4ab8-b15e-b8ce00e78d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:13.448465 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1233/2477] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:13.459696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56715341-8e2a-447e-8bd9-5da99041d49d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:13.461448 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-56715341-8e2a-447e-8bd9-5da99041d49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:13.503434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:13.520049 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56715341-8e2a-447e-8bd9-5da99041d49d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:13.523639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535f00b-c917-4e6b-a774-f470bae19c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:13.524232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f00b-c917-4e6b-a774-f470bae19c8d service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:13.524507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f00b-c917-4e6b-a774-f470bae19c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:13.525264 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f00b-c917-4e6b-a774-f470bae19c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:13.534220 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535f00b-c917-4e6b-a774-f470bae19c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:13.535641 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535f00b-c917-4e6b-a774-f470bae19c8d service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:13.545326 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1245/2478] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:13.865851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddcc32-4f68-4ab8-b15e-b8ce00e78d66 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:13.875572 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddcc32-4f68-4ab8-b15e-b8ce00e78d66 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:13.879372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601ed9a-49ab-4a8b-bf16-9086ee32e89c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:13.880027 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601ed9a-49ab-4a8b-bf16-9086ee32e89c service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:13.880305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601ed9a-49ab-4a8b-bf16-9086ee32e89c service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:13.880570 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601ed9a-49ab-4a8b-bf16-9086ee32e89c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:13.928392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:13.937303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601ed9a-49ab-4a8b-bf16-9086ee32e89c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:13.938807 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601ed9a-49ab-4a8b-bf16-9086ee32e89c service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:13.948522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1234/2479] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:15.619240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535f00b-c917-4e6b-a774-f470bae19c8d service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:15.620683 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b535f00b-c917-4e6b-a774-f470bae19c8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:15.695912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535f00b-c917-4e6b-a774-f470bae19c8d service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:15.701628 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11645a9-e015-4f6a-b24a-10c12282f804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:15.702397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11645a9-e015-4f6a-b24a-10c12282f804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:15.702603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11645a9-e015-4f6a-b24a-10c12282f804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:15.702870 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11645a9-e015-4f6a-b24a-10c12282f804 admin admin] PATH_INFO: `/v3/users/09d633bc5aed441daad5b9bf30455e9f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:15.704018 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11645a9-e015-4f6a-b24a-10c12282f804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d633bc5aed441daad5b9bf30455e9f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:15.706512 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11645a9-e015-4f6a-b24a-10c12282f804 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:15.883433 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b11645a9-e015-4f6a-b24a-10c12282f804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d633bc5aed441daad5b9bf30455e9f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:15.896473 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b11645a9-e015-4f6a-b24a-10c12282f804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d633bc5aed441daad5b9bf30455e9f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:15.907808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b11645a9-e015-4f6a-b24a-10c12282f804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d633bc5aed441daad5b9bf30455e9f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:15.908616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b11645a9-e015-4f6a-b24a-10c12282f804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d633bc5aed441daad5b9bf30455e9f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:15.988363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b11645a9-e015-4f6a-b24a-10c12282f804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d633bc5aed441daad5b9bf30455e9f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:15.995850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1246/2480] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:38:15 2022] DELETE /identity/v3/users/09d633bc5aed441daad5b9bf30455e9f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:16.000457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d8a6-a144-4370-9b8d-42ad52ceddf9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:16.000945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d8a6-a144-4370-9b8d-42ad52ceddf9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:16.001041 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d8a6-a144-4370-9b8d-42ad52ceddf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:16.020179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b862d8a6-a144-4370-9b8d-42ad52ceddf9 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:16.021399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b862d8a6-a144-4370-9b8d-42ad52ceddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:16.083883 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1235/2481] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:38:16.094892 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11645a9-e015-4f6a-b24a-10c12282f804 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:16.096297 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b11645a9-e015-4f6a-b24a-10c12282f804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:16.156222 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11645a9-e015-4f6a-b24a-10c12282f804 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:16.162254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f406ec-77ca-4774-a1b7-6062f2a6a9ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:16.162886 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f406ec-77ca-4774-a1b7-6062f2a6a9ab service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:16.163168 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f406ec-77ca-4774-a1b7-6062f2a6a9ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:16.163472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f406ec-77ca-4774-a1b7-6062f2a6a9ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:16.175091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f406ec-77ca-4774-a1b7-6062f2a6a9ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:16.175996 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f406ec-77ca-4774-a1b7-6062f2a6a9ab service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:16.181255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:16.186870 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1247/2482] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:16.996490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d8a6-a144-4370-9b8d-42ad52ceddf9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:16.997974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b862d8a6-a144-4370-9b8d-42ad52ceddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:17.010722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d8a6-a144-4370-9b8d-42ad52ceddf9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:17.015504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095a3b4-4fda-4a57-8227-680f78be2429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:17.016182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a3b4-4fda-4a57-8227-680f78be2429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:17.016425 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a3b4-4fda-4a57-8227-680f78be2429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:17.016699 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a3b4-4fda-4a57-8227-680f78be2429 admin admin] PATH_INFO: `/v3/projects/13c437280ac940ed98072a3dab732cb9` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:17.017860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095a3b4-4fda-4a57-8227-680f78be2429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c437280ac940ed98072a3dab732cb9)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:17.019767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095a3b4-4fda-4a57-8227-680f78be2429 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:17.150353 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1095a3b4-4fda-4a57-8227-680f78be2429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c437280ac940ed98072a3dab732cb9', 'request_id': 'req-1095a3b4-4fda-4a57-8227-680f78be2429'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:17.189997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5e810-0a1d-4261-899a-7982d00ab3e5 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:17.190499 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5e810-0a1d-4261-899a-7982d00ab3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:17.190598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5e810-0a1d-4261-899a-7982d00ab3e5 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:17.192141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1248/2483] 10.222.0.82 () {54 vars in 921 bytes} [Fri Sep 23 15:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 15:38:17.197045 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800c602-b369-4e67-8bcb-625982333ce2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:17.197348 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800c602-b369-4e67-8bcb-625982333ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:17.198246 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800c602-b369-4e67-8bcb-625982333ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:17.217876 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c800c602-b369-4e67-8bcb-625982333ce2 None None] MFA Rules not processed for user `6dbf682960cc447099c11862afa3206b`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:17.219085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c800c602-b369-4e67-8bcb-625982333ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:17.269269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1095a3b4-4fda-4a57-8227-680f78be2429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c437280ac940ed98072a3dab732cb9', 'request_id': 'req-1095a3b4-4fda-4a57-8227-680f78be2429'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:17.289467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1095a3b4-4fda-4a57-8227-680f78be2429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c437280ac940ed98072a3dab732cb9', 'request_id': 'req-1095a3b4-4fda-4a57-8227-680f78be2429'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:17.290701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1249/2484] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Sep 23 15:38:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:38:17.301314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1095a3b4-4fda-4a57-8227-680f78be2429 admin admin] The token cache is being invalidate because project 13c437280ac940ed98072a3dab732cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:38:17.302047 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1095a3b4-4fda-4a57-8227-680f78be2429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:17.302581 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800c602-b369-4e67-8bcb-625982333ce2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:17.302716 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1095a3b4-4fda-4a57-8227-680f78be2429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:17.304051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c800c602-b369-4e67-8bcb-625982333ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:17.304236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1236/2485] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:38:16 2022] DELETE /identity/v3/projects/13c437280ac940ed98072a3dab732cb9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:17.309322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fb5e7-93b2-4059-a654-bb471e927ac9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:17.309774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fb5e7-93b2-4059-a654-bb471e927ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:17.310057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fb5e7-93b2-4059-a654-bb471e927ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:17.330172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-903fb5e7-93b2-4059-a654-bb471e927ac9 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:17.331381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-903fb5e7-93b2-4059-a654-bb471e927ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:17.362328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800c602-b369-4e67-8bcb-625982333ce2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:17.366621 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33a456-2236-485b-aa1f-65a048938a81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1879a3ad7be74303b9feceff75f62979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:17.367222 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33a456-2236-485b-aa1f-65a048938a81 service glance] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:17.367500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33a456-2236-485b-aa1f-65a048938a81 service glance] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:17.367775 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33a456-2236-485b-aa1f-65a048938a81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:17.370054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8e33a456-2236-485b-aa1f-65a048938a81 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:17.383591 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33a456-2236-485b-aa1f-65a048938a81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:17.385098 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33a456-2236-485b-aa1f-65a048938a81 service glance] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:17.391696 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1237/2486] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:38:17.398114 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1250/2487] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:38:17.400155 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfde1e-e283-44cc-8702-55490c3be7c1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:17.400441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfde1e-e283-44cc-8702-55490c3be7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:17.400705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfde1e-e283-44cc-8702-55490c3be7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:17.421468 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d7bfde1e-e283-44cc-8702-55490c3be7c1 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:17.422764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d7bfde1e-e283-44cc-8702-55490c3be7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:17.430640 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1238/2488] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:17.435353 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33a456-2236-485b-aa1f-65a048938a81 service glance] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:17.445502 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33a456-2236-485b-aa1f-65a048938a81 service glance] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:17.450845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2d333-a2f1-4a81-9e95-79da148bcee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:17.451441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2d333-a2f1-4a81-9e95-79da148bcee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:17.451719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2d333-a2f1-4a81-9e95-79da148bcee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:17.451993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2d333-a2f1-4a81-9e95-79da148bcee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:17.452628 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2d333-a2f1-4a81-9e95-79da148bcee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:38:17.452930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2d333-a2f1-4a81-9e95-79da148bcee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:17.454572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2d333-a2f1-4a81-9e95-79da148bcee5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:17.466579 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1251/2489] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:38:17.470980 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfde1e-e283-44cc-8702-55490c3be7c1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:17.480290 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfde1e-e283-44cc-8702-55490c3be7c1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:17.484987 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928cada-b37c-493e-a7c2-ae5e6fecf5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:17.485601 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928cada-b37c-493e-a7c2-ae5e6fecf5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:17.485915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928cada-b37c-493e-a7c2-ae5e6fecf5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:17.486189 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928cada-b37c-493e-a7c2-ae5e6fecf5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:17.486813 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928cada-b37c-493e-a7c2-ae5e6fecf5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:17.488764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928cada-b37c-493e-a7c2-ae5e6fecf5a8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:17.494217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:17.595617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1239/2490] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:38:17 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:38:17.599603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2d333-a2f1-4a81-9e95-79da148bcee5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:17.610286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2d333-a2f1-4a81-9e95-79da148bcee5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:17.681343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759fe7f-9639-4676-adcf-1c5dd192c80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:17.682566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759fe7f-9639-4676-adcf-1c5dd192c80c admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:17.682856 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759fe7f-9639-4676-adcf-1c5dd192c80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:17.683130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759fe7f-9639-4676-adcf-1c5dd192c80c admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:17.683765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759fe7f-9639-4676-adcf-1c5dd192c80c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:17.685753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759fe7f-9639-4676-adcf-1c5dd192c80c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:17.997663 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:18.001940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1252/2491] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:38:17 2022] POST /identity/v3/users => generated 293 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:18.006163 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928cada-b37c-493e-a7c2-ae5e6fecf5a8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:18.016294 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928cada-b37c-493e-a7c2-ae5e6fecf5a8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:18.021907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c58607-aeae-4df6-9770-067b6b644ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:18.023675 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c58607-aeae-4df6-9770-067b6b644ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:18.023675 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c58607-aeae-4df6-9770-067b6b644ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:18.023675 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c58607-aeae-4df6-9770-067b6b644ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:18.023968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c58607-aeae-4df6-9770-067b6b644ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:18.025423 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c58607-aeae-4df6-9770-067b6b644ae2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:18.036171 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1240/2492] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:18.040269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759fe7f-9639-4676-adcf-1c5dd192c80c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:18.090184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759fe7f-9639-4676-adcf-1c5dd192c80c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:18.094856 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953a29d-3ef2-443d-adcb-11d43a544712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:18.095453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953a29d-3ef2-443d-adcb-11d43a544712 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:18.095734 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953a29d-3ef2-443d-adcb-11d43a544712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:18.096056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953a29d-3ef2-443d-adcb-11d43a544712 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:18.096642 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953a29d-3ef2-443d-adcb-11d43a544712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:18.098274 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953a29d-3ef2-443d-adcb-11d43a544712 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:18.109092 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1253/2493] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:18.121305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c58607-aeae-4df6-9770-067b6b644ae2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:18.157651 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c58607-aeae-4df6-9770-067b6b644ae2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:18.163035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1427a-c053-423f-b18d-7ee5e31e52be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:18.163689 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1427a-c053-423f-b18d-7ee5e31e52be admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:18.163968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1427a-c053-423f-b18d-7ee5e31e52be admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:18.164240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1427a-c053-423f-b18d-7ee5e31e52be admin admin] PATH_INFO: `/v3/projects/964e1f1332054a97b9acb112cf6bb9a7/users/a76e02228eed4239954f06e77213f008/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:18.182088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1427a-c053-423f-b18d-7ee5e31e52be admin admin] RBAC: Authorizing `identity:create_grant(project_id=964e1f1332054a97b9acb112cf6bb9a7, user_id=a76e02228eed4239954f06e77213f008, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:18.184799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1427a-c053-423f-b18d-7ee5e31e52be admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:18.284665 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1241/2494] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:18 2022] PUT /identity/v3/projects/964e1f1332054a97b9acb112cf6bb9a7/users/a76e02228eed4239954f06e77213f008/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:18.290547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fe37a-03c2-4ab7-b393-9e38e01f2488 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:18.290547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fe37a-03c2-4ab7-b393-9e38e01f2488 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:18.290547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fe37a-03c2-4ab7-b393-9e38e01f2488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:18.336396 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3e6fe37a-03c2-4ab7-b393-9e38e01f2488 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:18.339907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3e6fe37a-03c2-4ab7-b393-9e38e01f2488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:18.427080 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1254/2495] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:18.438791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1427a-c053-423f-b18d-7ee5e31e52be admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:18.440690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-72d1427a-c053-423f-b18d-7ee5e31e52be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:18.499276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1427a-c053-423f-b18d-7ee5e31e52be admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:18.503248 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6230f-2372-4c0b-9e05-843d660177f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:18.503849 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6230f-2372-4c0b-9e05-843d660177f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:18.504130 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6230f-2372-4c0b-9e05-843d660177f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:18.504398 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6230f-2372-4c0b-9e05-843d660177f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:18.514310 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6230f-2372-4c0b-9e05-843d660177f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:18.515761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6230f-2372-4c0b-9e05-843d660177f8 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:18.526612 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1242/2496] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:20.456939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1c33f-36ce-46e3-a0d4-ccba45558a31 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:20.457495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1c33f-36ce-46e3-a0d4-ccba45558a31 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:20.457495 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1c33f-36ce-46e3-a0d4-ccba45558a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:20.492182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-43e1c33f-36ce-46e3-a0d4-ccba45558a31 None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:20.493399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-43e1c33f-36ce-46e3-a0d4-ccba45558a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:20.568025 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1255/2497] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Sep 23 15:38:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:20.585777 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6230f-2372-4c0b-9e05-843d660177f8 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:20.587205 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3aa6230f-2372-4c0b-9e05-843d660177f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:20.702903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6230f-2372-4c0b-9e05-843d660177f8 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:20.711209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d5d68-ad80-48ed-b848-1ef288749119 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:20.718477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d5d68-ad80-48ed-b848-1ef288749119 service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:20.719875 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d5d68-ad80-48ed-b848-1ef288749119 service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:20.720384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d5d68-ad80-48ed-b848-1ef288749119 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:20.736017 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d5d68-ad80-48ed-b848-1ef288749119 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:20.739020 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d5d68-ad80-48ed-b848-1ef288749119 service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:20.755448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1243/2498] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:38:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 15:38:24.475428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1c33f-36ce-46e3-a0d4-ccba45558a31 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:24.479201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-43e1c33f-36ce-46e3-a0d4-ccba45558a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:24.527144 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1c33f-36ce-46e3-a0d4-ccba45558a31 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:24.537692 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9a662-84fd-41d6-8474-19a0e10592ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:24.538755 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9a662-84fd-41d6-8474-19a0e10592ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:24.539172 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9a662-84fd-41d6-8474-19a0e10592ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:24.539608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9a662-84fd-41d6-8474-19a0e10592ac admin admin] PATH_INFO: `/v3/users/a1710859b52d484186878de9f844affa` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:24.541454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9a662-84fd-41d6-8474-19a0e10592ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1710859b52d484186878de9f844affa)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:24.544598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9a662-84fd-41d6-8474-19a0e10592ac admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:24.560996 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:24.934015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d6d9a662-84fd-41d6-8474-19a0e10592ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1710859b52d484186878de9f844affa'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:24.988318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d6d9a662-84fd-41d6-8474-19a0e10592ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1710859b52d484186878de9f844affa'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:25.010649 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d6d9a662-84fd-41d6-8474-19a0e10592ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1710859b52d484186878de9f844affa'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:25.012106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d6d9a662-84fd-41d6-8474-19a0e10592ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1710859b52d484186878de9f844affa'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:25.183677 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d6d9a662-84fd-41d6-8474-19a0e10592ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1710859b52d484186878de9f844affa'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:25.199477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1256/2499] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:38:24 2022] DELETE /identity/v3/users/a1710859b52d484186878de9f844affa => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:25.201975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96375e0-3772-408e-90f0-57256953bb80 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:25.202824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96375e0-3772-408e-90f0-57256953bb80 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:25.203448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96375e0-3772-408e-90f0-57256953bb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:25.227408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:25.259976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c96375e0-3772-408e-90f0-57256953bb80 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:25.262154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c96375e0-3772-408e-90f0-57256953bb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:25.392747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1244/2500] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:25.401555 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9a662-84fd-41d6-8474-19a0e10592ac admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:25.403375 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d6d9a662-84fd-41d6-8474-19a0e10592ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:25.517918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9a662-84fd-41d6-8474-19a0e10592ac admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:25.523108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba511701-719f-4f7f-b56d-abaebc43b12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:25.524082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba511701-719f-4f7f-b56d-abaebc43b12b service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:25.524634 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba511701-719f-4f7f-b56d-abaebc43b12b service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:25.525282 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba511701-719f-4f7f-b56d-abaebc43b12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:25.537409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba511701-719f-4f7f-b56d-abaebc43b12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:25.539808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba511701-719f-4f7f-b56d-abaebc43b12b service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:25.553625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1257/2501] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:26.879025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96375e0-3772-408e-90f0-57256953bb80 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:26.881584 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c96375e0-3772-408e-90f0-57256953bb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:26.904073 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86d840-d5ef-45f0-977e-ac76e373e6d2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:26.904608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86d840-d5ef-45f0-977e-ac76e373e6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:26.904718 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86d840-d5ef-45f0-977e-ac76e373e6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:26.912235 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96375e0-3772-408e-90f0-57256953bb80 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:26.918021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:26.919196 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:26.919694 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:26.920014 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb admin admin] PATH_INFO: `/v3/projects/c737eac497dd44c381098604e7560912` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:26.922530 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c737eac497dd44c381098604e7560912)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:26.926884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:27.023753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9b86d840-d5ef-45f0-977e-ac76e373e6d2 None None] MFA Rules not processed for user `a76e02228eed4239954f06e77213f008`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:27.025559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9b86d840-d5ef-45f0-977e-ac76e373e6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:27.108797 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:27.114282 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1258/2502] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:27.120357 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86d840-d5ef-45f0-977e-ac76e373e6d2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:27.124367 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9b86d840-d5ef-45f0-977e-ac76e373e6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:27.136623 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c737eac497dd44c381098604e7560912', 'request_id': 'req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:27.146302 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86d840-d5ef-45f0-977e-ac76e373e6d2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:27.215866 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c737eac497dd44c381098604e7560912', 'request_id': 'req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:27.232704 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af962c09-1ce9-499d-b668-514cf5554ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:27.233663 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af962c09-1ce9-499d-b668-514cf5554ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:27.234481 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af962c09-1ce9-499d-b668-514cf5554ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:27.234949 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c737eac497dd44c381098604e7560912', 'request_id': 'req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:27.235104 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af962c09-1ce9-499d-b668-514cf5554ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:27.236412 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af962c09-1ce9-499d-b668-514cf5554ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:27.240196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af962c09-1ce9-499d-b668-514cf5554ab2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:27.260428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb admin admin] The token cache is being invalidate because project c737eac497dd44c381098604e7560912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:38:27.260725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:27.262482 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:27.267710 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1245/2503] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:38:26 2022] DELETE /identity/v3/projects/c737eac497dd44c381098604e7560912 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:27.270068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:27.272604 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:27.296605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5ee9c-5407-42b6-935b-6ccc2507aecb admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:27.315287 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fa206-2a8c-43e5-b3c3-a94f9ed7c426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:27.316236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fa206-2a8c-43e5-b3c3-a94f9ed7c426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:27.316672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fa206-2a8c-43e5-b3c3-a94f9ed7c426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:27.317104 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fa206-2a8c-43e5-b3c3-a94f9ed7c426 admin admin] PATH_INFO: `/v3/users/808dfdc7374b4635bcdc907898ceea7a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:27.318583 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fa206-2a8c-43e5-b3c3-a94f9ed7c426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=808dfdc7374b4635bcdc907898ceea7a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:27.320809 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fa206-2a8c-43e5-b3c3-a94f9ed7c426 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:27.408996 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1259/2504] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:38:27 2022] POST /identity/v3/projects => generated 381 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:27.410761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af962c09-1ce9-499d-b668-514cf5554ab2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:27.413094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-af962c09-1ce9-499d-b668-514cf5554ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:27.537070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af962c09-1ce9-499d-b668-514cf5554ab2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:27.545896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c225a2-f2c0-4dcc-a6c2-bac3787db57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:27.546140 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c225a2-f2c0-4dcc-a6c2-bac3787db57a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:27.546318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c225a2-f2c0-4dcc-a6c2-bac3787db57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:27.546732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c225a2-f2c0-4dcc-a6c2-bac3787db57a admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:27.547327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c225a2-f2c0-4dcc-a6c2-bac3787db57a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:27.549329 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c225a2-f2c0-4dcc-a6c2-bac3787db57a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:27.565279 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-800fa206-2a8c-43e5-b3c3-a94f9ed7c426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '808dfdc7374b4635bcdc907898ceea7a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:27.586374 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-800fa206-2a8c-43e5-b3c3-a94f9ed7c426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '808dfdc7374b4635bcdc907898ceea7a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:27.598514 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-800fa206-2a8c-43e5-b3c3-a94f9ed7c426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '808dfdc7374b4635bcdc907898ceea7a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:27.599423 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-800fa206-2a8c-43e5-b3c3-a94f9ed7c426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '808dfdc7374b4635bcdc907898ceea7a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:27.695593 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1260/2505] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:38:27 2022] POST /identity/v3/users => generated 297 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:38:27.699951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c225a2-f2c0-4dcc-a6c2-bac3787db57a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:27.701952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-21c225a2-f2c0-4dcc-a6c2-bac3787db57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:27.716419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c225a2-f2c0-4dcc-a6c2-bac3787db57a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:27.723439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482732a-6ee6-4b6c-86bd-5fa027cabe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:27.724295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482732a-6ee6-4b6c-86bd-5fa027cabe48 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:27.724735 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482732a-6ee6-4b6c-86bd-5fa027cabe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:27.725208 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482732a-6ee6-4b6c-86bd-5fa027cabe48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:27.726062 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482732a-6ee6-4b6c-86bd-5fa027cabe48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:27.728593 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482732a-6ee6-4b6c-86bd-5fa027cabe48 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:27.737163 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-800fa206-2a8c-43e5-b3c3-a94f9ed7c426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '808dfdc7374b4635bcdc907898ceea7a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:27.739932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:27.745592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1261/2506] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:27.745790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1246/2507] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:38:27 2022] DELETE /identity/v3/users/808dfdc7374b4635bcdc907898ceea7a => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:27.746891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482732a-6ee6-4b6c-86bd-5fa027cabe48 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:27.791015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482732a-6ee6-4b6c-86bd-5fa027cabe48 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:27.944893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:27.952953 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28267cf1-9462-4b28-aa97-f666461aff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:27.953972 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28267cf1-9462-4b28-aa97-f666461aff50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:27.954953 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28267cf1-9462-4b28-aa97-f666461aff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:27.954953 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28267cf1-9462-4b28-aa97-f666461aff50 admin admin] PATH_INFO: `/v3/projects/2d5965cb22b24bfbbab1630586c215d2/users/2de2bb22997f4b7291b31fbec7aa915c/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:27.978921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28267cf1-9462-4b28-aa97-f666461aff50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5965cb22b24bfbbab1630586c215d2, user_id=2de2bb22997f4b7291b31fbec7aa915c, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:27.984515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28267cf1-9462-4b28-aa97-f666461aff50 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:28.358275 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1262/2508] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:27 2022] PUT /identity/v3/projects/2d5965cb22b24bfbbab1630586c215d2/users/2de2bb22997f4b7291b31fbec7aa915c/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:28.363278 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fa206-2a8c-43e5-b3c3-a94f9ed7c426 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:28.394969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fa206-2a8c-43e5-b3c3-a94f9ed7c426 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:28.538932 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df242f-88ed-4c13-8628-29611655319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:28.543642 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df242f-88ed-4c13-8628-29611655319f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:28.547522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df242f-88ed-4c13-8628-29611655319f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:28.547522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df242f-88ed-4c13-8628-29611655319f admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:28.547522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df242f-88ed-4c13-8628-29611655319f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:28.547522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df242f-88ed-4c13-8628-29611655319f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:28.578461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28267cf1-9462-4b28-aa97-f666461aff50 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:28.589926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28267cf1-9462-4b28-aa97-f666461aff50 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:28.591611 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1247/2509] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:28.596752 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac9281-967d-49c1-8251-d70062de100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:28.599541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac9281-967d-49c1-8251-d70062de100e admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:28.599541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac9281-967d-49c1-8251-d70062de100e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:28.599541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac9281-967d-49c1-8251-d70062de100e admin admin] PATH_INFO: `/v3/projects/2d5965cb22b24bfbbab1630586c215d2/users/2de2bb22997f4b7291b31fbec7aa915c/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:28.618946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac9281-967d-49c1-8251-d70062de100e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5965cb22b24bfbbab1630586c215d2, user_id=2de2bb22997f4b7291b31fbec7aa915c, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:28.623028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac9281-967d-49c1-8251-d70062de100e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:28.650887 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1263/2510] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:28 2022] PUT /identity/v3/projects/2d5965cb22b24bfbbab1630586c215d2/users/2de2bb22997f4b7291b31fbec7aa915c/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:38:28.770364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df242f-88ed-4c13-8628-29611655319f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:28.770364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-09df242f-88ed-4c13-8628-29611655319f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:28.777450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df242f-88ed-4c13-8628-29611655319f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:28.864472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87854b-6343-4fd0-a514-9f5408895301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:28.889416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87854b-6343-4fd0-a514-9f5408895301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:28.890370 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87854b-6343-4fd0-a514-9f5408895301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:28.891059 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87854b-6343-4fd0-a514-9f5408895301 admin admin] PATH_INFO: `/v3/projects/9d85f6e23f7948b58d58c453e9897e42` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:28.893128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87854b-6343-4fd0-a514-9f5408895301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d85f6e23f7948b58d58c453e9897e42)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:28.902420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87854b-6343-4fd0-a514-9f5408895301 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:29.098244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c87854b-6343-4fd0-a514-9f5408895301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d85f6e23f7948b58d58c453e9897e42', 'request_id': 'req-1c87854b-6343-4fd0-a514-9f5408895301'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:29.181205 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c87854b-6343-4fd0-a514-9f5408895301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d85f6e23f7948b58d58c453e9897e42', 'request_id': 'req-1c87854b-6343-4fd0-a514-9f5408895301'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:29.188582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c87854b-6343-4fd0-a514-9f5408895301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d85f6e23f7948b58d58c453e9897e42', 'request_id': 'req-1c87854b-6343-4fd0-a514-9f5408895301'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:29.211891 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c87854b-6343-4fd0-a514-9f5408895301 admin admin] The token cache is being invalidate because project 9d85f6e23f7948b58d58c453e9897e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:38:29.212187 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c87854b-6343-4fd0-a514-9f5408895301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:29.213983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c87854b-6343-4fd0-a514-9f5408895301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:29.223366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bf455-76bd-40bb-865d-e5c776da7d96 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:29.223935 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bf455-76bd-40bb-865d-e5c776da7d96 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:29.223935 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bf455-76bd-40bb-865d-e5c776da7d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:29.227008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1248/2511] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:38:28 2022] DELETE /identity/v3/projects/9d85f6e23f7948b58d58c453e9897e42 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:29.340508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ec5bf455-76bd-40bb-865d-e5c776da7d96 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:29.351944 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ec5bf455-76bd-40bb-865d-e5c776da7d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:29.454164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1264/2512] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:29.461894 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25139fb-53ab-472e-a770-16b36a72289d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:29.462639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25139fb-53ab-472e-a770-16b36a72289d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:29.462639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25139fb-53ab-472e-a770-16b36a72289d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:29.499101 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b25139fb-53ab-472e-a770-16b36a72289d None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:29.500653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b25139fb-53ab-472e-a770-16b36a72289d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:29.509713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1249/2513] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:29.514917 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bf455-76bd-40bb-865d-e5c776da7d96 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:29.538178 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bf455-76bd-40bb-865d-e5c776da7d96 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:29.544310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f86fe-95cf-4951-bd1f-ed27220bb2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:29.545162 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f86fe-95cf-4951-bd1f-ed27220bb2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:29.545543 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f86fe-95cf-4951-bd1f-ed27220bb2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:29.546044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f86fe-95cf-4951-bd1f-ed27220bb2a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:29.546858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f86fe-95cf-4951-bd1f-ed27220bb2a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:38:29.547472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f86fe-95cf-4951-bd1f-ed27220bb2a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:29.562322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f86fe-95cf-4951-bd1f-ed27220bb2a7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:29.582105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25139fb-53ab-472e-a770-16b36a72289d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:29.588314 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1265/2514] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:38:29.594918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25139fb-53ab-472e-a770-16b36a72289d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:29.601802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebb912-baa6-44a7-95c5-3152154d3625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:29.602426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebb912-baa6-44a7-95c5-3152154d3625 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:29.603487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebb912-baa6-44a7-95c5-3152154d3625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:29.603781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebb912-baa6-44a7-95c5-3152154d3625 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:29.604428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bebb912-baa6-44a7-95c5-3152154d3625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:29.606621 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bebb912-baa6-44a7-95c5-3152154d3625 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:29.737661 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:29.751739 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f86fe-95cf-4951-bd1f-ed27220bb2a7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:29.757775 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1250/2515] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:38:29 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:29.765119 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f86fe-95cf-4951-bd1f-ed27220bb2a7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:29.850157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd429e-e1b9-42d6-bda3-78a9e155add2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:29.851193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd429e-e1b9-42d6-bda3-78a9e155add2 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:29.851747 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd429e-e1b9-42d6-bda3-78a9e155add2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:29.852290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd429e-e1b9-42d6-bda3-78a9e155add2 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:29.853160 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd429e-e1b9-42d6-bda3-78a9e155add2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:29.855678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd429e-e1b9-42d6-bda3-78a9e155add2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:29.956315 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1266/2516] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:38:29 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:29.960237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebb912-baa6-44a7-95c5-3152154d3625 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:29.992620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebb912-baa6-44a7-95c5-3152154d3625 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:29.999908 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530b13c-efac-48ff-afa4-49d2affcc637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:30.003336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530b13c-efac-48ff-afa4-49d2affcc637 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:30.004560 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530b13c-efac-48ff-afa4-49d2affcc637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:30.005876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530b13c-efac-48ff-afa4-49d2affcc637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:30.009297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530b13c-efac-48ff-afa4-49d2affcc637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:30.015128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530b13c-efac-48ff-afa4-49d2affcc637 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:30.028652 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1251/2517] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:30.033067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd429e-e1b9-42d6-bda3-78a9e155add2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:30.050024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd429e-e1b9-42d6-bda3-78a9e155add2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:30.061119 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1c47f-9c7c-4e4c-9771-7ebb0514cef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:30.062888 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c47f-9c7c-4e4c-9771-7ebb0514cef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:30.062888 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c47f-9c7c-4e4c-9771-7ebb0514cef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:30.063131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c47f-9c7c-4e4c-9771-7ebb0514cef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:30.065538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1c47f-9c7c-4e4c-9771-7ebb0514cef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:30.068176 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1c47f-9c7c-4e4c-9771-7ebb0514cef3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:30.086454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1267/2518] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:30.087948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530b13c-efac-48ff-afa4-49d2affcc637 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:30.120209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530b13c-efac-48ff-afa4-49d2affcc637 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:30.128582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6457a4-f7d1-49fb-a9d0-fcdb61beda3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:30.131325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6457a4-f7d1-49fb-a9d0-fcdb61beda3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:30.132676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6457a4-f7d1-49fb-a9d0-fcdb61beda3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:30.133702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6457a4-f7d1-49fb-a9d0-fcdb61beda3a admin admin] PATH_INFO: `/v3/projects/f8fe094c8a1a47588e1848cb43a89b34/users/10002e27287a402c9c3a706658d8428e/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:30.170651 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6457a4-f7d1-49fb-a9d0-fcdb61beda3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8fe094c8a1a47588e1848cb43a89b34, user_id=10002e27287a402c9c3a706658d8428e, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:30.176247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6457a4-f7d1-49fb-a9d0-fcdb61beda3a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:30.300681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1252/2519] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:30 2022] PUT /identity/v3/projects/f8fe094c8a1a47588e1848cb43a89b34/users/10002e27287a402c9c3a706658d8428e/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:30.302465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a3fad-7a2b-4b0a-a944-d49d199a774d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:30.302973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a3fad-7a2b-4b0a-a944-d49d199a774d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:30.303108 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a3fad-7a2b-4b0a-a944-d49d199a774d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:30.338538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:30.362236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5a2a3fad-7a2b-4b0a-a944-d49d199a774d None None] MFA Rules not processed for user `10002e27287a402c9c3a706658d8428e`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:30.363972 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5a2a3fad-7a2b-4b0a-a944-d49d199a774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:30.510705 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1268/2520] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:30.515355 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6457a4-f7d1-49fb-a9d0-fcdb61beda3a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:30.632972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6457a4-f7d1-49fb-a9d0-fcdb61beda3a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:30.648427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628d853-1f51-492c-83a5-7083b53d5e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:30.649629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628d853-1f51-492c-83a5-7083b53d5e39 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:30.654995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628d853-1f51-492c-83a5-7083b53d5e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:30.655396 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628d853-1f51-492c-83a5-7083b53d5e39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:30.656420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628d853-1f51-492c-83a5-7083b53d5e39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:30.659562 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628d853-1f51-492c-83a5-7083b53d5e39 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:30.888032 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1253/2521] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:38:30 2022] POST /identity/v3/projects => generated 385 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:38:30.892256 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a3fad-7a2b-4b0a-a944-d49d199a774d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:30.904271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a3fad-7a2b-4b0a-a944-d49d199a774d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:30.976192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fbd65-9fee-45c1-b833-b34d0e407de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:30.977201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fbd65-9fee-45c1-b833-b34d0e407de3 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:30.977201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fbd65-9fee-45c1-b833-b34d0e407de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:30.977569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fbd65-9fee-45c1-b833-b34d0e407de3 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:30.978262 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fbd65-9fee-45c1-b833-b34d0e407de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:30.981110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fbd65-9fee-45c1-b833-b34d0e407de3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:31.145992 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1269/2522] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:38:30 2022] POST /identity/v3/users => generated 299 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:31.147726 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628d853-1f51-492c-83a5-7083b53d5e39 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:31.159544 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628d853-1f51-492c-83a5-7083b53d5e39 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:31.164549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5a990-f728-4e20-ae45-df5e6df91b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:31.165538 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5a990-f728-4e20-ae45-df5e6df91b8f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:31.165538 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5a990-f728-4e20-ae45-df5e6df91b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:31.165914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5a990-f728-4e20-ae45-df5e6df91b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:31.166788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5a990-f728-4e20-ae45-df5e6df91b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:31.168977 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5a990-f728-4e20-ae45-df5e6df91b8f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:31.180840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1254/2523] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:31.192393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fbd65-9fee-45c1-b833-b34d0e407de3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:31.206496 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fbd65-9fee-45c1-b833-b34d0e407de3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:31.223158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a9d5d-6055-438e-b38b-53ac6f17cf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:31.223158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a9d5d-6055-438e-b38b-53ac6f17cf75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:31.223158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a9d5d-6055-438e-b38b-53ac6f17cf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:31.223158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a9d5d-6055-438e-b38b-53ac6f17cf75 admin admin] PATH_INFO: `/v3/projects/69dd416ad4b14bb1a28e43177b252789/users/924693829b2a4be0a7dd92ea6c82bd01/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:31.243004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a9d5d-6055-438e-b38b-53ac6f17cf75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69dd416ad4b14bb1a28e43177b252789, user_id=924693829b2a4be0a7dd92ea6c82bd01, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:31.247951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a9d5d-6055-438e-b38b-53ac6f17cf75 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:31.350311 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1270/2524] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:31 2022] PUT /identity/v3/projects/69dd416ad4b14bb1a28e43177b252789/users/924693829b2a4be0a7dd92ea6c82bd01/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:31.354534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5a990-f728-4e20-ae45-df5e6df91b8f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:31.367052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5a990-f728-4e20-ae45-df5e6df91b8f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:31.482106 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7eef60-7126-4536-94fc-07dee0411a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:31.482824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7eef60-7126-4536-94fc-07dee0411a6a admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:31.483197 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7eef60-7126-4536-94fc-07dee0411a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:31.483550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7eef60-7126-4536-94fc-07dee0411a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:31.484273 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7eef60-7126-4536-94fc-07dee0411a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:31.487381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7eef60-7126-4536-94fc-07dee0411a6a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:31.500908 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1255/2525] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:38:31.505047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a9d5d-6055-438e-b38b-53ac6f17cf75 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:31.518875 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a9d5d-6055-438e-b38b-53ac6f17cf75 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:31.524381 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9089e8-15e6-4650-9794-d8188bf95f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:31.525081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9089e8-15e6-4650-9794-d8188bf95f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:31.525423 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9089e8-15e6-4650-9794-d8188bf95f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:31.526849 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9089e8-15e6-4650-9794-d8188bf95f3b admin admin] PATH_INFO: `/v3/projects/69dd416ad4b14bb1a28e43177b252789/users/924693829b2a4be0a7dd92ea6c82bd01/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:31.529654 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9089e8-15e6-4650-9794-d8188bf95f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=69dd416ad4b14bb1a28e43177b252789, user_id=924693829b2a4be0a7dd92ea6c82bd01, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:31.533048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9089e8-15e6-4650-9794-d8188bf95f3b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:31.545692 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1271/2526] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:31 2022] PUT /identity/v3/projects/69dd416ad4b14bb1a28e43177b252789/users/924693829b2a4be0a7dd92ea6c82bd01/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:31.556534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6fd2f-b678-4ca2-8588-21222eb4ce7f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:31.557129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6fd2f-b678-4ca2-8588-21222eb4ce7f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:31.557129 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6fd2f-b678-4ca2-8588-21222eb4ce7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:31.588855 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-11b6fd2f-b678-4ca2-8588-21222eb4ce7f None None] MFA Rules not processed for user `924693829b2a4be0a7dd92ea6c82bd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:31.590259 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-11b6fd2f-b678-4ca2-8588-21222eb4ce7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:31.698394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1256/2527] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:38:31.711617 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9089e8-15e6-4650-9794-d8188bf95f3b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:31.713579 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8c9089e8-15e6-4650-9794-d8188bf95f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:31.846188 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9089e8-15e6-4650-9794-d8188bf95f3b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:31.875086 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a8ff7-595b-4e78-94e8-11c9b54bcfa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:31.876010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a8ff7-595b-4e78-94e8-11c9b54bcfa9 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:31.876392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a8ff7-595b-4e78-94e8-11c9b54bcfa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:31.876695 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a8ff7-595b-4e78-94e8-11c9b54bcfa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:31.901482 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a8ff7-595b-4e78-94e8-11c9b54bcfa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:31.904156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a8ff7-595b-4e78-94e8-11c9b54bcfa9 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:31.915698 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1272/2528] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:31.999683 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6fd2f-b678-4ca2-8588-21222eb4ce7f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:32.046104 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:32.106088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6fd2f-b678-4ca2-8588-21222eb4ce7f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:32.110789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716c72c-7084-48e9-ae37-a129a41c66a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:32.111431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716c72c-7084-48e9-ae37-a129a41c66a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:32.111705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716c72c-7084-48e9-ae37-a129a41c66a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:32.111972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716c72c-7084-48e9-ae37-a129a41c66a1 admin admin] PATH_INFO: `/v3/users/10002e27287a402c9c3a706658d8428e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:32.113240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716c72c-7084-48e9-ae37-a129a41c66a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10002e27287a402c9c3a706658d8428e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:32.115507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716c72c-7084-48e9-ae37-a129a41c66a1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:32.179824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:32.356629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b716c72c-7084-48e9-ae37-a129a41c66a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10002e27287a402c9c3a706658d8428e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:32.369304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b716c72c-7084-48e9-ae37-a129a41c66a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10002e27287a402c9c3a706658d8428e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:32.376810 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b716c72c-7084-48e9-ae37-a129a41c66a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10002e27287a402c9c3a706658d8428e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:32.377565 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b716c72c-7084-48e9-ae37-a129a41c66a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10002e27287a402c9c3a706658d8428e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:32.458177 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b716c72c-7084-48e9-ae37-a129a41c66a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10002e27287a402c9c3a706658d8428e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:32.474926 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1257/2529] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:38:31 2022] DELETE /identity/v3/users/10002e27287a402c9c3a706658d8428e => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:32.475093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb76db-bab9-42f4-ab4c-60f23bdd2a23 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:32.475093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb76db-bab9-42f4-ab4c-60f23bdd2a23 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:32.475093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb76db-bab9-42f4-ab4c-60f23bdd2a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:32.490665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2bcb76db-bab9-42f4-ab4c-60f23bdd2a23 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:32.491869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2bcb76db-bab9-42f4-ab4c-60f23bdd2a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:32.575888 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1273/2530] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:32.585844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716c72c-7084-48e9-ae37-a129a41c66a1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:32.587285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b716c72c-7084-48e9-ae37-a129a41c66a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:32.649879 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716c72c-7084-48e9-ae37-a129a41c66a1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:32.656406 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75c75f-4091-44c8-9312-38c35ce79e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:32.661633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75c75f-4091-44c8-9312-38c35ce79e3b service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:32.661633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75c75f-4091-44c8-9312-38c35ce79e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:32.661633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75c75f-4091-44c8-9312-38c35ce79e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:32.687123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75c75f-4091-44c8-9312-38c35ce79e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:32.689433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75c75f-4091-44c8-9312-38c35ce79e3b service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:32.730621 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1258/2531] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:33.340186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb76db-bab9-42f4-ab4c-60f23bdd2a23 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:33.344003 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2bcb76db-bab9-42f4-ab4c-60f23bdd2a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:33.355788 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb76db-bab9-42f4-ab4c-60f23bdd2a23 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:33.360970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4636a-ffdb-42b0-9611-8f4613577e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:33.363025 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4636a-ffdb-42b0-9611-8f4613577e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:33.366899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4636a-ffdb-42b0-9611-8f4613577e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:33.366899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4636a-ffdb-42b0-9611-8f4613577e60 admin admin] PATH_INFO: `/v3/projects/f8fe094c8a1a47588e1848cb43a89b34` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:33.366899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4636a-ffdb-42b0-9611-8f4613577e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8fe094c8a1a47588e1848cb43a89b34)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:33.369685 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4636a-ffdb-42b0-9611-8f4613577e60 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:33.487096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d4636a-ffdb-42b0-9611-8f4613577e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8fe094c8a1a47588e1848cb43a89b34', 'request_id': 'req-c5d4636a-ffdb-42b0-9611-8f4613577e60'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:33.671891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d4636a-ffdb-42b0-9611-8f4613577e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8fe094c8a1a47588e1848cb43a89b34', 'request_id': 'req-c5d4636a-ffdb-42b0-9611-8f4613577e60'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:33.686438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d4636a-ffdb-42b0-9611-8f4613577e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8fe094c8a1a47588e1848cb43a89b34', 'request_id': 'req-c5d4636a-ffdb-42b0-9611-8f4613577e60'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:33.698171 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d4636a-ffdb-42b0-9611-8f4613577e60 admin admin] The token cache is being invalidate because project f8fe094c8a1a47588e1848cb43a89b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:38:33.698624 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d4636a-ffdb-42b0-9611-8f4613577e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:33.699616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d4636a-ffdb-42b0-9611-8f4613577e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:33.701378 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1274/2532] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:38:33 2022] DELETE /identity/v3/projects/f8fe094c8a1a47588e1848cb43a89b34 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:33.705440 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75c75f-4091-44c8-9312-38c35ce79e3b service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:33.716199 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75c75f-4091-44c8-9312-38c35ce79e3b service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:33.787611 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50f00e-4f8a-4de1-9c87-198a8b71b2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:33.788362 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50f00e-4f8a-4de1-9c87-198a8b71b2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:33.788776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50f00e-4f8a-4de1-9c87-198a8b71b2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:33.789155 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50f00e-4f8a-4de1-9c87-198a8b71b2b3 admin admin] PATH_INFO: `/v3/users/924693829b2a4be0a7dd92ea6c82bd01` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:33.790422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50f00e-4f8a-4de1-9c87-198a8b71b2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=924693829b2a4be0a7dd92ea6c82bd01)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:33.793058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50f00e-4f8a-4de1-9c87-198a8b71b2b3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:33.992925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:34.003754 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4c50f00e-4f8a-4de1-9c87-198a8b71b2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924693829b2a4be0a7dd92ea6c82bd01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:34.027412 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4c50f00e-4f8a-4de1-9c87-198a8b71b2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924693829b2a4be0a7dd92ea6c82bd01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:34.041019 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4c50f00e-4f8a-4de1-9c87-198a8b71b2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924693829b2a4be0a7dd92ea6c82bd01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:34.043145 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4c50f00e-4f8a-4de1-9c87-198a8b71b2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924693829b2a4be0a7dd92ea6c82bd01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:34.149303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4c50f00e-4f8a-4de1-9c87-198a8b71b2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924693829b2a4be0a7dd92ea6c82bd01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:34.156533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1259/2533] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:38:33 2022] DELETE /identity/v3/users/924693829b2a4be0a7dd92ea6c82bd01 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:34.806165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4636a-ffdb-42b0-9611-8f4613577e60 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:34.808818 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c5d4636a-ffdb-42b0-9611-8f4613577e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:34.841995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4636a-ffdb-42b0-9611-8f4613577e60 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:34.975923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:34.985808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c378ff-192c-4aba-b1e6-fb68d0fac305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:34.986402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c378ff-192c-4aba-b1e6-fb68d0fac305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:34.986851 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c378ff-192c-4aba-b1e6-fb68d0fac305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:34.987269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c378ff-192c-4aba-b1e6-fb68d0fac305 admin admin] PATH_INFO: `/v3/projects/69dd416ad4b14bb1a28e43177b252789` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:34.988454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c378ff-192c-4aba-b1e6-fb68d0fac305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69dd416ad4b14bb1a28e43177b252789)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:34.990488 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c378ff-192c-4aba-b1e6-fb68d0fac305 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:35.132070 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f7c378ff-192c-4aba-b1e6-fb68d0fac305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69dd416ad4b14bb1a28e43177b252789', 'request_id': 'req-f7c378ff-192c-4aba-b1e6-fb68d0fac305'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:35.212004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f7c378ff-192c-4aba-b1e6-fb68d0fac305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69dd416ad4b14bb1a28e43177b252789', 'request_id': 'req-f7c378ff-192c-4aba-b1e6-fb68d0fac305'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:35.223844 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f7c378ff-192c-4aba-b1e6-fb68d0fac305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69dd416ad4b14bb1a28e43177b252789', 'request_id': 'req-f7c378ff-192c-4aba-b1e6-fb68d0fac305'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:35.236207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f7c378ff-192c-4aba-b1e6-fb68d0fac305 admin admin] The token cache is being invalidate because project 69dd416ad4b14bb1a28e43177b252789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:38:35.236506 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f7c378ff-192c-4aba-b1e6-fb68d0fac305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:35.237206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f7c378ff-192c-4aba-b1e6-fb68d0fac305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:35.239026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1275/2534] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:38:34 2022] DELETE /identity/v3/projects/69dd416ad4b14bb1a28e43177b252789 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:35.245023 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9bdbf-96c6-4e6d-bdb7-d3fe22e88169 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:35.246012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9bdbf-96c6-4e6d-bdb7-d3fe22e88169 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:35.246165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9bdbf-96c6-4e6d-bdb7-d3fe22e88169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:35.266858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f2e9bdbf-96c6-4e6d-bdb7-d3fe22e88169 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:35.268057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f2e9bdbf-96c6-4e6d-bdb7-d3fe22e88169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:35.369016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1260/2535] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:35.369477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c00fbc-6842-40ba-bf4d-b7a4d9e84255 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:35.369871 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c00fbc-6842-40ba-bf4d-b7a4d9e84255 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:35.370226 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c00fbc-6842-40ba-bf4d-b7a4d9e84255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:35.403168 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e9c00fbc-6842-40ba-bf4d-b7a4d9e84255 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:35.403168 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e9c00fbc-6842-40ba-bf4d-b7a4d9e84255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:35.430798 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1276/2536] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:35.431049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9bdbf-96c6-4e6d-bdb7-d3fe22e88169 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:35.440637 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9bdbf-96c6-4e6d-bdb7-d3fe22e88169 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:35.446123 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b26d2-337c-4c0d-9464-9846cdadd8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:35.446925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b26d2-337c-4c0d-9464-9846cdadd8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:35.447273 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b26d2-337c-4c0d-9464-9846cdadd8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:35.447920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b26d2-337c-4c0d-9464-9846cdadd8e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:35.449298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b26d2-337c-4c0d-9464-9846cdadd8e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:38:35.449672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b26d2-337c-4c0d-9464-9846cdadd8e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:35.451670 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b26d2-337c-4c0d-9464-9846cdadd8e6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:35.468197 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1261/2537] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:38:35.472224 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c00fbc-6842-40ba-bf4d-b7a4d9e84255 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:35.484585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c00fbc-6842-40ba-bf4d-b7a4d9e84255 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:35.501948 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf707c-7b1e-4f57-b9c0-547b1998e140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:35.503136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf707c-7b1e-4f57-b9c0-547b1998e140 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:35.503740 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf707c-7b1e-4f57-b9c0-547b1998e140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:35.504833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf707c-7b1e-4f57-b9c0-547b1998e140 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:35.505727 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf707c-7b1e-4f57-b9c0-547b1998e140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:35.508658 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf707c-7b1e-4f57-b9c0-547b1998e140 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:35.935527 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21572698-85e7-4be7-9116-503e7cbfc8b5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:35.935818 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21572698-85e7-4be7-9116-503e7cbfc8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:35.936306 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21572698-85e7-4be7-9116-503e7cbfc8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:35.973548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-21572698-85e7-4be7-9116-503e7cbfc8b5 None None] MFA Rules not processed for user `2de2bb22997f4b7291b31fbec7aa915c`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:35.977485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-21572698-85e7-4be7-9116-503e7cbfc8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:36.052490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1262/2538] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:38:36.066058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21572698-85e7-4be7-9116-503e7cbfc8b5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:36.067450 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-21572698-85e7-4be7-9116-503e7cbfc8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:36.129257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21572698-85e7-4be7-9116-503e7cbfc8b5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:36.133121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd19aad-0b1f-4bbe-bff1-4ec437bf1a03 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1879a3ad7be74303b9feceff75f62979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:36.133747 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd19aad-0b1f-4bbe-bff1-4ec437bf1a03 service glance] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:36.134061 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd19aad-0b1f-4bbe-bff1-4ec437bf1a03 service glance] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:36.134332 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd19aad-0b1f-4bbe-bff1-4ec437bf1a03 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:36.136084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1fd19aad-0b1f-4bbe-bff1-4ec437bf1a03 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:36.200760 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd19aad-0b1f-4bbe-bff1-4ec437bf1a03 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:36.201510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd19aad-0b1f-4bbe-bff1-4ec437bf1a03 service glance] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:36.211955 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1263/2539] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:38:36.379691 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1277/2540] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:38:35 2022] POST /identity/v3/projects => generated 371 bytes in 900 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:36.382642 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd19aad-0b1f-4bbe-bff1-4ec437bf1a03 service glance] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:36.393589 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd19aad-0b1f-4bbe-bff1-4ec437bf1a03 service glance] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:36.450097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc124713-9868-4dbc-b719-ecc6a1040b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:36.450711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc124713-9868-4dbc-b719-ecc6a1040b52 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:36.450992 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc124713-9868-4dbc-b719-ecc6a1040b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:36.451266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc124713-9868-4dbc-b719-ecc6a1040b52 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:36.451911 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc124713-9868-4dbc-b719-ecc6a1040b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:36.453874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc124713-9868-4dbc-b719-ecc6a1040b52 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:36.712745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1264/2541] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:38:36 2022] POST /identity/v3/users => generated 286 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:36.718196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf707c-7b1e-4f57-b9c0-547b1998e140 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:36.738293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf707c-7b1e-4f57-b9c0-547b1998e140 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:36.743831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fc318-d8b6-4234-86ab-2351f2f6fe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:36.744443 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fc318-d8b6-4234-86ab-2351f2f6fe0a admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:36.744763 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fc318-d8b6-4234-86ab-2351f2f6fe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:36.744985 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fc318-d8b6-4234-86ab-2351f2f6fe0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:36.745841 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fc318-d8b6-4234-86ab-2351f2f6fe0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:36.747609 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fc318-d8b6-4234-86ab-2351f2f6fe0a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:36.758717 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1278/2542] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:36.762663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc124713-9868-4dbc-b719-ecc6a1040b52 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:36.772801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc124713-9868-4dbc-b719-ecc6a1040b52 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:36.778439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c842449-7790-48a9-b8a3-7698331b2088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:36.779297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c842449-7790-48a9-b8a3-7698331b2088 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:36.779577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c842449-7790-48a9-b8a3-7698331b2088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:36.779879 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c842449-7790-48a9-b8a3-7698331b2088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:36.780519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c842449-7790-48a9-b8a3-7698331b2088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:36.782202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c842449-7790-48a9-b8a3-7698331b2088 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:36.793322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1265/2543] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:38:36.798137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fc318-d8b6-4234-86ab-2351f2f6fe0a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:36.809328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fc318-d8b6-4234-86ab-2351f2f6fe0a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:36.814041 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73502d9-1b6b-49e2-bc7f-649078bed6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:36.814811 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73502d9-1b6b-49e2-bc7f-649078bed6f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:36.815097 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73502d9-1b6b-49e2-bc7f-649078bed6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:36.815368 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73502d9-1b6b-49e2-bc7f-649078bed6f1 admin admin] PATH_INFO: `/v3/projects/dcb1fbd6f4234ab2997d225eb2aa83f3/users/3e997a3d413245169bd6830a12db62da/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:36.832065 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73502d9-1b6b-49e2-bc7f-649078bed6f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb1fbd6f4234ab2997d225eb2aa83f3, user_id=3e997a3d413245169bd6830a12db62da, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:36.834806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73502d9-1b6b-49e2-bc7f-649078bed6f1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:36.901420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a3737-3030-4979-be43-b5b7583ee964 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:36.902348 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a3737-3030-4979-be43-b5b7583ee964 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:36.902530 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a3737-3030-4979-be43-b5b7583ee964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:36.927815 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-277a3737-3030-4979-be43-b5b7583ee964 None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:36.929065 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-277a3737-3030-4979-be43-b5b7583ee964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:36.960557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1279/2544] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:36 2022] PUT /identity/v3/projects/dcb1fbd6f4234ab2997d225eb2aa83f3/users/3e997a3d413245169bd6830a12db62da/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:36.962704 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77544b62-a792-4271-bb06-d3a18104f042 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:36.966605 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77544b62-a792-4271-bb06-d3a18104f042 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:36.967172 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77544b62-a792-4271-bb06-d3a18104f042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:37.021549 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-77544b62-a792-4271-bb06-d3a18104f042 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:37.024560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-77544b62-a792-4271-bb06-d3a18104f042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:37.040864 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1266/2545] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Sep 23 15:38:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:37.056063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a3737-3030-4979-be43-b5b7583ee964 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:37.057699 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-277a3737-3030-4979-be43-b5b7583ee964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:37.097086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:37.160053 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1280/2546] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:37.177192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77544b62-a792-4271-bb06-d3a18104f042 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:37.177192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-77544b62-a792-4271-bb06-d3a18104f042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:37.178650 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a3737-3030-4979-be43-b5b7583ee964 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:37.198487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f067d-097f-4b17-a71e-57cefa31610f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:37.199822 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f067d-097f-4b17-a71e-57cefa31610f service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:37.200054 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f067d-097f-4b17-a71e-57cefa31610f service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:37.200399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f067d-097f-4b17-a71e-57cefa31610f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:37.216159 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f067d-097f-4b17-a71e-57cefa31610f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:37.217975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f067d-097f-4b17-a71e-57cefa31610f service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:37.227103 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1267/2547] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:38:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 15:38:37.245544 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77544b62-a792-4271-bb06-d3a18104f042 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:37.249960 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88da38-86d3-4a67-b595-dd1dbe03223b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:37.250597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88da38-86d3-4a67-b595-dd1dbe03223b service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:37.250909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88da38-86d3-4a67-b595-dd1dbe03223b service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:37.251182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88da38-86d3-4a67-b595-dd1dbe03223b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:37.267764 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88da38-86d3-4a67-b595-dd1dbe03223b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:37.269571 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88da38-86d3-4a67-b595-dd1dbe03223b service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:37.291061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1281/2548] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:38.360686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:39.327162 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1f8f6-cb8e-4e5a-b04e-5737bd975de4 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:39.331255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1f8f6-cb8e-4e5a-b04e-5737bd975de4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:39.331255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1f8f6-cb8e-4e5a-b04e-5737bd975de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:39.397510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:39.403179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-04f1f8f6-cb8e-4e5a-b04e-5737bd975de4 None None] MFA Rules not processed for user `3e997a3d413245169bd6830a12db62da`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:39.405275 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-04f1f8f6-cb8e-4e5a-b04e-5737bd975de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:39.478048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1f396-3163-4ce8-b3e3-85d246d328f9 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:39.478614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1f396-3163-4ce8-b3e3-85d246d328f9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:39.478614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1f396-3163-4ce8-b3e3-85d246d328f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:39.515243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-54d1f396-3163-4ce8-b3e3-85d246d328f9 None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:39.516472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-54d1f396-3163-4ce8-b3e3-85d246d328f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:39.539497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1282/2549] 10.222.0.82 () {58 vars in 967 bytes} [Fri Sep 23 15:38:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:38:39.550088 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1f396-3163-4ce8-b3e3-85d246d328f9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:39.568989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1f396-3163-4ce8-b3e3-85d246d328f9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:39.590163 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1268/2550] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:39.592673 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c369a-6d72-4b8e-8ffd-05fd4a495dd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:39.593694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c369a-6d72-4b8e-8ffd-05fd4a495dd3 service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:39.594072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c369a-6d72-4b8e-8ffd-05fd4a495dd3 service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:39.594411 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c369a-6d72-4b8e-8ffd-05fd4a495dd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:39.595954 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1f8f6-cb8e-4e5a-b04e-5737bd975de4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:39.611258 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c369a-6d72-4b8e-8ffd-05fd4a495dd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:39.614356 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c369a-6d72-4b8e-8ffd-05fd4a495dd3 service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:39.623039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1f8f6-cb8e-4e5a-b04e-5737bd975de4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:39.630981 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1283/2551] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:38:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 15:38:39.631673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b3821-4f4f-4764-9372-10c70da28293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:39.632422 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b3821-4f4f-4764-9372-10c70da28293 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:39.632904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b3821-4f4f-4764-9372-10c70da28293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:39.633241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b3821-4f4f-4764-9372-10c70da28293 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:39.634161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b3821-4f4f-4764-9372-10c70da28293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:39.637031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b3821-4f4f-4764-9372-10c70da28293 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:39.770189 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1269/2552] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:38:39 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:39.774334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c369a-6d72-4b8e-8ffd-05fd4a495dd3 service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:39.789158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:39.795630 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c369a-6d72-4b8e-8ffd-05fd4a495dd3 service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:39.880186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14086e7a-426b-4154-9555-bf7c322744a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:39.880869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14086e7a-426b-4154-9555-bf7c322744a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:39.881187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14086e7a-426b-4154-9555-bf7c322744a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:39.881460 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14086e7a-426b-4154-9555-bf7c322744a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:39.882121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14086e7a-426b-4154-9555-bf7c322744a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:39.884429 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14086e7a-426b-4154-9555-bf7c322744a5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:40.024877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1284/2553] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:38:39 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:40.028903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b3821-4f4f-4764-9372-10c70da28293 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:40.046824 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b3821-4f4f-4764-9372-10c70da28293 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:40.067801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa084222-0415-4306-b96b-b4a03db04994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:40.068772 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084222-0415-4306-b96b-b4a03db04994 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:40.069057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084222-0415-4306-b96b-b4a03db04994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:40.069323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084222-0415-4306-b96b-b4a03db04994 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:40.070009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa084222-0415-4306-b96b-b4a03db04994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:40.071610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa084222-0415-4306-b96b-b4a03db04994 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:40.090179 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1270/2554] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:40.094485 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14086e7a-426b-4154-9555-bf7c322744a5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:40.116951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14086e7a-426b-4154-9555-bf7c322744a5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:40.129170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa0bd6-d39d-4ca9-91bd-adf10ac5a837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:40.130028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa0bd6-d39d-4ca9-91bd-adf10ac5a837 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:40.130306 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa0bd6-d39d-4ca9-91bd-adf10ac5a837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:40.130577 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa0bd6-d39d-4ca9-91bd-adf10ac5a837 admin admin] PATH_INFO: `/v3/projects/7dbc9a79e862499fbf801a5c7729dbc6/users/ce6bbd789eb543f6bd927f60d85d2a9f/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:40.176868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa0bd6-d39d-4ca9-91bd-adf10ac5a837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbc9a79e862499fbf801a5c7729dbc6, user_id=ce6bbd789eb543f6bd927f60d85d2a9f, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:40.180570 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa0bd6-d39d-4ca9-91bd-adf10ac5a837 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:40.285562 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1285/2555] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:40 2022] PUT /identity/v3/projects/7dbc9a79e862499fbf801a5c7729dbc6/users/ce6bbd789eb543f6bd927f60d85d2a9f/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:38:40.289669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa084222-0415-4306-b96b-b4a03db04994 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:40.314809 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa084222-0415-4306-b96b-b4a03db04994 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:40.420057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e69f86-d644-41c7-910b-879be597eb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:40.421585 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e69f86-d644-41c7-910b-879be597eb14 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:40.422047 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e69f86-d644-41c7-910b-879be597eb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:40.422478 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e69f86-d644-41c7-910b-879be597eb14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:40.423335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e69f86-d644-41c7-910b-879be597eb14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:40.425569 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e69f86-d644-41c7-910b-879be597eb14 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:40.437938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1271/2556] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:38:40.442598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa0bd6-d39d-4ca9-91bd-adf10ac5a837 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:40.460914 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa0bd6-d39d-4ca9-91bd-adf10ac5a837 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:40.475777 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf658a-1627-4f04-a401-f46ce935e60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:40.476527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf658a-1627-4f04-a401-f46ce935e60b admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:40.476809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf658a-1627-4f04-a401-f46ce935e60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:40.477083 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf658a-1627-4f04-a401-f46ce935e60b admin admin] PATH_INFO: `/v3/projects/7dbc9a79e862499fbf801a5c7729dbc6/users/ce6bbd789eb543f6bd927f60d85d2a9f/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:40.479585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf658a-1627-4f04-a401-f46ce935e60b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbc9a79e862499fbf801a5c7729dbc6, user_id=ce6bbd789eb543f6bd927f60d85d2a9f, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:40.489677 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf658a-1627-4f04-a401-f46ce935e60b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:40.520259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1286/2557] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:40 2022] PUT /identity/v3/projects/7dbc9a79e862499fbf801a5c7729dbc6/users/ce6bbd789eb543f6bd927f60d85d2a9f/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:38:42.936388 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710ef76-a982-40f5-917a-68c75bcb72aa None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:42.936938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710ef76-a982-40f5-917a-68c75bcb72aa None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:42.936938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710ef76-a982-40f5-917a-68c75bcb72aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:42.994384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3710ef76-a982-40f5-917a-68c75bcb72aa None None] MFA Rules not processed for user `ce6bbd789eb543f6bd927f60d85d2a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:42.995675 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3710ef76-a982-40f5-917a-68c75bcb72aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:43.133545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1272/2558] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:43.147256 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3714902-bd52-4a9e-ac3e-9ac274124601 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:43.149398 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3714902-bd52-4a9e-ac3e-9ac274124601 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:43.149398 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3714902-bd52-4a9e-ac3e-9ac274124601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:43.175121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b3714902-bd52-4a9e-ac3e-9ac274124601 None None] MFA Rules not processed for user `3e997a3d413245169bd6830a12db62da`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:43.180604 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b3714902-bd52-4a9e-ac3e-9ac274124601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:43.271349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1287/2559] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:43.280497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710ef76-a982-40f5-917a-68c75bcb72aa None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:43.282444 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3710ef76-a982-40f5-917a-68c75bcb72aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:43.318833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:43.397938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710ef76-a982-40f5-917a-68c75bcb72aa None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:43.408348 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bb490-9749-46c2-b34d-800f44a12c01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:43.409144 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bb490-9749-46c2-b34d-800f44a12c01 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:43.409489 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bb490-9749-46c2-b34d-800f44a12c01 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:43.410162 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bb490-9749-46c2-b34d-800f44a12c01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:43.447901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bb490-9749-46c2-b34d-800f44a12c01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:43.453229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bb490-9749-46c2-b34d-800f44a12c01 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:43.486655 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1273/2560] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:43.830669 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3714902-bd52-4a9e-ac3e-9ac274124601 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:43.837192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:44.075193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3714902-bd52-4a9e-ac3e-9ac274124601 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:44.078936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690bcee-35b3-4af5-ad8b-c93ad88307f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:44.079574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690bcee-35b3-4af5-ad8b-c93ad88307f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:44.079861 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690bcee-35b3-4af5-ad8b-c93ad88307f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:44.080137 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690bcee-35b3-4af5-ad8b-c93ad88307f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:44.081945 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d690bcee-35b3-4af5-ad8b-c93ad88307f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:44.093652 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690bcee-35b3-4af5-ad8b-c93ad88307f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:44.095391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690bcee-35b3-4af5-ad8b-c93ad88307f8 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:44.104632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1288/2561] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:49.537689 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bb490-9749-46c2-b34d-800f44a12c01 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:49.550441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bb490-9749-46c2-b34d-800f44a12c01 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:49.554643 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b5650-8bf2-4cdb-82f6-d7b1b9852b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:49.555451 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b5650-8bf2-4cdb-82f6-d7b1b9852b3e service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:49.555905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b5650-8bf2-4cdb-82f6-d7b1b9852b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:49.556343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b5650-8bf2-4cdb-82f6-d7b1b9852b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:49.558343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2e0b5650-8bf2-4cdb-82f6-d7b1b9852b3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:49.626959 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b5650-8bf2-4cdb-82f6-d7b1b9852b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:49.628696 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b5650-8bf2-4cdb-82f6-d7b1b9852b3e service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:49.646795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1274/2562] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:50.704453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f01e-866a-473c-9b4c-64cf01642832 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:50.704952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f01e-866a-473c-9b4c-64cf01642832 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:50.705053 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f01e-866a-473c-9b4c-64cf01642832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:50.736100 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3ab8f01e-866a-473c-9b4c-64cf01642832 None None] MFA Rules not processed for user `a76e02228eed4239954f06e77213f008`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:50.737784 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3ab8f01e-866a-473c-9b4c-64cf01642832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:50.830286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1289/2563] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:53.947918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b5650-8bf2-4cdb-82f6-d7b1b9852b3e service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:53.950068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2e0b5650-8bf2-4cdb-82f6-d7b1b9852b3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:54.034718 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b5650-8bf2-4cdb-82f6-d7b1b9852b3e service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:54.040624 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8a8ae-196c-416c-8400-706ab061cb3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25109eeb1b34b3689b10e3f7c44a6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:54.045805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8a8ae-196c-416c-8400-706ab061cb3a service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:54.045805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8a8ae-196c-416c-8400-706ab061cb3a service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:54.045805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8a8ae-196c-416c-8400-706ab061cb3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:54.045805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-61d8a8ae-196c-416c-8400-706ab061cb3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:54.056410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8a8ae-196c-416c-8400-706ab061cb3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:54.058780 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8a8ae-196c-416c-8400-706ab061cb3a service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:54.069381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1275/2564] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:54.114375 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8f01e-866a-473c-9b4c-64cf01642832 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:54.115900 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3ab8f01e-866a-473c-9b4c-64cf01642832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:54.149676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8f01e-866a-473c-9b4c-64cf01642832 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:54.155347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9667da-3d9c-4f8c-b197-950e20529f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:54.155994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9667da-3d9c-4f8c-b197-950e20529f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:54.156269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9667da-3d9c-4f8c-b197-950e20529f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:54.156538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9667da-3d9c-4f8c-b197-950e20529f43 admin admin] PATH_INFO: `/v3/users/2ff41052ee8747cb8039347a41f4e3f4` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:54.158028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9667da-3d9c-4f8c-b197-950e20529f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff41052ee8747cb8039347a41f4e3f4)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:54.159642 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9667da-3d9c-4f8c-b197-950e20529f43 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:54.465527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ce9667da-3d9c-4f8c-b197-950e20529f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff41052ee8747cb8039347a41f4e3f4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:54.481462 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ce9667da-3d9c-4f8c-b197-950e20529f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff41052ee8747cb8039347a41f4e3f4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:54.489438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ce9667da-3d9c-4f8c-b197-950e20529f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff41052ee8747cb8039347a41f4e3f4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:54.490708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ce9667da-3d9c-4f8c-b197-950e20529f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff41052ee8747cb8039347a41f4e3f4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:54.593481 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ce9667da-3d9c-4f8c-b197-950e20529f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff41052ee8747cb8039347a41f4e3f4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:54.600921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1290/2565] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:38:54 2022] DELETE /identity/v3/users/2ff41052ee8747cb8039347a41f4e3f4 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:54.884556 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8a8ae-196c-416c-8400-706ab061cb3a service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:54.896013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8a8ae-196c-416c-8400-706ab061cb3a service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:54.924812 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:54.960084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6ba63-a6b7-4b50-8e22-591aab1fec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:54.961277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6ba63-a6b7-4b50-8e22-591aab1fec9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:54.965658 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6ba63-a6b7-4b50-8e22-591aab1fec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:54.965658 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6ba63-a6b7-4b50-8e22-591aab1fec9e admin admin] PATH_INFO: `/v3/projects/8f048438b75a4dd5989cb8a1bf009334` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:54.965658 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6ba63-a6b7-4b50-8e22-591aab1fec9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f048438b75a4dd5989cb8a1bf009334)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:54.966128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6ba63-a6b7-4b50-8e22-591aab1fec9e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:55.104006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eca6ba63-a6b7-4b50-8e22-591aab1fec9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f048438b75a4dd5989cb8a1bf009334', 'request_id': 'req-eca6ba63-a6b7-4b50-8e22-591aab1fec9e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:55.209669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eca6ba63-a6b7-4b50-8e22-591aab1fec9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f048438b75a4dd5989cb8a1bf009334', 'request_id': 'req-eca6ba63-a6b7-4b50-8e22-591aab1fec9e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:55.219565 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eca6ba63-a6b7-4b50-8e22-591aab1fec9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f048438b75a4dd5989cb8a1bf009334', 'request_id': 'req-eca6ba63-a6b7-4b50-8e22-591aab1fec9e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:55.241158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eca6ba63-a6b7-4b50-8e22-591aab1fec9e admin admin] The token cache is being invalidate because project 8f048438b75a4dd5989cb8a1bf009334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:38:55.241643 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eca6ba63-a6b7-4b50-8e22-591aab1fec9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:55.242500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eca6ba63-a6b7-4b50-8e22-591aab1fec9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:38:55.244835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1276/2566] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:38:54 2022] DELETE /identity/v3/projects/8f048438b75a4dd5989cb8a1bf009334 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:55.249684 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a677cb4-0933-498f-87bd-0619e1265f88 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:55.250160 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a677cb4-0933-498f-87bd-0619e1265f88 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:55.250292 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a677cb4-0933-498f-87bd-0619e1265f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:55.272185 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3a677cb4-0933-498f-87bd-0619e1265f88 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:55.273697 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3a677cb4-0933-498f-87bd-0619e1265f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:55.307465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:55.374994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1291/2567] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:38:55.383180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abf23f-e2c3-4713-acab-46fd29245b44 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:55.383472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abf23f-e2c3-4713-acab-46fd29245b44 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:55.383774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abf23f-e2c3-4713-acab-46fd29245b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:55.427499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f2abf23f-e2c3-4713-acab-46fd29245b44 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:55.428882 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f2abf23f-e2c3-4713-acab-46fd29245b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:55.439898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1277/2568] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:38:55.443975 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a677cb4-0933-498f-87bd-0619e1265f88 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:55.456882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a677cb4-0933-498f-87bd-0619e1265f88 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:55.464446 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02991d73-9038-4726-bd7e-cdca91fc1be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:55.465502 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02991d73-9038-4726-bd7e-cdca91fc1be0 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:55.465996 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02991d73-9038-4726-bd7e-cdca91fc1be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:55.466471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02991d73-9038-4726-bd7e-cdca91fc1be0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:55.467310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02991d73-9038-4726-bd7e-cdca91fc1be0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:38:55.467808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02991d73-9038-4726-bd7e-cdca91fc1be0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:55.469655 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02991d73-9038-4726-bd7e-cdca91fc1be0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:55.488157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1292/2569] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:38:55.492544 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abf23f-e2c3-4713-acab-46fd29245b44 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:55.519500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abf23f-e2c3-4713-acab-46fd29245b44 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:55.536182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e2c71-2dec-4329-b95a-86320b042cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:55.537057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e2c71-2dec-4329-b95a-86320b042cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:55.537531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e2c71-2dec-4329-b95a-86320b042cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:55.537840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e2c71-2dec-4329-b95a-86320b042cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:55.538482 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e2c71-2dec-4329-b95a-86320b042cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:55.541860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e2c71-2dec-4329-b95a-86320b042cf8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:55.578278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0f24-9032-41ee-8c54-791b6ab7142a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:55.578864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0f24-9032-41ee-8c54-791b6ab7142a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:55.580686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0f24-9032-41ee-8c54-791b6ab7142a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:55.623978 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b48f0f24-9032-41ee-8c54-791b6ab7142a None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:55.625248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b48f0f24-9032-41ee-8c54-791b6ab7142a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:55.702383 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1278/2570] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:38:55 2022] POST /identity/v3/projects => generated 371 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:38:55.706400 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e2c71-2dec-4329-b95a-86320b042cf8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:55.731441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1293/2571] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Sep 23 15:38:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:38:55.752721 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f0f24-9032-41ee-8c54-791b6ab7142a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:55.757767 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b48f0f24-9032-41ee-8c54-791b6ab7142a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:55.855553 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e2c71-2dec-4329-b95a-86320b042cf8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:55.860674 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533f7ff-a827-4221-8e7e-7be5e8e85f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:55.861599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f7ff-a827-4221-8e7e-7be5e8e85f22 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:55.862128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f7ff-a827-4221-8e7e-7be5e8e85f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:55.862409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f7ff-a827-4221-8e7e-7be5e8e85f22 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:55.863826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533f7ff-a827-4221-8e7e-7be5e8e85f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:55.865884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533f7ff-a827-4221-8e7e-7be5e8e85f22 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:55.873906 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f0f24-9032-41ee-8c54-791b6ab7142a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:55.948194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fd4a7-8667-4cc9-9555-98443e0d1374 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:55.949381 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fd4a7-8667-4cc9-9555-98443e0d1374 service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:55.949770 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fd4a7-8667-4cc9-9555-98443e0d1374 service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:55.955283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fd4a7-8667-4cc9-9555-98443e0d1374 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:55.961342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1279/2572] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:38:55 2022] POST /identity/v3/users => generated 286 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:38:55.967579 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533f7ff-a827-4221-8e7e-7be5e8e85f22 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:55.985709 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533f7ff-a827-4221-8e7e-7be5e8e85f22 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:55.993634 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011b628-ba68-4db2-832d-6535ca9a1418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:55.994731 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011b628-ba68-4db2-832d-6535ca9a1418 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:55.995294 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011b628-ba68-4db2-832d-6535ca9a1418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:55.995908 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011b628-ba68-4db2-832d-6535ca9a1418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:55.998301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011b628-ba68-4db2-832d-6535ca9a1418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:56.000454 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011b628-ba68-4db2-832d-6535ca9a1418 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:56.015048 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1280/2573] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:56.019113 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011b628-ba68-4db2-832d-6535ca9a1418 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:56.045143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fd4a7-8667-4cc9-9555-98443e0d1374 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:56.048608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fd4a7-8667-4cc9-9555-98443e0d1374 service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:56.053010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011b628-ba68-4db2-832d-6535ca9a1418 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:56.073120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae6ff6-b4b7-4c35-9e9f-ff099da410f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:56.074443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae6ff6-b4b7-4c35-9e9f-ff099da410f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:56.074886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae6ff6-b4b7-4c35-9e9f-ff099da410f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:56.075257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae6ff6-b4b7-4c35-9e9f-ff099da410f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:56.076153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae6ff6-b4b7-4c35-9e9f-ff099da410f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:56.076715 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1294/2574] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:38:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 15:38:56.078052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae6ff6-b4b7-4c35-9e9f-ff099da410f5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:56.080132 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:56.093788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1281/2575] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:38:56.098383 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fd4a7-8667-4cc9-9555-98443e0d1374 service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:56.119141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fd4a7-8667-4cc9-9555-98443e0d1374 service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:56.125183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52a932-8cbe-45c2-86c8-f817aadf6c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:56.126286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52a932-8cbe-45c2-86c8-f817aadf6c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:56.126790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52a932-8cbe-45c2-86c8-f817aadf6c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:56.127402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52a932-8cbe-45c2-86c8-f817aadf6c7f admin admin] PATH_INFO: `/v3/projects/61bb27f18d7f4161b6300b5831c2147f/users/a8dd0999d38a4340baaef5adcd41dac2/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:56.147782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52a932-8cbe-45c2-86c8-f817aadf6c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61bb27f18d7f4161b6300b5831c2147f, user_id=a8dd0999d38a4340baaef5adcd41dac2, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:56.150966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52a932-8cbe-45c2-86c8-f817aadf6c7f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:56.307501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1295/2576] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:56 2022] PUT /identity/v3/projects/61bb27f18d7f4161b6300b5831c2147f/users/a8dd0999d38a4340baaef5adcd41dac2/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:38:56.318928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279842f6-fb85-4ae0-a789-ec7d19fe2a16 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:56.319321 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279842f6-fb85-4ae0-a789-ec7d19fe2a16 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:56.319615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279842f6-fb85-4ae0-a789-ec7d19fe2a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:56.384104 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-279842f6-fb85-4ae0-a789-ec7d19fe2a16 None None] MFA Rules not processed for user `a8dd0999d38a4340baaef5adcd41dac2`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:56.385691 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-279842f6-fb85-4ae0-a789-ec7d19fe2a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:56.404126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:56.512985 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1282/2577] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:56.517249 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52a932-8cbe-45c2-86c8-f817aadf6c7f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:56.695127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52a932-8cbe-45c2-86c8-f817aadf6c7f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:56.700926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc982aaf-e977-4f4f-a1ba-71adc2ce9573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:56.701700 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc982aaf-e977-4f4f-a1ba-71adc2ce9573 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:56.702126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc982aaf-e977-4f4f-a1ba-71adc2ce9573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:56.702498 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc982aaf-e977-4f4f-a1ba-71adc2ce9573 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:56.703407 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc982aaf-e977-4f4f-a1ba-71adc2ce9573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:56.706632 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc982aaf-e977-4f4f-a1ba-71adc2ce9573 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:56.826173 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1296/2578] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:38:56 2022] POST /identity/v3/projects => generated 371 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:38:56.827835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279842f6-fb85-4ae0-a789-ec7d19fe2a16 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:56.839597 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279842f6-fb85-4ae0-a789-ec7d19fe2a16 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:56.913346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc300a-c911-4fde-bc57-8d99d6d39ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:56.918367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc300a-c911-4fde-bc57-8d99d6d39ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:56.918663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc300a-c911-4fde-bc57-8d99d6d39ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:56.918942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc300a-c911-4fde-bc57-8d99d6d39ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:56.919605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc300a-c911-4fde-bc57-8d99d6d39ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:56.921570 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc300a-c911-4fde-bc57-8d99d6d39ef5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:57.072949 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1283/2579] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:38:56 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:38:57.076564 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc982aaf-e977-4f4f-a1ba-71adc2ce9573 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:57.087865 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc982aaf-e977-4f4f-a1ba-71adc2ce9573 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:57.093675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce874c-9dd0-4950-87ca-f83d5c44773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:57.094332 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce874c-9dd0-4950-87ca-f83d5c44773f admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:57.094603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce874c-9dd0-4950-87ca-f83d5c44773f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:57.094874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce874c-9dd0-4950-87ca-f83d5c44773f admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:57.095515 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce874c-9dd0-4950-87ca-f83d5c44773f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:57.097822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce874c-9dd0-4950-87ca-f83d5c44773f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:57.113711 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1297/2580] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:57.117791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc300a-c911-4fde-bc57-8d99d6d39ef5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:57.135774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc300a-c911-4fde-bc57-8d99d6d39ef5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:57.135774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e6329-6e1c-4e44-b895-3df899de171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:57.135774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e6329-6e1c-4e44-b895-3df899de171a admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:57.135774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e6329-6e1c-4e44-b895-3df899de171a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:57.136262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e6329-6e1c-4e44-b895-3df899de171a admin admin] PATH_INFO: `/v3/projects/ac2710ab63ef4d1180efc2aa8c91a328/users/48cba13e3c754a71b18505e74ed84bb8/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:57.174758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e6329-6e1c-4e44-b895-3df899de171a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2710ab63ef4d1180efc2aa8c91a328, user_id=48cba13e3c754a71b18505e74ed84bb8, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:57.177674 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e6329-6e1c-4e44-b895-3df899de171a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:57.259209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1284/2581] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:57 2022] PUT /identity/v3/projects/ac2710ab63ef4d1180efc2aa8c91a328/users/48cba13e3c754a71b18505e74ed84bb8/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:57.262777 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce874c-9dd0-4950-87ca-f83d5c44773f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:57.273381 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce874c-9dd0-4950-87ca-f83d5c44773f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:57.335893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:57.351186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb602c-8ab4-4402-8893-2417d7902422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:57.351766 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb602c-8ab4-4402-8893-2417d7902422 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:57.352048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb602c-8ab4-4402-8893-2417d7902422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:57.352322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb602c-8ab4-4402-8893-2417d7902422 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:57.353052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb602c-8ab4-4402-8893-2417d7902422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:57.355626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb602c-8ab4-4402-8893-2417d7902422 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:57.367231 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1298/2582] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:38:57.371556 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e6329-6e1c-4e44-b895-3df899de171a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:57.389673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e6329-6e1c-4e44-b895-3df899de171a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:57.394451 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51c417-50c3-49ca-a92e-fb24f16578a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:57.395120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51c417-50c3-49ca-a92e-fb24f16578a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:57.395400 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51c417-50c3-49ca-a92e-fb24f16578a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:57.395673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51c417-50c3-49ca-a92e-fb24f16578a7 admin admin] PATH_INFO: `/v3/projects/ac2710ab63ef4d1180efc2aa8c91a328/users/48cba13e3c754a71b18505e74ed84bb8/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:57.397637 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51c417-50c3-49ca-a92e-fb24f16578a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2710ab63ef4d1180efc2aa8c91a328, user_id=48cba13e3c754a71b18505e74ed84bb8, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:57.400363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51c417-50c3-49ca-a92e-fb24f16578a7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:57.415642 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1285/2583] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:38:57 2022] PUT /identity/v3/projects/ac2710ab63ef4d1180efc2aa8c91a328/users/48cba13e3c754a71b18505e74ed84bb8/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:38:57.428403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5d12f-d198-47ed-8db2-22f56a611205 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:57.429060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5d12f-d198-47ed-8db2-22f56a611205 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:57.429533 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5d12f-d198-47ed-8db2-22f56a611205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:57.471272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a9e5d12f-d198-47ed-8db2-22f56a611205 None None] MFA Rules not processed for user `48cba13e3c754a71b18505e74ed84bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:38:57.473091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a9e5d12f-d198-47ed-8db2-22f56a611205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:57.556813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1299/2584] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:38:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:38:57.568001 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51c417-50c3-49ca-a92e-fb24f16578a7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:57.569845 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ba51c417-50c3-49ca-a92e-fb24f16578a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:38:57.617337 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:38:57.634306 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51c417-50c3-49ca-a92e-fb24f16578a7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:57.638861 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7568c7f-5783-4284-b2ba-4d8875962d1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:57.639552 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7568c7f-5783-4284-b2ba-4d8875962d1d service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:57.639900 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7568c7f-5783-4284-b2ba-4d8875962d1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:57.640252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7568c7f-5783-4284-b2ba-4d8875962d1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:57.650103 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7568c7f-5783-4284-b2ba-4d8875962d1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:57.652247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7568c7f-5783-4284-b2ba-4d8875962d1d service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:57.663641 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1286/2585] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:38:57.884155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5d12f-d198-47ed-8db2-22f56a611205 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:38:57.901078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5d12f-d198-47ed-8db2-22f56a611205 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:38:57.906388 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b1d6c-5ab7-4d32-ae81-d03d6c69cf4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:38:57.907058 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b1d6c-5ab7-4d32-ae81-d03d6c69cf4e service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:38:57.907336 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b1d6c-5ab7-4d32-ae81-d03d6c69cf4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:38:57.907602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b1d6c-5ab7-4d32-ae81-d03d6c69cf4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:38:58.006596 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b1d6c-5ab7-4d32-ae81-d03d6c69cf4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:38:58.008353 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b1d6c-5ab7-4d32-ae81-d03d6c69cf4e service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:38:58.020684 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1300/2586] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:38:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:39:03.129122 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7568c7f-5783-4284-b2ba-4d8875962d1d service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:03.130767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b7568c7f-5783-4284-b2ba-4d8875962d1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:03.241392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7568c7f-5783-4284-b2ba-4d8875962d1d service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:03.252410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05872124-fb06-47fc-a490-ab19d4ff5434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbf682960cc447099c11862afa3206b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:03.253196 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05872124-fb06-47fc-a490-ab19d4ff5434 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:03.253601 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05872124-fb06-47fc-a490-ab19d4ff5434 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:03.254058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05872124-fb06-47fc-a490-ab19d4ff5434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:03.257741 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-05872124-fb06-47fc-a490-ab19d4ff5434 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:03.361930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05872124-fb06-47fc-a490-ab19d4ff5434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:03.364441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05872124-fb06-47fc-a490-ab19d4ff5434 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:03.376345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1287/2587] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:39:08.015182 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=69 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:11.117289 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b1d6c-5ab7-4d32-ae81-d03d6c69cf4e service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:11.118794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-509b1d6c-5ab7-4d32-ae81-d03d6c69cf4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:11.175704 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b1d6c-5ab7-4d32-ae81-d03d6c69cf4e service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:11.179507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c874719-d26b-4905-aae2-34df942ec787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:11.180104 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874719-d26b-4905-aae2-34df942ec787 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:11.180427 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874719-d26b-4905-aae2-34df942ec787 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:11.180696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874719-d26b-4905-aae2-34df942ec787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:11.183051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7c874719-d26b-4905-aae2-34df942ec787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:11.243925 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c874719-d26b-4905-aae2-34df942ec787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:11.245971 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c874719-d26b-4905-aae2-34df942ec787 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:11.255899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1301/2588] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:39:12.078119 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05872124-fb06-47fc-a490-ab19d4ff5434 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:12.080991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-05872124-fb06-47fc-a490-ab19d4ff5434 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:12.095461 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05872124-fb06-47fc-a490-ab19d4ff5434 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:12.099365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df465e0b-e165-4888-bdd5-7eab768ac605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:12.100150 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df465e0b-e165-4888-bdd5-7eab768ac605 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:12.100429 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df465e0b-e165-4888-bdd5-7eab768ac605 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:12.101199 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df465e0b-e165-4888-bdd5-7eab768ac605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:12.103075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-df465e0b-e165-4888-bdd5-7eab768ac605 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:12.193719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df465e0b-e165-4888-bdd5-7eab768ac605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:12.195866 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df465e0b-e165-4888-bdd5-7eab768ac605 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:12.206198 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1288/2589] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:39:19.820622 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c874719-d26b-4905-aae2-34df942ec787 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:19.822105 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7c874719-d26b-4905-aae2-34df942ec787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:19.834908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c874719-d26b-4905-aae2-34df942ec787 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:19.840352 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3c787-2166-4fdb-b7f7-a3ebab6eb2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:19.841057 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3c787-2166-4fdb-b7f7-a3ebab6eb2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:19.841434 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3c787-2166-4fdb-b7f7-a3ebab6eb2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:19.841709 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3c787-2166-4fdb-b7f7-a3ebab6eb2ac admin admin] PATH_INFO: `/v3/users/93d9d6782d7d4f5cb82afa51d77415c2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:19.842862 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3c787-2166-4fdb-b7f7-a3ebab6eb2ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=93d9d6782d7d4f5cb82afa51d77415c2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:19.844821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3c787-2166-4fdb-b7f7-a3ebab6eb2ac admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:20.110825 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7bd3c787-2166-4fdb-b7f7-a3ebab6eb2ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93d9d6782d7d4f5cb82afa51d77415c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:20.124060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7bd3c787-2166-4fdb-b7f7-a3ebab6eb2ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93d9d6782d7d4f5cb82afa51d77415c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:20.131684 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7bd3c787-2166-4fdb-b7f7-a3ebab6eb2ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93d9d6782d7d4f5cb82afa51d77415c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:20.132638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7bd3c787-2166-4fdb-b7f7-a3ebab6eb2ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93d9d6782d7d4f5cb82afa51d77415c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:20.325690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7bd3c787-2166-4fdb-b7f7-a3ebab6eb2ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93d9d6782d7d4f5cb82afa51d77415c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:20.332384 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1302/2590] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:19 2022] DELETE /identity/v3/users/93d9d6782d7d4f5cb82afa51d77415c2 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:20.779379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df465e0b-e165-4888-bdd5-7eab768ac605 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:20.794676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df465e0b-e165-4888-bdd5-7eab768ac605 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:20.816947 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:20.891920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:20.893761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:20.894096 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:20.906302 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6 admin admin] PATH_INFO: `/v3/projects/1189a34c520e4c7289affda6101c1180` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:20.910710 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1189a34c520e4c7289affda6101c1180)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:20.912697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:21.049624 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1189a34c520e4c7289affda6101c1180', 'request_id': 'req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:21.209312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1189a34c520e4c7289affda6101c1180', 'request_id': 'req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:21.215778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1189a34c520e4c7289affda6101c1180', 'request_id': 'req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:21.233840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6 admin admin] The token cache is being invalidate because project 1189a34c520e4c7289affda6101c1180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:39:21.234139 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:21.243610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:21.243610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1289/2591] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:39:20 2022] DELETE /identity/v3/projects/1189a34c520e4c7289affda6101c1180 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:21.246765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3c787-2166-4fdb-b7f7-a3ebab6eb2ac admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:21.248213 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7bd3c787-2166-4fdb-b7f7-a3ebab6eb2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:21.262670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3c787-2166-4fdb-b7f7-a3ebab6eb2ac admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:21.284587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:21.325135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff788f4-abbf-4341-995e-b923efa50cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:21.325808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff788f4-abbf-4341-995e-b923efa50cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:21.326091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff788f4-abbf-4341-995e-b923efa50cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:21.326364 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff788f4-abbf-4341-995e-b923efa50cb0 admin admin] PATH_INFO: `/v3/users/b3fa8b4eefd147ef9dda3c732e351106` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:21.327600 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff788f4-abbf-4341-995e-b923efa50cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3fa8b4eefd147ef9dda3c732e351106)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:21.329574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff788f4-abbf-4341-995e-b923efa50cb0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:21.546680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bff788f4-abbf-4341-995e-b923efa50cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3fa8b4eefd147ef9dda3c732e351106'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:21.577491 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bff788f4-abbf-4341-995e-b923efa50cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3fa8b4eefd147ef9dda3c732e351106'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:21.585148 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bff788f4-abbf-4341-995e-b923efa50cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3fa8b4eefd147ef9dda3c732e351106'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:21.586113 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bff788f4-abbf-4341-995e-b923efa50cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3fa8b4eefd147ef9dda3c732e351106'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:21.705586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-bff788f4-abbf-4341-995e-b923efa50cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3fa8b4eefd147ef9dda3c732e351106'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:21.719096 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1303/2592] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:21 2022] DELETE /identity/v3/users/b3fa8b4eefd147ef9dda3c732e351106 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:22.006382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:22.008549 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:22.028292 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfff3e-5971-4c48-81a1-7f1fbd2cffc6 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:22.111802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a04ba2-4fe1-4704-be16-5bf15606c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:22.112419 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a04ba2-4fe1-4704-be16-5bf15606c89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:22.112696 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a04ba2-4fe1-4704-be16-5bf15606c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:22.113016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a04ba2-4fe1-4704-be16-5bf15606c89a admin admin] PATH_INFO: `/v3/projects/91447389ca914648b20129c3cc93e7de` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:22.114186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a04ba2-4fe1-4704-be16-5bf15606c89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=91447389ca914648b20129c3cc93e7de)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:22.116189 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a04ba2-4fe1-4704-be16-5bf15606c89a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:22.238723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:22.242898 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-77a04ba2-4fe1-4704-be16-5bf15606c89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91447389ca914648b20129c3cc93e7de', 'request_id': 'req-77a04ba2-4fe1-4704-be16-5bf15606c89a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:22.317911 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-77a04ba2-4fe1-4704-be16-5bf15606c89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91447389ca914648b20129c3cc93e7de', 'request_id': 'req-77a04ba2-4fe1-4704-be16-5bf15606c89a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:22.329336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-77a04ba2-4fe1-4704-be16-5bf15606c89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91447389ca914648b20129c3cc93e7de', 'request_id': 'req-77a04ba2-4fe1-4704-be16-5bf15606c89a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:22.348633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-77a04ba2-4fe1-4704-be16-5bf15606c89a admin admin] The token cache is being invalidate because project 91447389ca914648b20129c3cc93e7de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:39:22.349078 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-77a04ba2-4fe1-4704-be16-5bf15606c89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:22.350082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-77a04ba2-4fe1-4704-be16-5bf15606c89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:22.352150 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1290/2593] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:39:22 2022] DELETE /identity/v3/projects/91447389ca914648b20129c3cc93e7de => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:22.990139 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff788f4-abbf-4341-995e-b923efa50cb0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:22.991542 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bff788f4-abbf-4341-995e-b923efa50cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:23.049091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff788f4-abbf-4341-995e-b923efa50cb0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:23.108797 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3931f9-5e84-4b5a-8b7f-520d64cb13bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:23.109402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3931f9-5e84-4b5a-8b7f-520d64cb13bf service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:23.109676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3931f9-5e84-4b5a-8b7f-520d64cb13bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:23.110081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3931f9-5e84-4b5a-8b7f-520d64cb13bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:23.111819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5e3931f9-5e84-4b5a-8b7f-520d64cb13bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:23.123201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:23.175638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3931f9-5e84-4b5a-8b7f-520d64cb13bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:23.177062 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3931f9-5e84-4b5a-8b7f-520d64cb13bf service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:23.187308 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1304/2594] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:39:26.757925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a04ba2-4fe1-4704-be16-5bf15606c89a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:26.759664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-77a04ba2-4fe1-4704-be16-5bf15606c89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:26.777547 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a04ba2-4fe1-4704-be16-5bf15606c89a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:26.782325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025ccf6-eee9-4541-b96d-6a488ec6c542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:26.782980 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025ccf6-eee9-4541-b96d-6a488ec6c542 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:26.783361 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025ccf6-eee9-4541-b96d-6a488ec6c542 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:26.783735 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025ccf6-eee9-4541-b96d-6a488ec6c542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:26.785576 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b025ccf6-eee9-4541-b96d-6a488ec6c542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:26.855331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025ccf6-eee9-4541-b96d-6a488ec6c542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:26.856886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025ccf6-eee9-4541-b96d-6a488ec6c542 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:26.866664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1291/2595] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:39:31.055545 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3931f9-5e84-4b5a-8b7f-520d64cb13bf service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:31.057196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5e3931f9-5e84-4b5a-8b7f-520d64cb13bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:31.132232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3931f9-5e84-4b5a-8b7f-520d64cb13bf service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:31.137298 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546191ad-4b93-4dbd-9561-5993e5e9974b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25109eeb1b34b3689b10e3f7c44a6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:31.138115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546191ad-4b93-4dbd-9561-5993e5e9974b service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:31.138399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546191ad-4b93-4dbd-9561-5993e5e9974b service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:31.138675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546191ad-4b93-4dbd-9561-5993e5e9974b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:31.140427 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-546191ad-4b93-4dbd-9561-5993e5e9974b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:31.152141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546191ad-4b93-4dbd-9561-5993e5e9974b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:31.153863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546191ad-4b93-4dbd-9561-5993e5e9974b service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:31.164036 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1305/2596] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:39:31.195156 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025ccf6-eee9-4541-b96d-6a488ec6c542 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:31.196604 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b025ccf6-eee9-4541-b96d-6a488ec6c542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:31.209081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025ccf6-eee9-4541-b96d-6a488ec6c542 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:31.214931 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1ddb8-6e66-409b-9ece-f51a20c352a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:31.215573 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1ddb8-6e66-409b-9ece-f51a20c352a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:31.215851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1ddb8-6e66-409b-9ece-f51a20c352a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:31.216711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1ddb8-6e66-409b-9ece-f51a20c352a3 admin admin] PATH_INFO: `/v3/users/65e23f2d5c78471b87eb64d7a9c07b86` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:31.217434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1ddb8-6e66-409b-9ece-f51a20c352a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e23f2d5c78471b87eb64d7a9c07b86)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:31.219530 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1ddb8-6e66-409b-9ece-f51a20c352a3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:31.426480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1ea1ddb8-6e66-409b-9ece-f51a20c352a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e23f2d5c78471b87eb64d7a9c07b86'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:31.438513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1ea1ddb8-6e66-409b-9ece-f51a20c352a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e23f2d5c78471b87eb64d7a9c07b86'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:31.445548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1ea1ddb8-6e66-409b-9ece-f51a20c352a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e23f2d5c78471b87eb64d7a9c07b86'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:31.446246 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1ea1ddb8-6e66-409b-9ece-f51a20c352a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e23f2d5c78471b87eb64d7a9c07b86'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:31.511829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1ea1ddb8-6e66-409b-9ece-f51a20c352a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e23f2d5c78471b87eb64d7a9c07b86'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:31.520847 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1292/2597] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:31 2022] DELETE /identity/v3/users/65e23f2d5c78471b87eb64d7a9c07b86 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:31.752460 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546191ad-4b93-4dbd-9561-5993e5e9974b service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:31.763719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546191ad-4b93-4dbd-9561-5993e5e9974b service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:31.824714 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753ebe8-fb6c-4e86-a8bb-f12fecaa0d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:31.825347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753ebe8-fb6c-4e86-a8bb-f12fecaa0d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:31.825626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753ebe8-fb6c-4e86-a8bb-f12fecaa0d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:31.825932 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753ebe8-fb6c-4e86-a8bb-f12fecaa0d05 admin admin] PATH_INFO: `/v3/projects/ebd1c6172f374b3db629c3a9b5cf02a7` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:31.827135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753ebe8-fb6c-4e86-a8bb-f12fecaa0d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd1c6172f374b3db629c3a9b5cf02a7)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:31.831210 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753ebe8-fb6c-4e86-a8bb-f12fecaa0d05 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:31.956561 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:31.964155 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8753ebe8-fb6c-4e86-a8bb-f12fecaa0d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd1c6172f374b3db629c3a9b5cf02a7', 'request_id': 'req-8753ebe8-fb6c-4e86-a8bb-f12fecaa0d05'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:32.043056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8753ebe8-fb6c-4e86-a8bb-f12fecaa0d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd1c6172f374b3db629c3a9b5cf02a7', 'request_id': 'req-8753ebe8-fb6c-4e86-a8bb-f12fecaa0d05'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:32.050063 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8753ebe8-fb6c-4e86-a8bb-f12fecaa0d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd1c6172f374b3db629c3a9b5cf02a7', 'request_id': 'req-8753ebe8-fb6c-4e86-a8bb-f12fecaa0d05'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:32.060313 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8753ebe8-fb6c-4e86-a8bb-f12fecaa0d05 admin admin] The token cache is being invalidate because project ebd1c6172f374b3db629c3a9b5cf02a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:39:32.060884 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8753ebe8-fb6c-4e86-a8bb-f12fecaa0d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:32.061301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8753ebe8-fb6c-4e86-a8bb-f12fecaa0d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:32.062780 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1306/2598] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:39:31 2022] DELETE /identity/v3/projects/ebd1c6172f374b3db629c3a9b5cf02a7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:32.067769 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e1565-07a6-4e6d-8e1c-307e809032b6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:32.068060 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e1565-07a6-4e6d-8e1c-307e809032b6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:32.074303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e1565-07a6-4e6d-8e1c-307e809032b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:32.087810 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5b7e1565-07a6-4e6d-8e1c-307e809032b6 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:32.089659 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5b7e1565-07a6-4e6d-8e1c-307e809032b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:32.127188 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:32.158434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1293/2599] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:39:32.161124 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633fe38-53b2-40bc-ba96-7b9ec6ffc129 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:32.161418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633fe38-53b2-40bc-ba96-7b9ec6ffc129 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:32.161696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633fe38-53b2-40bc-ba96-7b9ec6ffc129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:32.181813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b633fe38-53b2-40bc-ba96-7b9ec6ffc129 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:32.183639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b633fe38-53b2-40bc-ba96-7b9ec6ffc129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:32.191969 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1307/2600] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:32.196645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e1565-07a6-4e6d-8e1c-307e809032b6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:32.207372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e1565-07a6-4e6d-8e1c-307e809032b6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:32.213225 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fcdf3-465a-4a09-9761-425719920d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:32.213973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fcdf3-465a-4a09-9761-425719920d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:32.214259 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fcdf3-465a-4a09-9761-425719920d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:32.218761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fcdf3-465a-4a09-9761-425719920d5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:32.218761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fcdf3-465a-4a09-9761-425719920d5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:39:32.218761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fcdf3-465a-4a09-9761-425719920d5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:32.218761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fcdf3-465a-4a09-9761-425719920d5b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:32.229721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1294/2601] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:39:32.234223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633fe38-53b2-40bc-ba96-7b9ec6ffc129 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:32.244469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633fe38-53b2-40bc-ba96-7b9ec6ffc129 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:32.249871 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f8f56-6d06-4524-81ec-4ced409c17b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:32.250467 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f8f56-6d06-4524-81ec-4ced409c17b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:32.250748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f8f56-6d06-4524-81ec-4ced409c17b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:32.251020 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f8f56-6d06-4524-81ec-4ced409c17b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:32.251646 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f8f56-6d06-4524-81ec-4ced409c17b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:32.253538 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f8f56-6d06-4524-81ec-4ced409c17b0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:32.395642 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1308/2602] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:39:32 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:32.399927 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fcdf3-465a-4a09-9761-425719920d5b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:32.410577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fcdf3-465a-4a09-9761-425719920d5b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:32.466530 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5724bc3-5e67-446f-b3cb-711a72af7fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:32.467135 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5724bc3-5e67-446f-b3cb-711a72af7fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:32.467416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5724bc3-5e67-446f-b3cb-711a72af7fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:32.467688 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5724bc3-5e67-446f-b3cb-711a72af7fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:32.468318 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5724bc3-5e67-446f-b3cb-711a72af7fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:32.470338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5724bc3-5e67-446f-b3cb-711a72af7fa9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:32.592365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1295/2603] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:39:32 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:32.596848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f8f56-6d06-4524-81ec-4ced409c17b0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:32.609874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f8f56-6d06-4524-81ec-4ced409c17b0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:32.612923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f13baf-c51d-4cbf-8ba0-41ce4f73e2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:32.613548 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f13baf-c51d-4cbf-8ba0-41ce4f73e2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:32.613920 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f13baf-c51d-4cbf-8ba0-41ce4f73e2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:32.614237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f13baf-c51d-4cbf-8ba0-41ce4f73e2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:32.614925 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f13baf-c51d-4cbf-8ba0-41ce4f73e2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:32.616549 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f13baf-c51d-4cbf-8ba0-41ce4f73e2b3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:32.627814 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1309/2604] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:32.638522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5724bc3-5e67-446f-b3cb-711a72af7fa9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:32.642356 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5724bc3-5e67-446f-b3cb-711a72af7fa9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:32.646937 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ebad9-ffa9-4958-b017-a60c023c072b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:32.647524 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ebad9-ffa9-4958-b017-a60c023c072b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:32.647822 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ebad9-ffa9-4958-b017-a60c023c072b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:32.648091 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ebad9-ffa9-4958-b017-a60c023c072b admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:32.648719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ebad9-ffa9-4958-b017-a60c023c072b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:32.650495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ebad9-ffa9-4958-b017-a60c023c072b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:32.662503 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1296/2605] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:39:32.673360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f13baf-c51d-4cbf-8ba0-41ce4f73e2b3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:32.684047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f13baf-c51d-4cbf-8ba0-41ce4f73e2b3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:32.688586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a30a8-52bc-4cf6-b148-dc408f717c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:32.689222 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a30a8-52bc-4cf6-b148-dc408f717c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:32.689514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a30a8-52bc-4cf6-b148-dc408f717c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:32.689790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a30a8-52bc-4cf6-b148-dc408f717c21 admin admin] PATH_INFO: `/v3/projects/0c7034c8cc7943f2bdebe60f6b94f077/users/e32566a42a2c4c7aaaf4d7ca731902be/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:32.707889 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a30a8-52bc-4cf6-b148-dc408f717c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c7034c8cc7943f2bdebe60f6b94f077, user_id=e32566a42a2c4c7aaaf4d7ca731902be, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:32.707889 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a30a8-52bc-4cf6-b148-dc408f717c21 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:32.797639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1310/2606] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:32 2022] PUT /identity/v3/projects/0c7034c8cc7943f2bdebe60f6b94f077/users/e32566a42a2c4c7aaaf4d7ca731902be/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:32.808487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04333eca-6eeb-4296-8f3c-9db96c4bdeef None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:32.808774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04333eca-6eeb-4296-8f3c-9db96c4bdeef None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:32.809050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04333eca-6eeb-4296-8f3c-9db96c4bdeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:32.837249 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-04333eca-6eeb-4296-8f3c-9db96c4bdeef None None] MFA Rules not processed for user `e32566a42a2c4c7aaaf4d7ca731902be`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:32.838597 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-04333eca-6eeb-4296-8f3c-9db96c4bdeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:32.905877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1297/2607] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:32.917956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a30a8-52bc-4cf6-b148-dc408f717c21 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:32.919629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-988a30a8-52bc-4cf6-b148-dc408f717c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:32.975183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a30a8-52bc-4cf6-b148-dc408f717c21 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:32.978886 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21fc7e-a1e4-415c-8b68-df375c978f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:32.980091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21fc7e-a1e4-415c-8b68-df375c978f99 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:32.980368 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21fc7e-a1e4-415c-8b68-df375c978f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:32.980638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21fc7e-a1e4-415c-8b68-df375c978f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:32.989776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21fc7e-a1e4-415c-8b68-df375c978f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:32.991234 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21fc7e-a1e4-415c-8b68-df375c978f99 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:32.999983 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1311/2608] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:39:38.996744 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04333eca-6eeb-4296-8f3c-9db96c4bdeef None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:38.998195 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-04333eca-6eeb-4296-8f3c-9db96c4bdeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:39.036865 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:39.072849 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04333eca-6eeb-4296-8f3c-9db96c4bdeef None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:39.078579 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b87c5-c9b1-48b5-a102-a3fd0615d4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:39.079427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b87c5-c9b1-48b5-a102-a3fd0615d4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:39.079879 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b87c5-c9b1-48b5-a102-a3fd0615d4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:39.080410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b87c5-c9b1-48b5-a102-a3fd0615d4d2 admin admin] PATH_INFO: `/v3/users/3e997a3d413245169bd6830a12db62da` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:39.081586 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b87c5-c9b1-48b5-a102-a3fd0615d4d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e997a3d413245169bd6830a12db62da)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:39.083563 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b87c5-c9b1-48b5-a102-a3fd0615d4d2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:39.253585 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6b5b87c5-c9b1-48b5-a102-a3fd0615d4d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e997a3d413245169bd6830a12db62da'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:39.271553 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6b5b87c5-c9b1-48b5-a102-a3fd0615d4d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e997a3d413245169bd6830a12db62da'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:39.279448 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6b5b87c5-c9b1-48b5-a102-a3fd0615d4d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e997a3d413245169bd6830a12db62da'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:39.280459 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6b5b87c5-c9b1-48b5-a102-a3fd0615d4d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e997a3d413245169bd6830a12db62da'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:39.384944 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6b5b87c5-c9b1-48b5-a102-a3fd0615d4d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e997a3d413245169bd6830a12db62da'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:39.395165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1298/2609] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:38 2022] DELETE /identity/v3/users/3e997a3d413245169bd6830a12db62da => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:39.639318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21fc7e-a1e4-415c-8b68-df375c978f99 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:39.652366 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21fc7e-a1e4-415c-8b68-df375c978f99 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:39.711516 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04102c68-384e-4217-bc9c-3f8b065cb32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:39.712141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04102c68-384e-4217-bc9c-3f8b065cb32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:39.712417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04102c68-384e-4217-bc9c-3f8b065cb32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:39.712690 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04102c68-384e-4217-bc9c-3f8b065cb32e admin admin] PATH_INFO: `/v3/projects/dcb1fbd6f4234ab2997d225eb2aa83f3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:39.713845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04102c68-384e-4217-bc9c-3f8b065cb32e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb1fbd6f4234ab2997d225eb2aa83f3)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:39.715845 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04102c68-384e-4217-bc9c-3f8b065cb32e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:39.724394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:39.888728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-04102c68-384e-4217-bc9c-3f8b065cb32e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb1fbd6f4234ab2997d225eb2aa83f3', 'request_id': 'req-04102c68-384e-4217-bc9c-3f8b065cb32e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:39.977024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-04102c68-384e-4217-bc9c-3f8b065cb32e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb1fbd6f4234ab2997d225eb2aa83f3', 'request_id': 'req-04102c68-384e-4217-bc9c-3f8b065cb32e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:39.984106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-04102c68-384e-4217-bc9c-3f8b065cb32e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb1fbd6f4234ab2997d225eb2aa83f3', 'request_id': 'req-04102c68-384e-4217-bc9c-3f8b065cb32e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:39.994371 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-04102c68-384e-4217-bc9c-3f8b065cb32e admin admin] The token cache is being invalidate because project dcb1fbd6f4234ab2997d225eb2aa83f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:39:39.994653 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-04102c68-384e-4217-bc9c-3f8b065cb32e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:39.995278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-04102c68-384e-4217-bc9c-3f8b065cb32e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:39.996727 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1312/2610] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:39:39 2022] DELETE /identity/v3/projects/dcb1fbd6f4234ab2997d225eb2aa83f3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:40.000710 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b87c5-c9b1-48b5-a102-a3fd0615d4d2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:40.002192 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6b5b87c5-c9b1-48b5-a102-a3fd0615d4d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:40.015899 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b87c5-c9b1-48b5-a102-a3fd0615d4d2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:40.072121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fef93f-dfef-4643-aab7-9a50adb70d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:40.072746 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fef93f-dfef-4643-aab7-9a50adb70d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:40.073026 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fef93f-dfef-4643-aab7-9a50adb70d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:40.073301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fef93f-dfef-4643-aab7-9a50adb70d8e admin admin] PATH_INFO: `/v3/users/ce6bbd789eb543f6bd927f60d85d2a9f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:40.074497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fef93f-dfef-4643-aab7-9a50adb70d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce6bbd789eb543f6bd927f60d85d2a9f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:40.076941 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fef93f-dfef-4643-aab7-9a50adb70d8e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:40.336457 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-15fef93f-dfef-4643-aab7-9a50adb70d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce6bbd789eb543f6bd927f60d85d2a9f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:40.341655 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:40.348798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-15fef93f-dfef-4643-aab7-9a50adb70d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce6bbd789eb543f6bd927f60d85d2a9f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:40.355446 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-15fef93f-dfef-4643-aab7-9a50adb70d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce6bbd789eb543f6bd927f60d85d2a9f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:40.356182 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-15fef93f-dfef-4643-aab7-9a50adb70d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce6bbd789eb543f6bd927f60d85d2a9f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:40.448376 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-15fef93f-dfef-4643-aab7-9a50adb70d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce6bbd789eb543f6bd927f60d85d2a9f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:40.456863 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1299/2611] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:39 2022] DELETE /identity/v3/users/ce6bbd789eb543f6bd927f60d85d2a9f => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:40.735878 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04102c68-384e-4217-bc9c-3f8b065cb32e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:40.737309 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-04102c68-384e-4217-bc9c-3f8b065cb32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:40.752094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04102c68-384e-4217-bc9c-3f8b065cb32e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:40.809984 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2b37e-9f14-4045-b8cc-d4dfd83f0028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:40.810986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2b37e-9f14-4045-b8cc-d4dfd83f0028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:40.811255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2b37e-9f14-4045-b8cc-d4dfd83f0028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:40.811677 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2b37e-9f14-4045-b8cc-d4dfd83f0028 admin admin] PATH_INFO: `/v3/projects/7dbc9a79e862499fbf801a5c7729dbc6` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:40.812816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2b37e-9f14-4045-b8cc-d4dfd83f0028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dbc9a79e862499fbf801a5c7729dbc6)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:40.814932 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2b37e-9f14-4045-b8cc-d4dfd83f0028 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:40.829133 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fef93f-dfef-4643-aab7-9a50adb70d8e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:40.830656 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-15fef93f-dfef-4643-aab7-9a50adb70d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:40.845254 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fef93f-dfef-4643-aab7-9a50adb70d8e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:40.850388 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32a869-0229-441c-90e4-b71822e0fef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:40.851014 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32a869-0229-441c-90e4-b71822e0fef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:40.851353 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32a869-0229-441c-90e4-b71822e0fef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:40.851595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32a869-0229-441c-90e4-b71822e0fef9 admin admin] PATH_INFO: `/v3/users/a8dd0999d38a4340baaef5adcd41dac2` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:40.852722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32a869-0229-441c-90e4-b71822e0fef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8dd0999d38a4340baaef5adcd41dac2)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:40.854699 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32a869-0229-441c-90e4-b71822e0fef9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:40.939749 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-30f2b37e-9f14-4045-b8cc-d4dfd83f0028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dbc9a79e862499fbf801a5c7729dbc6', 'request_id': 'req-30f2b37e-9f14-4045-b8cc-d4dfd83f0028'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:41.036441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-30f2b37e-9f14-4045-b8cc-d4dfd83f0028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dbc9a79e862499fbf801a5c7729dbc6', 'request_id': 'req-30f2b37e-9f14-4045-b8cc-d4dfd83f0028'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:41.043094 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-30f2b37e-9f14-4045-b8cc-d4dfd83f0028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dbc9a79e862499fbf801a5c7729dbc6', 'request_id': 'req-30f2b37e-9f14-4045-b8cc-d4dfd83f0028'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:41.054187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-30f2b37e-9f14-4045-b8cc-d4dfd83f0028 admin admin] The token cache is being invalidate because project 7dbc9a79e862499fbf801a5c7729dbc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:39:41.054475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-30f2b37e-9f14-4045-b8cc-d4dfd83f0028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:41.055102 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-30f2b37e-9f14-4045-b8cc-d4dfd83f0028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:41.056573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1313/2612] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:39:40 2022] DELETE /identity/v3/projects/7dbc9a79e862499fbf801a5c7729dbc6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:41.062139 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cc5b5-0be5-4218-a842-cd08a480f4eb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:41.062439 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cc5b5-0be5-4218-a842-cd08a480f4eb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:41.062707 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cc5b5-0be5-4218-a842-cd08a480f4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:41.073366 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0d32a869-0229-441c-90e4-b71822e0fef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8dd0999d38a4340baaef5adcd41dac2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:41.083871 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-140cc5b5-0be5-4218-a842-cd08a480f4eb None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:41.085563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-140cc5b5-0be5-4218-a842-cd08a480f4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:41.091811 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0d32a869-0229-441c-90e4-b71822e0fef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8dd0999d38a4340baaef5adcd41dac2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:41.103050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0d32a869-0229-441c-90e4-b71822e0fef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8dd0999d38a4340baaef5adcd41dac2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:41.103756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0d32a869-0229-441c-90e4-b71822e0fef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8dd0999d38a4340baaef5adcd41dac2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:41.106513 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:41.144895 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1314/2613] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:39:41.152527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b450d3-76ae-4dbf-89b7-dae99dcfeca3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:41.152809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b450d3-76ae-4dbf-89b7-dae99dcfeca3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:41.153080 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b450d3-76ae-4dbf-89b7-dae99dcfeca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:41.172817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c4b450d3-76ae-4dbf-89b7-dae99dcfeca3 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:41.173433 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0d32a869-0229-441c-90e4-b71822e0fef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8dd0999d38a4340baaef5adcd41dac2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:41.174017 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c4b450d3-76ae-4dbf-89b7-dae99dcfeca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:41.179758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1300/2614] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:40 2022] DELETE /identity/v3/users/a8dd0999d38a4340baaef5adcd41dac2 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:41.185227 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1315/2615] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:39:41.185399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b19fe-eb9f-4788-876b-65f9678b036e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:41.185399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b19fe-eb9f-4788-876b-65f9678b036e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:41.185399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b19fe-eb9f-4788-876b-65f9678b036e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:41.186248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b450d3-76ae-4dbf-89b7-dae99dcfeca3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:41.195214 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b450d3-76ae-4dbf-89b7-dae99dcfeca3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:41.202983 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8e0b19fe-eb9f-4788-876b-65f9678b036e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:41.204190 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8e0b19fe-eb9f-4788-876b-65f9678b036e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:41.251485 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b30ed3-dcca-47f0-80b2-281a4e9b586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:41.252093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b30ed3-dcca-47f0-80b2-281a4e9b586d admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:41.252368 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b30ed3-dcca-47f0-80b2-281a4e9b586d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:41.252657 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b30ed3-dcca-47f0-80b2-281a4e9b586d admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:41.253265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b30ed3-dcca-47f0-80b2-281a4e9b586d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:39:41.254015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b30ed3-dcca-47f0-80b2-281a4e9b586d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:41.255303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b30ed3-dcca-47f0-80b2-281a4e9b586d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:41.264650 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1301/2616] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:41.267540 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1316/2617] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:39:41.271971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b19fe-eb9f-4788-876b-65f9678b036e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:41.274327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b30ed3-dcca-47f0-80b2-281a4e9b586d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:41.276013 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a6b30ed3-dcca-47f0-80b2-281a4e9b586d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:41.283030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b19fe-eb9f-4788-876b-65f9678b036e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:41.287787 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60386a17-b96c-44b8-802f-3260659f3d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:41.288361 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60386a17-b96c-44b8-802f-3260659f3d9f admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:41.288643 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60386a17-b96c-44b8-802f-3260659f3d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:41.288916 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60386a17-b96c-44b8-802f-3260659f3d9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:41.289552 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60386a17-b96c-44b8-802f-3260659f3d9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:41.291480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60386a17-b96c-44b8-802f-3260659f3d9f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:41.332409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b30ed3-dcca-47f0-80b2-281a4e9b586d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:41.336893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f765a-58ff-4f1c-884a-e1a3adc5ea09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:41.337489 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f765a-58ff-4f1c-884a-e1a3adc5ea09 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:41.337818 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f765a-58ff-4f1c-884a-e1a3adc5ea09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:41.338156 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f765a-58ff-4f1c-884a-e1a3adc5ea09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:41.348428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f765a-58ff-4f1c-884a-e1a3adc5ea09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:41.349900 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f765a-58ff-4f1c-884a-e1a3adc5ea09 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:41.359705 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1317/2618] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:39:41.398245 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1302/2619] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:39:41 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:41.402641 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f765a-58ff-4f1c-884a-e1a3adc5ea09 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:41.412822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f765a-58ff-4f1c-884a-e1a3adc5ea09 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:41.467294 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:41.473348 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e1eb4-d498-4913-aa2b-2c393c775299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:41.473978 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e1eb4-d498-4913-aa2b-2c393c775299 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:41.474255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e1eb4-d498-4913-aa2b-2c393c775299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:41.474548 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e1eb4-d498-4913-aa2b-2c393c775299 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:41.475187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e1eb4-d498-4913-aa2b-2c393c775299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:41.477151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e1eb4-d498-4913-aa2b-2c393c775299 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:41.558910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1318/2620] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:39:41 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:41.562177 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60386a17-b96c-44b8-802f-3260659f3d9f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:41.573016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60386a17-b96c-44b8-802f-3260659f3d9f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:41.578338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9d30b-4d06-4b57-9943-e44fbaf02170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:41.578938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9d30b-4d06-4b57-9943-e44fbaf02170 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:41.579213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9d30b-4d06-4b57-9943-e44fbaf02170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:41.579480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9d30b-4d06-4b57-9943-e44fbaf02170 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:41.580116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9d30b-4d06-4b57-9943-e44fbaf02170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:41.581758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9d30b-4d06-4b57-9943-e44fbaf02170 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:41.593715 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1303/2621] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:41.597570 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e1eb4-d498-4913-aa2b-2c393c775299 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:41.608181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e1eb4-d498-4913-aa2b-2c393c775299 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:41.612835 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e190cb0-f5a1-4754-ad3b-4cfb16cd91e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:41.613432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e190cb0-f5a1-4754-ad3b-4cfb16cd91e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:41.613711 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e190cb0-f5a1-4754-ad3b-4cfb16cd91e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:41.614030 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e190cb0-f5a1-4754-ad3b-4cfb16cd91e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:41.614667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e190cb0-f5a1-4754-ad3b-4cfb16cd91e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:41.616259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e190cb0-f5a1-4754-ad3b-4cfb16cd91e8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:41.627683 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1319/2622] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:41.631528 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9d30b-4d06-4b57-9943-e44fbaf02170 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:41.642864 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9d30b-4d06-4b57-9943-e44fbaf02170 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:41.647643 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42535d22-c2a0-47cf-9dd6-371c969b6fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:41.648288 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42535d22-c2a0-47cf-9dd6-371c969b6fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:41.648565 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42535d22-c2a0-47cf-9dd6-371c969b6fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:41.648836 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42535d22-c2a0-47cf-9dd6-371c969b6fbc admin admin] PATH_INFO: `/v3/projects/620961838fd443f0b8ec766233ad6a66/users/97f1d752ef36424a8606db64c2fe2a14/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:41.658897 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:41.665666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42535d22-c2a0-47cf-9dd6-371c969b6fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=620961838fd443f0b8ec766233ad6a66, user_id=97f1d752ef36424a8606db64c2fe2a14, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:41.668523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42535d22-c2a0-47cf-9dd6-371c969b6fbc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:41.749047 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1304/2623] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:41 2022] PUT /identity/v3/projects/620961838fd443f0b8ec766233ad6a66/users/97f1d752ef36424a8606db64c2fe2a14/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:41.750416 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e190cb0-f5a1-4754-ad3b-4cfb16cd91e8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:41.754995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1e190cb0-f5a1-4754-ad3b-4cfb16cd91e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:41.760046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aaf1c-4af9-4731-a0b1-90b441dc91b8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:41.760372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aaf1c-4af9-4731-a0b1-90b441dc91b8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:41.760593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aaf1c-4af9-4731-a0b1-90b441dc91b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:41.772343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e190cb0-f5a1-4754-ad3b-4cfb16cd91e8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:41.792073 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-405aaf1c-4af9-4731-a0b1-90b441dc91b8 None None] MFA Rules not processed for user `97f1d752ef36424a8606db64c2fe2a14`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:41.793255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-405aaf1c-4af9-4731-a0b1-90b441dc91b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:41.834828 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:41.835484 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:41.835762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:41.836035 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0 admin admin] PATH_INFO: `/v3/projects/61bb27f18d7f4161b6300b5831c2147f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:41.837233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61bb27f18d7f4161b6300b5831c2147f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:41.839267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:41.961237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61bb27f18d7f4161b6300b5831c2147f', 'request_id': 'req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:41.981790 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1305/2624] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:39:41.992902 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405aaf1c-4af9-4731-a0b1-90b441dc91b8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:41.994211 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-405aaf1c-4af9-4731-a0b1-90b441dc91b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:42.049026 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405aaf1c-4af9-4731-a0b1-90b441dc91b8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:42.057101 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61bb27f18d7f4161b6300b5831c2147f', 'request_id': 'req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:42.064579 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61bb27f18d7f4161b6300b5831c2147f', 'request_id': 'req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:42.074900 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0 admin admin] The token cache is being invalidate because project 61bb27f18d7f4161b6300b5831c2147f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:39:42.075191 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:42.076392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:42.077898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1320/2625] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:39:41 2022] DELETE /identity/v3/projects/61bb27f18d7f4161b6300b5831c2147f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:42.082113 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:42.083610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:42.098059 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6f135-f396-4da1-9fa4-3458f0519ea7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1879a3ad7be74303b9feceff75f62979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:42.098663 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6f135-f396-4da1-9fa4-3458f0519ea7 service glance] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:42.098936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6f135-f396-4da1-9fa4-3458f0519ea7 service glance] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:42.099201 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6f135-f396-4da1-9fa4-3458f0519ea7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:42.100896 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-43b6f135-f396-4da1-9fa4-3458f0519ea7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:42.149298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:42.156227 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b072e3-b450-4bba-9b9a-6a9ff8d479a0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:42.161432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed243f-283b-48ab-86ce-134e425763ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:42.162123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed243f-283b-48ab-86ce-134e425763ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:42.162406 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed243f-283b-48ab-86ce-134e425763ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:42.162675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed243f-283b-48ab-86ce-134e425763ca admin admin] PATH_INFO: `/v3/users/48cba13e3c754a71b18505e74ed84bb8` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:42.163813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed243f-283b-48ab-86ce-134e425763ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=48cba13e3c754a71b18505e74ed84bb8)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:42.165705 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed243f-283b-48ab-86ce-134e425763ca admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:42.170022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6f135-f396-4da1-9fa4-3458f0519ea7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:42.171721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6f135-f396-4da1-9fa4-3458f0519ea7 service glance] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:42.175435 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:42.182403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1306/2626] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:39:42.335090 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9eed243f-283b-48ab-86ce-134e425763ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48cba13e3c754a71b18505e74ed84bb8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:42.347746 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9eed243f-283b-48ab-86ce-134e425763ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48cba13e3c754a71b18505e74ed84bb8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:42.355522 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9eed243f-283b-48ab-86ce-134e425763ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48cba13e3c754a71b18505e74ed84bb8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:42.355522 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9eed243f-283b-48ab-86ce-134e425763ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48cba13e3c754a71b18505e74ed84bb8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:42.432287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9eed243f-283b-48ab-86ce-134e425763ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48cba13e3c754a71b18505e74ed84bb8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:42.440101 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1321/2627] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:42 2022] DELETE /identity/v3/users/48cba13e3c754a71b18505e74ed84bb8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:42.836293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6f135-f396-4da1-9fa4-3458f0519ea7 service glance] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:42.847768 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6f135-f396-4da1-9fa4-3458f0519ea7 service glance] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:42.904055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7f200-7799-4f5f-b96a-e905850a103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:42.904916 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7f200-7799-4f5f-b96a-e905850a103e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:42.905539 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7f200-7799-4f5f-b96a-e905850a103e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:42.905749 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7f200-7799-4f5f-b96a-e905850a103e admin admin] PATH_INFO: `/v3/projects/ac2710ab63ef4d1180efc2aa8c91a328` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:42.906873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7f200-7799-4f5f-b96a-e905850a103e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac2710ab63ef4d1180efc2aa8c91a328)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:42.908786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7f200-7799-4f5f-b96a-e905850a103e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:43.042281 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fcf7f200-7799-4f5f-b96a-e905850a103e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac2710ab63ef4d1180efc2aa8c91a328', 'request_id': 'req-fcf7f200-7799-4f5f-b96a-e905850a103e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:43.209829 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed243f-283b-48ab-86ce-134e425763ca admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:43.211418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9eed243f-283b-48ab-86ce-134e425763ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:43.213696 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fcf7f200-7799-4f5f-b96a-e905850a103e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac2710ab63ef4d1180efc2aa8c91a328', 'request_id': 'req-fcf7f200-7799-4f5f-b96a-e905850a103e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:43.223864 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fcf7f200-7799-4f5f-b96a-e905850a103e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac2710ab63ef4d1180efc2aa8c91a328', 'request_id': 'req-fcf7f200-7799-4f5f-b96a-e905850a103e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:43.229403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed243f-283b-48ab-86ce-134e425763ca admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:43.232961 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fcf7f200-7799-4f5f-b96a-e905850a103e admin admin] The token cache is being invalidate because project ac2710ab63ef4d1180efc2aa8c91a328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:39:43.233336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fcf7f200-7799-4f5f-b96a-e905850a103e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:43.234018 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fcf7f200-7799-4f5f-b96a-e905850a103e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:43.235910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1307/2628] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:39:42 2022] DELETE /identity/v3/projects/ac2710ab63ef4d1180efc2aa8c91a328 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:43.241113 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18344ac9-5a35-4231-ae10-d6c0fcac7c2e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:43.241113 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18344ac9-5a35-4231-ae10-d6c0fcac7c2e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:43.241113 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18344ac9-5a35-4231-ae10-d6c0fcac7c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:43.262068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-18344ac9-5a35-4231-ae10-d6c0fcac7c2e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:43.263408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-18344ac9-5a35-4231-ae10-d6c0fcac7c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:43.293896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c3ce2-510c-4b43-9cfa-5beb59771638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:43.295058 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3ce2-510c-4b43-9cfa-5beb59771638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:43.295332 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3ce2-510c-4b43-9cfa-5beb59771638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:43.295597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3ce2-510c-4b43-9cfa-5beb59771638 admin admin] PATH_INFO: `/v3/users/e32566a42a2c4c7aaaf4d7ca731902be` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:43.296921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c3ce2-510c-4b43-9cfa-5beb59771638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32566a42a2c4c7aaaf4d7ca731902be)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:43.298964 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c3ce2-510c-4b43-9cfa-5beb59771638 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:43.330583 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1308/2629] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:39:43.339493 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4cd5b-904d-43c2-8301-8ff163b958cb None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:43.339778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4cd5b-904d-43c2-8301-8ff163b958cb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:43.340049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4cd5b-904d-43c2-8301-8ff163b958cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:43.360363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-38d4cd5b-904d-43c2-8301-8ff163b958cb None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:43.361628 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-38d4cd5b-904d-43c2-8301-8ff163b958cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:43.369405 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1309/2630] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:39:43.373413 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4cd5b-904d-43c2-8301-8ff163b958cb None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:43.382112 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4cd5b-904d-43c2-8301-8ff163b958cb None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:43.386599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd6cdf-bcc8-4b5f-8df0-193731774fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:43.387207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6cdf-bcc8-4b5f-8df0-193731774fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:43.387485 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6cdf-bcc8-4b5f-8df0-193731774fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:43.387756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6cdf-bcc8-4b5f-8df0-193731774fa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:43.388414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6cdf-bcc8-4b5f-8df0-193731774fa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:39:43.388714 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6cdf-bcc8-4b5f-8df0-193731774fa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:43.390314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6cdf-bcc8-4b5f-8df0-193731774fa4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:43.396691 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:43.401776 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1310/2631] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:39:43.406651 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd6cdf-bcc8-4b5f-8df0-193731774fa4 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:43.415731 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd6cdf-bcc8-4b5f-8df0-193731774fa4 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:43.421175 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f2b93-8df6-4155-bb35-f1fb29c67809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:43.421761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f2b93-8df6-4155-bb35-f1fb29c67809 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:43.422099 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f2b93-8df6-4155-bb35-f1fb29c67809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:43.422375 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f2b93-8df6-4155-bb35-f1fb29c67809 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:43.422986 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f2b93-8df6-4155-bb35-f1fb29c67809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:43.425378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f2b93-8df6-4155-bb35-f1fb29c67809 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:43.501298 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-af6c3ce2-510c-4b43-9cfa-5beb59771638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32566a42a2c4c7aaaf4d7ca731902be'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:43.513128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-af6c3ce2-510c-4b43-9cfa-5beb59771638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32566a42a2c4c7aaaf4d7ca731902be'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:43.520760 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-af6c3ce2-510c-4b43-9cfa-5beb59771638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32566a42a2c4c7aaaf4d7ca731902be'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:43.521564 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-af6c3ce2-510c-4b43-9cfa-5beb59771638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32566a42a2c4c7aaaf4d7ca731902be'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:43.524342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1311/2632] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:39:43 2022] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:39:43.529071 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f2b93-8df6-4155-bb35-f1fb29c67809 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:43.531067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-625f2b93-8df6-4155-bb35-f1fb29c67809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:43.594724 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f2b93-8df6-4155-bb35-f1fb29c67809 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:43.599557 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0301-ee66-4d9e-90c1-30a9ae416899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:43.600171 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0301-ee66-4d9e-90c1-30a9ae416899 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:43.600432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0301-ee66-4d9e-90c1-30a9ae416899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:43.600701 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0301-ee66-4d9e-90c1-30a9ae416899 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:43.601322 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db0301-ee66-4d9e-90c1-30a9ae416899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:43.603405 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db0301-ee66-4d9e-90c1-30a9ae416899 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:43.645607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-af6c3ce2-510c-4b43-9cfa-5beb59771638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32566a42a2c4c7aaaf4d7ca731902be'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:43.652737 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1322/2633] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:43 2022] DELETE /identity/v3/users/e32566a42a2c4c7aaaf4d7ca731902be => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:43.658257 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086f10d-640e-4218-a396-a530ebf00df9 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:43.658578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086f10d-640e-4218-a396-a530ebf00df9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:43.658916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086f10d-640e-4218-a396-a530ebf00df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:43.669330 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:43.681078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6086f10d-640e-4218-a396-a530ebf00df9 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:43.682397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6086f10d-640e-4218-a396-a530ebf00df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:43.741162 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1323/2634] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:39:43.750723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1312/2635] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:39:43 2022] POST /identity/v3/users => generated 282 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:39:43.752352 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086f10d-640e-4218-a396-a530ebf00df9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:43.753905 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6086f10d-640e-4218-a396-a530ebf00df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:43.754794 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0301-ee66-4d9e-90c1-30a9ae416899 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:43.765321 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0301-ee66-4d9e-90c1-30a9ae416899 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:43.770088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcb8dc-c340-405a-8e94-0afd70ff18fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:43.770754 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcb8dc-c340-405a-8e94-0afd70ff18fc admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:43.771116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcb8dc-c340-405a-8e94-0afd70ff18fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:43.771441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcb8dc-c340-405a-8e94-0afd70ff18fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:43.772310 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcb8dc-c340-405a-8e94-0afd70ff18fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:43.774255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcb8dc-c340-405a-8e94-0afd70ff18fc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:43.786818 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1313/2636] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:43.791777 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcb8dc-c340-405a-8e94-0afd70ff18fc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:43.801785 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcb8dc-c340-405a-8e94-0afd70ff18fc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:43.806963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f55391-ed49-4172-b011-99de175cf782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:43.807573 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f55391-ed49-4172-b011-99de175cf782 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:43.808107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f55391-ed49-4172-b011-99de175cf782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:43.808407 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f55391-ed49-4172-b011-99de175cf782 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:43.809038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f55391-ed49-4172-b011-99de175cf782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:43.810829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f55391-ed49-4172-b011-99de175cf782 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:43.813574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086f10d-640e-4218-a396-a530ebf00df9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:43.817402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fade41c-bf5e-4174-925c-52af1dc35468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:43.818099 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fade41c-bf5e-4174-925c-52af1dc35468 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:43.818436 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fade41c-bf5e-4174-925c-52af1dc35468 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:43.818770 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fade41c-bf5e-4174-925c-52af1dc35468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:43.822050 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1314/2637] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:39:43.826133 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f55391-ed49-4172-b011-99de175cf782 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:43.832528 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fade41c-bf5e-4174-925c-52af1dc35468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:43.833994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fade41c-bf5e-4174-925c-52af1dc35468 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:43.836599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f55391-ed49-4172-b011-99de175cf782 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:43.843036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d2b0a-dad1-45f8-93c7-d86449359e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:43.843752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d2b0a-dad1-45f8-93c7-d86449359e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:43.844140 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d2b0a-dad1-45f8-93c7-d86449359e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:43.844423 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d2b0a-dad1-45f8-93c7-d86449359e89 admin admin] PATH_INFO: `/v3/projects/75a26090f17948bd9656801b9c11e418/users/76f60e5b3ead4d5ebe30fde4a151b0c2/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:43.844937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1324/2638] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:39:43.861529 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d2b0a-dad1-45f8-93c7-d86449359e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a26090f17948bd9656801b9c11e418, user_id=76f60e5b3ead4d5ebe30fde4a151b0c2, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:43.864393 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d2b0a-dad1-45f8-93c7-d86449359e89 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:43.979159 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1315/2639] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:43 2022] PUT /identity/v3/projects/75a26090f17948bd9656801b9c11e418/users/76f60e5b3ead4d5ebe30fde4a151b0c2/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:43.980827 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3445fd-1543-4dd1-a51a-cf284c94fd20 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:43.981111 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3445fd-1543-4dd1-a51a-cf284c94fd20 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:43.981414 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3445fd-1543-4dd1-a51a-cf284c94fd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:44.009462 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7d3445fd-1543-4dd1-a51a-cf284c94fd20 None None] MFA Rules not processed for user `76f60e5b3ead4d5ebe30fde4a151b0c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:44.012115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7d3445fd-1543-4dd1-a51a-cf284c94fd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:44.080410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1325/2640] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:44.085360 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d2b0a-dad1-45f8-93c7-d86449359e89 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:44.156833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d2b0a-dad1-45f8-93c7-d86449359e89 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:44.161661 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18982ae6-4be4-496d-bcee-ecbd9af06a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:44.162315 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18982ae6-4be4-496d-bcee-ecbd9af06a6b admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:44.162600 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18982ae6-4be4-496d-bcee-ecbd9af06a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:44.162867 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18982ae6-4be4-496d-bcee-ecbd9af06a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:44.163511 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18982ae6-4be4-496d-bcee-ecbd9af06a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:44.165873 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18982ae6-4be4-496d-bcee-ecbd9af06a6b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:44.319876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1316/2641] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:39:44 2022] POST /identity/v3/projects => generated 363 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:44.320465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3445fd-1543-4dd1-a51a-cf284c94fd20 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:44.328170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3445fd-1543-4dd1-a51a-cf284c94fd20 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:44.362384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18982ae6-4be4-496d-bcee-ecbd9af06a6b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:44.363827 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:44.364258 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-18982ae6-4be4-496d-bcee-ecbd9af06a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:44.379768 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:44.399662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535b4c2-7f7d-4869-8915-64a2c97661b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:44.400357 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535b4c2-7f7d-4869-8915-64a2c97661b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:44.400639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535b4c2-7f7d-4869-8915-64a2c97661b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:44.400917 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535b4c2-7f7d-4869-8915-64a2c97661b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:44.401584 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535b4c2-7f7d-4869-8915-64a2c97661b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:44.403571 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535b4c2-7f7d-4869-8915-64a2c97661b9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:44.441157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18982ae6-4be4-496d-bcee-ecbd9af06a6b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:44.446180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169f5ed-9fdb-4aad-beb4-64c0e4c4b360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:44.450611 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169f5ed-9fdb-4aad-beb4-64c0e4c4b360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:44.450611 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169f5ed-9fdb-4aad-beb4-64c0e4c4b360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:44.450611 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169f5ed-9fdb-4aad-beb4-64c0e4c4b360 admin admin] PATH_INFO: `/v3/projects/0c7034c8cc7943f2bdebe60f6b94f077` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:44.450611 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169f5ed-9fdb-4aad-beb4-64c0e4c4b360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c7034c8cc7943f2bdebe60f6b94f077)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:44.450611 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169f5ed-9fdb-4aad-beb4-64c0e4c4b360 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:44.566975 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1326/2642] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:39:44 2022] POST /identity/v3/users => generated 288 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:44.568242 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535b4c2-7f7d-4869-8915-64a2c97661b9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:44.578309 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535b4c2-7f7d-4869-8915-64a2c97661b9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:44.582923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c334e-b4b7-4ae8-b194-4b4779c88d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:44.583494 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c334e-b4b7-4ae8-b194-4b4779c88d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:44.583767 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c334e-b4b7-4ae8-b194-4b4779c88d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:44.584034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c334e-b4b7-4ae8-b194-4b4779c88d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:44.584682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c334e-b4b7-4ae8-b194-4b4779c88d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:44.586584 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c334e-b4b7-4ae8-b194-4b4779c88d6b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:44.597029 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1327/2643] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:39:44.602490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c334e-b4b7-4ae8-b194-4b4779c88d6b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:44.612869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c334e-b4b7-4ae8-b194-4b4779c88d6b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:44.617625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0f6ea-fcca-4a1d-b6d1-efa590fba9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:44.618437 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0f6ea-fcca-4a1d-b6d1-efa590fba9a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:44.618688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0f6ea-fcca-4a1d-b6d1-efa590fba9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:44.619034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0f6ea-fcca-4a1d-b6d1-efa590fba9a9 admin admin] PATH_INFO: `/v3/projects/7839c9d6370f41799f9d2f9c8adb756b/users/5778f308221b42d8a044c1ab67e8e396/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:44.637339 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0f6ea-fcca-4a1d-b6d1-efa590fba9a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7839c9d6370f41799f9d2f9c8adb756b, user_id=5778f308221b42d8a044c1ab67e8e396, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:44.642305 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0f6ea-fcca-4a1d-b6d1-efa590fba9a9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:44.650754 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4169f5ed-9fdb-4aad-beb4-64c0e4c4b360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c7034c8cc7943f2bdebe60f6b94f077', 'request_id': 'req-4169f5ed-9fdb-4aad-beb4-64c0e4c4b360'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:44.728998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1328/2644] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:44 2022] PUT /identity/v3/projects/7839c9d6370f41799f9d2f9c8adb756b/users/5778f308221b42d8a044c1ab67e8e396/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:44.733391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0f6ea-fcca-4a1d-b6d1-efa590fba9a9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:44.734396 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4169f5ed-9fdb-4aad-beb4-64c0e4c4b360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c7034c8cc7943f2bdebe60f6b94f077', 'request_id': 'req-4169f5ed-9fdb-4aad-beb4-64c0e4c4b360'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:44.740499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4169f5ed-9fdb-4aad-beb4-64c0e4c4b360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c7034c8cc7943f2bdebe60f6b94f077', 'request_id': 'req-4169f5ed-9fdb-4aad-beb4-64c0e4c4b360'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:44.752738 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4169f5ed-9fdb-4aad-beb4-64c0e4c4b360 admin admin] The token cache is being invalidate because project 0c7034c8cc7943f2bdebe60f6b94f077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:39:44.753331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4169f5ed-9fdb-4aad-beb4-64c0e4c4b360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:44.754391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4169f5ed-9fdb-4aad-beb4-64c0e4c4b360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:44.755919 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1317/2645] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:39:44 2022] DELETE /identity/v3/projects/0c7034c8cc7943f2bdebe60f6b94f077 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:44.760659 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0888d72-39b4-46cb-9ad4-d9ef975ed02e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:44.761447 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0888d72-39b4-46cb-9ad4-d9ef975ed02e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:44.761447 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0888d72-39b4-46cb-9ad4-d9ef975ed02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:44.781685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e0888d72-39b4-46cb-9ad4-d9ef975ed02e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:44.782937 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e0888d72-39b4-46cb-9ad4-d9ef975ed02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:44.802928 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0f6ea-fcca-4a1d-b6d1-efa590fba9a9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:44.806877 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3d9cf-e273-4a02-a8b1-2a13a16332f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:44.807773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3d9cf-e273-4a02-a8b1-2a13a16332f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:44.808030 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3d9cf-e273-4a02-a8b1-2a13a16332f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:44.808324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3d9cf-e273-4a02-a8b1-2a13a16332f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:44.809044 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3d9cf-e273-4a02-a8b1-2a13a16332f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:44.810786 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3d9cf-e273-4a02-a8b1-2a13a16332f9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:44.820980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1329/2646] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:44.825046 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3d9cf-e273-4a02-a8b1-2a13a16332f9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:44.826796 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-32b3d9cf-e273-4a02-a8b1-2a13a16332f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:44.839460 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3d9cf-e273-4a02-a8b1-2a13a16332f9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:44.844735 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029240a0-4d9b-4f5f-a3c8-448dbb3255c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:44.845350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029240a0-4d9b-4f5f-a3c8-448dbb3255c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:44.845620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029240a0-4d9b-4f5f-a3c8-448dbb3255c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:44.845930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029240a0-4d9b-4f5f-a3c8-448dbb3255c4 admin admin] PATH_INFO: `/v3/projects/7839c9d6370f41799f9d2f9c8adb756b/users/5778f308221b42d8a044c1ab67e8e396/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:44.847956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029240a0-4d9b-4f5f-a3c8-448dbb3255c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7839c9d6370f41799f9d2f9c8adb756b, user_id=5778f308221b42d8a044c1ab67e8e396, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:44.850619 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029240a0-4d9b-4f5f-a3c8-448dbb3255c4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:44.856006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1318/2647] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:39:44.859554 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55033646-01fd-4871-b41a-68b1820dd4ce None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:44.860024 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55033646-01fd-4871-b41a-68b1820dd4ce None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:44.860533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55033646-01fd-4871-b41a-68b1820dd4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:44.862447 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1330/2648] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:44 2022] PUT /identity/v3/projects/7839c9d6370f41799f9d2f9c8adb756b/users/5778f308221b42d8a044c1ab67e8e396/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:44.873946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf5c87-014d-4910-b332-f70ca3b8265b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:44.874233 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf5c87-014d-4910-b332-f70ca3b8265b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:44.874531 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf5c87-014d-4910-b332-f70ca3b8265b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:44.884333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-55033646-01fd-4871-b41a-68b1820dd4ce None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:44.885853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-55033646-01fd-4871-b41a-68b1820dd4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:44.904151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cccf5c87-014d-4910-b332-f70ca3b8265b None None] MFA Rules not processed for user `5778f308221b42d8a044c1ab67e8e396`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:44.906457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cccf5c87-014d-4910-b332-f70ca3b8265b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:44.922442 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:44.955565 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1319/2649] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:44.959868 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55033646-01fd-4871-b41a-68b1820dd4ce None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:44.970486 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55033646-01fd-4871-b41a-68b1820dd4ce None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:44.976752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f3fdb-68f6-4a37-b0c6-25dd32d19932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:44.977626 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f3fdb-68f6-4a37-b0c6-25dd32d19932 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:44.978065 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f3fdb-68f6-4a37-b0c6-25dd32d19932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:44.978432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f3fdb-68f6-4a37-b0c6-25dd32d19932 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:44.979110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f3fdb-68f6-4a37-b0c6-25dd32d19932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:39:44.979414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f3fdb-68f6-4a37-b0c6-25dd32d19932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:44.981046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f3fdb-68f6-4a37-b0c6-25dd32d19932 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:44.989597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:44.992602 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1331/2650] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:44.996667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1320/2651] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:39:44.998719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf5c87-014d-4910-b332-f70ca3b8265b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:45.005546 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f3fdb-68f6-4a37-b0c6-25dd32d19932 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:45.010055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-548f3fdb-68f6-4a37-b0c6-25dd32d19932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:45.012061 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf5c87-014d-4910-b332-f70ca3b8265b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:45.016993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe008a1b-d41e-4a65-a283-b05a0bec7fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:45.017630 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe008a1b-d41e-4a65-a283-b05a0bec7fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:45.017933 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe008a1b-d41e-4a65-a283-b05a0bec7fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:45.018201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe008a1b-d41e-4a65-a283-b05a0bec7fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:45.018831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe008a1b-d41e-4a65-a283-b05a0bec7fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:45.020752 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe008a1b-d41e-4a65-a283-b05a0bec7fc7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:45.068223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f3fdb-68f6-4a37-b0c6-25dd32d19932 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:45.072346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112613eb-71cb-43d7-a3fc-d49778442848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:45.075046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112613eb-71cb-43d7-a3fc-d49778442848 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:45.075046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112613eb-71cb-43d7-a3fc-d49778442848 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:45.075046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112613eb-71cb-43d7-a3fc-d49778442848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:45.082703 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112613eb-71cb-43d7-a3fc-d49778442848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:45.084135 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112613eb-71cb-43d7-a3fc-d49778442848 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:45.095072 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1321/2652] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:39:45.174504 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1332/2653] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:39:44 2022] POST /identity/v3/projects => generated 365 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:45.178924 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112613eb-71cb-43d7-a3fc-d49778442848 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:45.189390 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112613eb-71cb-43d7-a3fc-d49778442848 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:45.246739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae0833-8bda-4662-9a80-7d5fb717a706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:45.247304 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae0833-8bda-4662-9a80-7d5fb717a706 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:45.247584 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae0833-8bda-4662-9a80-7d5fb717a706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:45.247859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae0833-8bda-4662-9a80-7d5fb717a706 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:45.248526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae0833-8bda-4662-9a80-7d5fb717a706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:45.250441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae0833-8bda-4662-9a80-7d5fb717a706 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:45.354257 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1322/2654] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:39:45 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:45.358500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe008a1b-d41e-4a65-a283-b05a0bec7fc7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:45.370490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe008a1b-d41e-4a65-a283-b05a0bec7fc7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:45.375296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd28b3a-1e05-4efa-b8b5-910fe2fca705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:45.382157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd28b3a-1e05-4efa-b8b5-910fe2fca705 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:45.382157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd28b3a-1e05-4efa-b8b5-910fe2fca705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:45.382157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd28b3a-1e05-4efa-b8b5-910fe2fca705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:45.382157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd28b3a-1e05-4efa-b8b5-910fe2fca705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:45.382157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd28b3a-1e05-4efa-b8b5-910fe2fca705 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:45.389906 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1333/2655] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:45.393977 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae0833-8bda-4662-9a80-7d5fb717a706 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:45.404633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae0833-8bda-4662-9a80-7d5fb717a706 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:45.410645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c02516-f019-4683-9022-59eb3c74228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:45.411245 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c02516-f019-4683-9022-59eb3c74228c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:45.411520 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c02516-f019-4683-9022-59eb3c74228c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:45.411789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c02516-f019-4683-9022-59eb3c74228c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:45.412429 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c02516-f019-4683-9022-59eb3c74228c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:45.414026 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c02516-f019-4683-9022-59eb3c74228c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:45.426723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1323/2656] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:45.438909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd28b3a-1e05-4efa-b8b5-910fe2fca705 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:45.442676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd28b3a-1e05-4efa-b8b5-910fe2fca705 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:45.447748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c2459-1970-4ab8-bbb1-d4dc01a7f8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:45.448410 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c2459-1970-4ab8-bbb1-d4dc01a7f8b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:45.448706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c2459-1970-4ab8-bbb1-d4dc01a7f8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:45.448986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c2459-1970-4ab8-bbb1-d4dc01a7f8b9 admin admin] PATH_INFO: `/v3/projects/090a093ef30e483b8f6f1a37eef391ee/users/4869c6dabe12434c96a6bbdd75b1548e/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:45.468199 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c2459-1970-4ab8-bbb1-d4dc01a7f8b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=090a093ef30e483b8f6f1a37eef391ee, user_id=4869c6dabe12434c96a6bbdd75b1548e, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:45.473318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c2459-1970-4ab8-bbb1-d4dc01a7f8b9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:45.569982 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1334/2657] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:45 2022] PUT /identity/v3/projects/090a093ef30e483b8f6f1a37eef391ee/users/4869c6dabe12434c96a6bbdd75b1548e/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:45.582910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b39b7-916d-4c1e-befa-edebaab51c8d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:45.582910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b39b7-916d-4c1e-befa-edebaab51c8d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:45.582910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b39b7-916d-4c1e-befa-edebaab51c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:45.612368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-905b39b7-916d-4c1e-befa-edebaab51c8d None None] MFA Rules not processed for user `4869c6dabe12434c96a6bbdd75b1548e`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:45.613597 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-905b39b7-916d-4c1e-befa-edebaab51c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:45.678522 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1324/2658] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:45.683106 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c2459-1970-4ab8-bbb1-d4dc01a7f8b9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:45.747651 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c2459-1970-4ab8-bbb1-d4dc01a7f8b9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:45.752327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5efb7-3f0f-4b66-8a0d-a80f6b58b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:45.752934 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5efb7-3f0f-4b66-8a0d-a80f6b58b366 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:45.753206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5efb7-3f0f-4b66-8a0d-a80f6b58b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:45.753474 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5efb7-3f0f-4b66-8a0d-a80f6b58b366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:45.754141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5efb7-3f0f-4b66-8a0d-a80f6b58b366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:45.756026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5efb7-3f0f-4b66-8a0d-a80f6b58b366 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:45.850585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1335/2659] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:39:45 2022] POST /identity/v3/projects => generated 363 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:45.855634 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b39b7-916d-4c1e-befa-edebaab51c8d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:45.867341 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b39b7-916d-4c1e-befa-edebaab51c8d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:45.929568 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb2ebf-2924-445b-b7f5-631f0c3c97dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:45.930238 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb2ebf-2924-445b-b7f5-631f0c3c97dd admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:45.930509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb2ebf-2924-445b-b7f5-631f0c3c97dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:45.930788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb2ebf-2924-445b-b7f5-631f0c3c97dd admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:45.931419 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb2ebf-2924-445b-b7f5-631f0c3c97dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:45.933391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb2ebf-2924-445b-b7f5-631f0c3c97dd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:45.988854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:46.054037 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1325/2660] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:39:45 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:46.058206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5efb7-3f0f-4b66-8a0d-a80f6b58b366 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:46.068444 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5efb7-3f0f-4b66-8a0d-a80f6b58b366 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:46.077988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fad300-4e19-432c-ba7d-447d62edb526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:46.078662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fad300-4e19-432c-ba7d-447d62edb526 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:46.079753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fad300-4e19-432c-ba7d-447d62edb526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:46.079753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fad300-4e19-432c-ba7d-447d62edb526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:46.079975 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fad300-4e19-432c-ba7d-447d62edb526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:46.081510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fad300-4e19-432c-ba7d-447d62edb526 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:46.096311 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1336/2661] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:46.097404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb2ebf-2924-445b-b7f5-631f0c3c97dd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:46.109026 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb2ebf-2924-445b-b7f5-631f0c3c97dd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:46.113635 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712975c-4e42-40b9-b517-cf0a16b192fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:46.129092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712975c-4e42-40b9-b517-cf0a16b192fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:46.129092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712975c-4e42-40b9-b517-cf0a16b192fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:46.129092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712975c-4e42-40b9-b517-cf0a16b192fb admin admin] PATH_INFO: `/v3/projects/09508c03135f44619b6de91aa04a5b83/users/8f0d336ebc82484f88123f4c31ecdc80/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:46.129463 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712975c-4e42-40b9-b517-cf0a16b192fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=09508c03135f44619b6de91aa04a5b83, user_id=8f0d336ebc82484f88123f4c31ecdc80, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:46.132389 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712975c-4e42-40b9-b517-cf0a16b192fb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:46.237091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fad300-4e19-432c-ba7d-447d62edb526 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:46.238571 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1326/2662] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:46 2022] PUT /identity/v3/projects/09508c03135f44619b6de91aa04a5b83/users/8f0d336ebc82484f88123f4c31ecdc80/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:46.242554 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712975c-4e42-40b9-b517-cf0a16b192fb admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:46.247170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fad300-4e19-432c-ba7d-447d62edb526 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:46.307538 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712975c-4e42-40b9-b517-cf0a16b192fb admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:46.308703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b90ded-3991-4ca2-a694-5e7a81c54fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:46.309490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b90ded-3991-4ca2-a694-5e7a81c54fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:46.309932 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b90ded-3991-4ca2-a694-5e7a81c54fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:46.310127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b90ded-3991-4ca2-a694-5e7a81c54fdc admin admin] PATH_INFO: `/v3/users/76f60e5b3ead4d5ebe30fde4a151b0c2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:46.311330 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b90ded-3991-4ca2-a694-5e7a81c54fdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=76f60e5b3ead4d5ebe30fde4a151b0c2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:46.312487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64ddf7-50f8-40d3-b57e-8f56860e0629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:46.313100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64ddf7-50f8-40d3-b57e-8f56860e0629 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:46.313405 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64ddf7-50f8-40d3-b57e-8f56860e0629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:46.313523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b90ded-3991-4ca2-a694-5e7a81c54fdc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:46.313684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64ddf7-50f8-40d3-b57e-8f56860e0629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:46.314354 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64ddf7-50f8-40d3-b57e-8f56860e0629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:46.316049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64ddf7-50f8-40d3-b57e-8f56860e0629 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:46.326472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1327/2663] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:46.330704 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64ddf7-50f8-40d3-b57e-8f56860e0629 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:46.340994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:46.341576 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64ddf7-50f8-40d3-b57e-8f56860e0629 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:46.347906 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e6d25-c047-427b-a697-699d5acbd846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:46.348499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e6d25-c047-427b-a697-699d5acbd846 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:46.348781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e6d25-c047-427b-a697-699d5acbd846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:46.349057 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e6d25-c047-427b-a697-699d5acbd846 admin admin] PATH_INFO: `/v3/projects/09508c03135f44619b6de91aa04a5b83/users/8f0d336ebc82484f88123f4c31ecdc80/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:46.351186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e6d25-c047-427b-a697-699d5acbd846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09508c03135f44619b6de91aa04a5b83, user_id=8f0d336ebc82484f88123f4c31ecdc80, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:46.353865 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e6d25-c047-427b-a697-699d5acbd846 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:46.365305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1328/2664] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:46 2022] PUT /identity/v3/projects/09508c03135f44619b6de91aa04a5b83/users/8f0d336ebc82484f88123f4c31ecdc80/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:46.377529 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c4928-6647-463d-87f4-3e796be73021 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:46.377890 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c4928-6647-463d-87f4-3e796be73021 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:46.378221 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c4928-6647-463d-87f4-3e796be73021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:46.408144 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-052c4928-6647-463d-87f4-3e796be73021 None None] MFA Rules not processed for user `8f0d336ebc82484f88123f4c31ecdc80`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:46.409282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-052c4928-6647-463d-87f4-3e796be73021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:46.479639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1329/2665] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:39:46.490870 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c4928-6647-463d-87f4-3e796be73021 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:46.527024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-49b90ded-3991-4ca2-a694-5e7a81c54fdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76f60e5b3ead4d5ebe30fde4a151b0c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:46.543134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-49b90ded-3991-4ca2-a694-5e7a81c54fdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76f60e5b3ead4d5ebe30fde4a151b0c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:46.552121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-49b90ded-3991-4ca2-a694-5e7a81c54fdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76f60e5b3ead4d5ebe30fde4a151b0c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:46.552818 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-49b90ded-3991-4ca2-a694-5e7a81c54fdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76f60e5b3ead4d5ebe30fde4a151b0c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:46.555805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c4928-6647-463d-87f4-3e796be73021 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:46.559526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd6c4f-d4e4-4ccf-9276-46e1732f1213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:46.560151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd6c4f-d4e4-4ccf-9276-46e1732f1213 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:46.560431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd6c4f-d4e4-4ccf-9276-46e1732f1213 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:46.560729 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd6c4f-d4e4-4ccf-9276-46e1732f1213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:46.563081 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-babd6c4f-d4e4-4ccf-9276-46e1732f1213 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:46.575207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd6c4f-d4e4-4ccf-9276-46e1732f1213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:46.576623 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd6c4f-d4e4-4ccf-9276-46e1732f1213 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:46.587519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1330/2666] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:39:46.682387 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-49b90ded-3991-4ca2-a694-5e7a81c54fdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76f60e5b3ead4d5ebe30fde4a151b0c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:46.689310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1337/2667] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:46 2022] DELETE /identity/v3/users/76f60e5b3ead4d5ebe30fde4a151b0c2 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:46.694066 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454e369-4373-4bce-b01a-aa9c7fc25c3b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:46.694404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454e369-4373-4bce-b01a-aa9c7fc25c3b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:46.694689 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454e369-4373-4bce-b01a-aa9c7fc25c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:46.711892 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:46.721844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3454e369-4373-4bce-b01a-aa9c7fc25c3b None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:46.721844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3454e369-4373-4bce-b01a-aa9c7fc25c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:46.778231 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1331/2668] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:46.788586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b90ded-3991-4ca2-a694-5e7a81c54fdc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:46.790035 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-49b90ded-3991-4ca2-a694-5e7a81c54fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:46.848463 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b90ded-3991-4ca2-a694-5e7a81c54fdc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:46.854067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f7e8b-c3e7-49f7-a189-8c133338e27d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:46.854067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f7e8b-c3e7-49f7-a189-8c133338e27d service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:46.854067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f7e8b-c3e7-49f7-a189-8c133338e27d service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:46.854067 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f7e8b-c3e7-49f7-a189-8c133338e27d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:46.863359 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f7e8b-c3e7-49f7-a189-8c133338e27d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:46.864891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f7e8b-c3e7-49f7-a189-8c133338e27d service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:46.875938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1338/2669] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:39:46.903593 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454e369-4373-4bce-b01a-aa9c7fc25c3b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:46.905519 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3454e369-4373-4bce-b01a-aa9c7fc25c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:46.965077 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454e369-4373-4bce-b01a-aa9c7fc25c3b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:46.969764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b287be9-2245-4efa-878d-14e65d2346a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:46.970445 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b287be9-2245-4efa-878d-14e65d2346a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:46.970836 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b287be9-2245-4efa-878d-14e65d2346a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:46.971178 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b287be9-2245-4efa-878d-14e65d2346a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:46.974531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1b287be9-2245-4efa-878d-14e65d2346a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:47.036455 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b287be9-2245-4efa-878d-14e65d2346a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:47.037965 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b287be9-2245-4efa-878d-14e65d2346a7 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:47.044138 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:47.049329 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1332/2670] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:39:47.351364 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f7e8b-c3e7-49f7-a189-8c133338e27d service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:47.353290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b08f7e8b-c3e7-49f7-a189-8c133338e27d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:47.368124 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f7e8b-c3e7-49f7-a189-8c133338e27d service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:47.373952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:47.374512 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:47.374795 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:47.375068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e admin admin] PATH_INFO: `/v3/projects/75a26090f17948bd9656801b9c11e418` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:47.376365 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a26090f17948bd9656801b9c11e418)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:47.381774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:47.522316 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a26090f17948bd9656801b9c11e418', 'request_id': 'req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:47.659625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a26090f17948bd9656801b9c11e418', 'request_id': 'req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:47.667338 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a26090f17948bd9656801b9c11e418', 'request_id': 'req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:47.678012 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e admin admin] The token cache is being invalidate because project 75a26090f17948bd9656801b9c11e418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:39:47.678303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:47.679011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:47.680501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1339/2671] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:39:47 2022] DELETE /identity/v3/projects/75a26090f17948bd9656801b9c11e418 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:47.684490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b287be9-2245-4efa-878d-14e65d2346a7 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:47.694988 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b287be9-2245-4efa-878d-14e65d2346a7 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:47.750340 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc920558-5428-43dd-8cbf-21625e72faa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:47.750977 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc920558-5428-43dd-8cbf-21625e72faa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:47.751258 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc920558-5428-43dd-8cbf-21625e72faa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:47.751525 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc920558-5428-43dd-8cbf-21625e72faa5 admin admin] PATH_INFO: `/v3/users/5778f308221b42d8a044c1ab67e8e396` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:47.752689 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc920558-5428-43dd-8cbf-21625e72faa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5778f308221b42d8a044c1ab67e8e396)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:47.754655 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc920558-5428-43dd-8cbf-21625e72faa5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:47.963299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cc920558-5428-43dd-8cbf-21625e72faa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5778f308221b42d8a044c1ab67e8e396'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:47.980010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cc920558-5428-43dd-8cbf-21625e72faa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5778f308221b42d8a044c1ab67e8e396'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:47.987254 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cc920558-5428-43dd-8cbf-21625e72faa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5778f308221b42d8a044c1ab67e8e396'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:47.987977 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cc920558-5428-43dd-8cbf-21625e72faa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5778f308221b42d8a044c1ab67e8e396'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:48.102761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cc920558-5428-43dd-8cbf-21625e72faa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5778f308221b42d8a044c1ab67e8e396'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:48.109543 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1333/2672] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:47 2022] DELETE /identity/v3/users/5778f308221b42d8a044c1ab67e8e396 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:48.548252 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:48.549791 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:48.563667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eee601-fe41-4480-93d1-4e7dfbfbf11e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:48.611217 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:48.654024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e2e03-bcc4-46bb-9d50-6a3f9392a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:48.654660 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e2e03-bcc4-46bb-9d50-6a3f9392a8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:48.655705 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e2e03-bcc4-46bb-9d50-6a3f9392a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:48.655973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e2e03-bcc4-46bb-9d50-6a3f9392a8e0 admin admin] PATH_INFO: `/v3/projects/7839c9d6370f41799f9d2f9c8adb756b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:48.657093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e2e03-bcc4-46bb-9d50-6a3f9392a8e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7839c9d6370f41799f9d2f9c8adb756b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:48.659016 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e2e03-bcc4-46bb-9d50-6a3f9392a8e0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:48.766574 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-354e2e03-bcc4-46bb-9d50-6a3f9392a8e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7839c9d6370f41799f9d2f9c8adb756b', 'request_id': 'req-354e2e03-bcc4-46bb-9d50-6a3f9392a8e0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:48.842222 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-354e2e03-bcc4-46bb-9d50-6a3f9392a8e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7839c9d6370f41799f9d2f9c8adb756b', 'request_id': 'req-354e2e03-bcc4-46bb-9d50-6a3f9392a8e0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:48.850033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-354e2e03-bcc4-46bb-9d50-6a3f9392a8e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7839c9d6370f41799f9d2f9c8adb756b', 'request_id': 'req-354e2e03-bcc4-46bb-9d50-6a3f9392a8e0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:48.861343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-354e2e03-bcc4-46bb-9d50-6a3f9392a8e0 admin admin] The token cache is being invalidate because project 7839c9d6370f41799f9d2f9c8adb756b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:39:48.861631 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-354e2e03-bcc4-46bb-9d50-6a3f9392a8e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:48.862345 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-354e2e03-bcc4-46bb-9d50-6a3f9392a8e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:48.863863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1340/2673] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:39:48 2022] DELETE /identity/v3/projects/7839c9d6370f41799f9d2f9c8adb756b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:48.868963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2599-47ff-4d68-9ce3-ccf3cf56662a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:48.869451 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2599-47ff-4d68-9ce3-ccf3cf56662a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:48.869573 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2599-47ff-4d68-9ce3-ccf3cf56662a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:48.889869 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-540f2599-47ff-4d68-9ce3-ccf3cf56662a None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:48.891094 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-540f2599-47ff-4d68-9ce3-ccf3cf56662a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:48.912455 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:48.955533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1334/2674] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:48.964287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105d352-08a3-49b3-9955-c7e739c5930f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:48.964568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105d352-08a3-49b3-9955-c7e739c5930f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:48.964842 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105d352-08a3-49b3-9955-c7e739c5930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:48.986127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b105d352-08a3-49b3-9955-c7e739c5930f None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:48.987350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b105d352-08a3-49b3-9955-c7e739c5930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:48.995626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1341/2675] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:49.000910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2599-47ff-4d68-9ce3-ccf3cf56662a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:49.010452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2599-47ff-4d68-9ce3-ccf3cf56662a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:49.016217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69cab3-876d-4f53-940f-6ab83c930487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:49.016913 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69cab3-876d-4f53-940f-6ab83c930487 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:49.017264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69cab3-876d-4f53-940f-6ab83c930487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:49.017599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69cab3-876d-4f53-940f-6ab83c930487 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:49.018518 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69cab3-876d-4f53-940f-6ab83c930487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:39:49.023892 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69cab3-876d-4f53-940f-6ab83c930487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:49.023892 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69cab3-876d-4f53-940f-6ab83c930487 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:49.032375 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1335/2676] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:39:49.037072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105d352-08a3-49b3-9955-c7e739c5930f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:49.047301 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105d352-08a3-49b3-9955-c7e739c5930f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:49.052601 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d76a5e-de73-482e-8ad5-9cff5d942dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:49.052773 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d76a5e-de73-482e-8ad5-9cff5d942dac admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:49.053054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d76a5e-de73-482e-8ad5-9cff5d942dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:49.053326 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d76a5e-de73-482e-8ad5-9cff5d942dac admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:49.053992 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d76a5e-de73-482e-8ad5-9cff5d942dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:49.055897 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d76a5e-de73-482e-8ad5-9cff5d942dac admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:49.167172 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1342/2677] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:39:49 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:49.170386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69cab3-876d-4f53-940f-6ab83c930487 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:49.181202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69cab3-876d-4f53-940f-6ab83c930487 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:49.243972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ccd71-da67-4187-bf64-276a8f9eddb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:49.243972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ccd71-da67-4187-bf64-276a8f9eddb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:49.243972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ccd71-da67-4187-bf64-276a8f9eddb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:49.243972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ccd71-da67-4187-bf64-276a8f9eddb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:49.244348 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ccd71-da67-4187-bf64-276a8f9eddb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:49.245911 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ccd71-da67-4187-bf64-276a8f9eddb1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:49.333793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1336/2678] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:39:49 2022] POST /identity/v3/users => generated 284 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:49.337854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d76a5e-de73-482e-8ad5-9cff5d942dac admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:49.348735 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d76a5e-de73-482e-8ad5-9cff5d942dac admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:49.353524 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ed8e9-d3bb-4b99-b6d8-b57351a19139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:49.354134 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ed8e9-d3bb-4b99-b6d8-b57351a19139 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:49.354407 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ed8e9-d3bb-4b99-b6d8-b57351a19139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:49.354677 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ed8e9-d3bb-4b99-b6d8-b57351a19139 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:49.355508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ed8e9-d3bb-4b99-b6d8-b57351a19139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:49.357114 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ed8e9-d3bb-4b99-b6d8-b57351a19139 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:49.367905 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1343/2679] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:49.372055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ccd71-da67-4187-bf64-276a8f9eddb1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:49.382670 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ccd71-da67-4187-bf64-276a8f9eddb1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:49.387286 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db056e12-4657-4b5e-afa9-9e8899baeaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:49.387891 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db056e12-4657-4b5e-afa9-9e8899baeaca admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:49.388169 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db056e12-4657-4b5e-afa9-9e8899baeaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:49.388443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db056e12-4657-4b5e-afa9-9e8899baeaca admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:49.389086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db056e12-4657-4b5e-afa9-9e8899baeaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:49.390709 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db056e12-4657-4b5e-afa9-9e8899baeaca admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:49.403175 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1337/2680] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:49.411727 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ed8e9-d3bb-4b99-b6d8-b57351a19139 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:49.422328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ed8e9-d3bb-4b99-b6d8-b57351a19139 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:49.432578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb98f1-62ba-44d7-af44-51e3a92d129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:49.433224 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb98f1-62ba-44d7-af44-51e3a92d129b admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:49.433501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb98f1-62ba-44d7-af44-51e3a92d129b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:49.433848 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb98f1-62ba-44d7-af44-51e3a92d129b admin admin] PATH_INFO: `/v3/projects/b25c0cbcd19a46aab890bbf447978ecd/users/567e03f47fb049b09c7eae2e57eecd1d/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:49.449230 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb98f1-62ba-44d7-af44-51e3a92d129b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25c0cbcd19a46aab890bbf447978ecd, user_id=567e03f47fb049b09c7eae2e57eecd1d, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:49.451907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb98f1-62ba-44d7-af44-51e3a92d129b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:49.525892 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1344/2681] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:49 2022] PUT /identity/v3/projects/b25c0cbcd19a46aab890bbf447978ecd/users/567e03f47fb049b09c7eae2e57eecd1d/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:49.537307 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7aef7-709d-4f5c-ad02-9e2abc67203d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:49.537721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7aef7-709d-4f5c-ad02-9e2abc67203d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:49.538020 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7aef7-709d-4f5c-ad02-9e2abc67203d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:49.566032 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0db7aef7-709d-4f5c-ad02-9e2abc67203d None None] MFA Rules not processed for user `567e03f47fb049b09c7eae2e57eecd1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:49.567245 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0db7aef7-709d-4f5c-ad02-9e2abc67203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:49.636372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1338/2682] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:49.641085 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb98f1-62ba-44d7-af44-51e3a92d129b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:49.691761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:49.705413 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb98f1-62ba-44d7-af44-51e3a92d129b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:49.710121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f4cec-4eb7-40d1-aa72-aa123b9a3606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:49.710739 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f4cec-4eb7-40d1-aa72-aa123b9a3606 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:49.711013 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f4cec-4eb7-40d1-aa72-aa123b9a3606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:49.711284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f4cec-4eb7-40d1-aa72-aa123b9a3606 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:49.711927 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f4cec-4eb7-40d1-aa72-aa123b9a3606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:49.713857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f4cec-4eb7-40d1-aa72-aa123b9a3606 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:49.864765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1345/2683] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:39:49 2022] POST /identity/v3/projects => generated 369 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:39:49.868816 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7aef7-709d-4f5c-ad02-9e2abc67203d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:49.879618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7aef7-709d-4f5c-ad02-9e2abc67203d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:49.896938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:49.935132 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f60b9-926c-425f-8c9e-40c9acd85522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:49.935810 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f60b9-926c-425f-8c9e-40c9acd85522 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:49.936015 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f60b9-926c-425f-8c9e-40c9acd85522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:49.936283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f60b9-926c-425f-8c9e-40c9acd85522 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:49.936907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f60b9-926c-425f-8c9e-40c9acd85522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:49.938845 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f60b9-926c-425f-8c9e-40c9acd85522 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:50.055152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1339/2684] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:39:49 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:50.058006 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f4cec-4eb7-40d1-aa72-aa123b9a3606 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:50.068878 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f4cec-4eb7-40d1-aa72-aa123b9a3606 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:50.073462 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69525fe-6fff-4bf7-b135-06a0888d8edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:50.074087 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69525fe-6fff-4bf7-b135-06a0888d8edd admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:50.074364 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69525fe-6fff-4bf7-b135-06a0888d8edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:50.074636 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69525fe-6fff-4bf7-b135-06a0888d8edd admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:50.075272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69525fe-6fff-4bf7-b135-06a0888d8edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:50.077641 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69525fe-6fff-4bf7-b135-06a0888d8edd admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:50.087613 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1346/2685] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:50.091829 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f60b9-926c-425f-8c9e-40c9acd85522 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:50.101942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f60b9-926c-425f-8c9e-40c9acd85522 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:50.107297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e51b2b-c636-466e-b9cf-a88cc7256ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:50.107297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51b2b-c636-466e-b9cf-a88cc7256ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:50.107535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51b2b-c636-466e-b9cf-a88cc7256ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:50.107641 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51b2b-c636-466e-b9cf-a88cc7256ec8 admin admin] PATH_INFO: `/v3/projects/b9bc062ff55d45c7aa098162460d783b/users/2129e988b36d4ca9be3dae47b782c762/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:50.123342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e51b2b-c636-466e-b9cf-a88cc7256ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9bc062ff55d45c7aa098162460d783b, user_id=2129e988b36d4ca9be3dae47b782c762, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:50.126531 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e51b2b-c636-466e-b9cf-a88cc7256ec8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:50.211416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1340/2686] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:50 2022] PUT /identity/v3/projects/b9bc062ff55d45c7aa098162460d783b/users/2129e988b36d4ca9be3dae47b782c762/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:50.215547 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69525fe-6fff-4bf7-b135-06a0888d8edd admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:50.225629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69525fe-6fff-4bf7-b135-06a0888d8edd admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:50.284112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679dccb-b93e-46d4-97ba-21e51b0b0f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:50.284739 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679dccb-b93e-46d4-97ba-21e51b0b0f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:50.285029 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679dccb-b93e-46d4-97ba-21e51b0b0f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:50.285302 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679dccb-b93e-46d4-97ba-21e51b0b0f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:50.286020 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679dccb-b93e-46d4-97ba-21e51b0b0f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:50.287680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679dccb-b93e-46d4-97ba-21e51b0b0f92 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:50.297725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1347/2687] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:50.301964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e51b2b-c636-466e-b9cf-a88cc7256ec8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:50.312968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e51b2b-c636-466e-b9cf-a88cc7256ec8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:50.317577 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dd770-88f4-4f15-aa6e-c7bb18f17832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:50.318269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dd770-88f4-4f15-aa6e-c7bb18f17832 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:50.318548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dd770-88f4-4f15-aa6e-c7bb18f17832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:50.318945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dd770-88f4-4f15-aa6e-c7bb18f17832 admin admin] PATH_INFO: `/v3/projects/b9bc062ff55d45c7aa098162460d783b/users/2129e988b36d4ca9be3dae47b782c762/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:50.320842 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3dd770-88f4-4f15-aa6e-c7bb18f17832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9bc062ff55d45c7aa098162460d783b, user_id=2129e988b36d4ca9be3dae47b782c762, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:50.323482 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3dd770-88f4-4f15-aa6e-c7bb18f17832 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:50.334348 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1341/2688] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:50 2022] PUT /identity/v3/projects/b9bc062ff55d45c7aa098162460d783b/users/2129e988b36d4ca9be3dae47b782c762/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:50.345387 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a445220-90db-4d55-a5a1-36964faf4b3a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:50.345942 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a445220-90db-4d55-a5a1-36964faf4b3a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:50.346225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a445220-90db-4d55-a5a1-36964faf4b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:50.374999 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6a445220-90db-4d55-a5a1-36964faf4b3a None None] MFA Rules not processed for user `2129e988b36d4ca9be3dae47b782c762`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:50.376343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6a445220-90db-4d55-a5a1-36964faf4b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:50.446455 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1348/2689] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:50.457387 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dd770-88f4-4f15-aa6e-c7bb18f17832 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:50.459193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dd3dd770-88f4-4f15-aa6e-c7bb18f17832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:50.520264 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dd770-88f4-4f15-aa6e-c7bb18f17832 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:50.524013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a6a75-c9b0-4a37-b1ec-e30781b21279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:50.524620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a6a75-c9b0-4a37-b1ec-e30781b21279 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:50.524890 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a6a75-c9b0-4a37-b1ec-e30781b21279 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:50.525157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a6a75-c9b0-4a37-b1ec-e30781b21279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:50.534923 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a6a75-c9b0-4a37-b1ec-e30781b21279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:50.536337 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a6a75-c9b0-4a37-b1ec-e30781b21279 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:50.546407 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1342/2690] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:39:50.783573 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a445220-90db-4d55-a5a1-36964faf4b3a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:50.785242 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6a445220-90db-4d55-a5a1-36964faf4b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:50.833724 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:50.852239 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a445220-90db-4d55-a5a1-36964faf4b3a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:50.856756 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d218a-6b26-46e2-993b-f5f5131b058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:50.857379 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d218a-6b26-46e2-993b-f5f5131b058f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:50.857693 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d218a-6b26-46e2-993b-f5f5131b058f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:50.858635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d218a-6b26-46e2-993b-f5f5131b058f admin admin] PATH_INFO: `/v3/users/4869c6dabe12434c96a6bbdd75b1548e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:50.859785 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d218a-6b26-46e2-993b-f5f5131b058f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4869c6dabe12434c96a6bbdd75b1548e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:50.861689 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d218a-6b26-46e2-993b-f5f5131b058f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:51.102798 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a64d218a-6b26-46e2-993b-f5f5131b058f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4869c6dabe12434c96a6bbdd75b1548e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:51.116034 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a64d218a-6b26-46e2-993b-f5f5131b058f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4869c6dabe12434c96a6bbdd75b1548e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:51.122916 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a64d218a-6b26-46e2-993b-f5f5131b058f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4869c6dabe12434c96a6bbdd75b1548e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:51.124116 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a64d218a-6b26-46e2-993b-f5f5131b058f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4869c6dabe12434c96a6bbdd75b1548e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:51.197419 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a64d218a-6b26-46e2-993b-f5f5131b058f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4869c6dabe12434c96a6bbdd75b1548e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:51.204021 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1349/2691] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:50 2022] DELETE /identity/v3/users/4869c6dabe12434c96a6bbdd75b1548e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:51.208515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf844719-e852-44e6-a649-e6f9d95f9915 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:51.209016 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf844719-e852-44e6-a649-e6f9d95f9915 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:51.209116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf844719-e852-44e6-a649-e6f9d95f9915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:51.228024 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-cf844719-e852-44e6-a649-e6f9d95f9915 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:51.229103 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cf844719-e852-44e6-a649-e6f9d95f9915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:51.288835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1343/2692] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:39:51.299264 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d218a-6b26-46e2-993b-f5f5131b058f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:51.300678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a64d218a-6b26-46e2-993b-f5f5131b058f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:51.359638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d218a-6b26-46e2-993b-f5f5131b058f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:51.363425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cae87d-86b0-4ee3-96dc-26095428f201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:51.364139 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cae87d-86b0-4ee3-96dc-26095428f201 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:51.364417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cae87d-86b0-4ee3-96dc-26095428f201 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:51.364687 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cae87d-86b0-4ee3-96dc-26095428f201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:51.374768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cae87d-86b0-4ee3-96dc-26095428f201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:51.376222 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cae87d-86b0-4ee3-96dc-26095428f201 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:51.385567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1350/2693] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:39:51.819335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf844719-e852-44e6-a649-e6f9d95f9915 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:51.823280 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cf844719-e852-44e6-a649-e6f9d95f9915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:51.836510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf844719-e852-44e6-a649-e6f9d95f9915 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:51.842435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994f037-9f66-4f70-a9df-a28e9c852417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:51.842435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994f037-9f66-4f70-a9df-a28e9c852417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:51.842435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994f037-9f66-4f70-a9df-a28e9c852417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:51.842760 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994f037-9f66-4f70-a9df-a28e9c852417 admin admin] PATH_INFO: `/v3/projects/090a093ef30e483b8f6f1a37eef391ee` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:51.843724 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994f037-9f66-4f70-a9df-a28e9c852417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=090a093ef30e483b8f6f1a37eef391ee)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:51.845646 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994f037-9f66-4f70-a9df-a28e9c852417 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:51.856423 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:51.986951 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8994f037-9f66-4f70-a9df-a28e9c852417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '090a093ef30e483b8f6f1a37eef391ee', 'request_id': 'req-8994f037-9f66-4f70-a9df-a28e9c852417'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:52.080180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8994f037-9f66-4f70-a9df-a28e9c852417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '090a093ef30e483b8f6f1a37eef391ee', 'request_id': 'req-8994f037-9f66-4f70-a9df-a28e9c852417'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:52.090388 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8994f037-9f66-4f70-a9df-a28e9c852417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '090a093ef30e483b8f6f1a37eef391ee', 'request_id': 'req-8994f037-9f66-4f70-a9df-a28e9c852417'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:52.098816 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8994f037-9f66-4f70-a9df-a28e9c852417 admin admin] The token cache is being invalidate because project 090a093ef30e483b8f6f1a37eef391ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:39:52.099125 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8994f037-9f66-4f70-a9df-a28e9c852417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:52.101574 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8994f037-9f66-4f70-a9df-a28e9c852417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:52.103229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1344/2694] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:39:51 2022] DELETE /identity/v3/projects/090a093ef30e483b8f6f1a37eef391ee => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:52.106964 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cae87d-86b0-4ee3-96dc-26095428f201 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:52.119238 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cae87d-86b0-4ee3-96dc-26095428f201 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:52.178051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62a423-5276-4213-b81e-c947de21abe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:52.178706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62a423-5276-4213-b81e-c947de21abe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:52.179007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62a423-5276-4213-b81e-c947de21abe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:52.179282 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62a423-5276-4213-b81e-c947de21abe8 admin admin] PATH_INFO: `/v3/users/8f0d336ebc82484f88123f4c31ecdc80` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:52.180457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62a423-5276-4213-b81e-c947de21abe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0d336ebc82484f88123f4c31ecdc80)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:52.182531 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62a423-5276-4213-b81e-c947de21abe8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:52.188903 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:52.394575 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fe62a423-5276-4213-b81e-c947de21abe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0d336ebc82484f88123f4c31ecdc80'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:52.410327 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fe62a423-5276-4213-b81e-c947de21abe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0d336ebc82484f88123f4c31ecdc80'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:52.417277 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fe62a423-5276-4213-b81e-c947de21abe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0d336ebc82484f88123f4c31ecdc80'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:52.418015 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fe62a423-5276-4213-b81e-c947de21abe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0d336ebc82484f88123f4c31ecdc80'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:52.508610 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-fe62a423-5276-4213-b81e-c947de21abe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0d336ebc82484f88123f4c31ecdc80'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:52.515359 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1351/2695] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:52 2022] DELETE /identity/v3/users/8f0d336ebc82484f88123f4c31ecdc80 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:53.006470 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994f037-9f66-4f70-a9df-a28e9c852417 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:53.006470 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8994f037-9f66-4f70-a9df-a28e9c852417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:53.020120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994f037-9f66-4f70-a9df-a28e9c852417 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:53.101452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecf22b-9f0a-42b8-94df-c46f890b5fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:53.102115 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecf22b-9f0a-42b8-94df-c46f890b5fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:53.102442 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecf22b-9f0a-42b8-94df-c46f890b5fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:53.102850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecf22b-9f0a-42b8-94df-c46f890b5fa1 admin admin] PATH_INFO: `/v3/projects/09508c03135f44619b6de91aa04a5b83` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:53.103978 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecf22b-9f0a-42b8-94df-c46f890b5fa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09508c03135f44619b6de91aa04a5b83)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:53.106910 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecf22b-9f0a-42b8-94df-c46f890b5fa1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:53.261172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-57ecf22b-9f0a-42b8-94df-c46f890b5fa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09508c03135f44619b6de91aa04a5b83', 'request_id': 'req-57ecf22b-9f0a-42b8-94df-c46f890b5fa1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:53.360110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-57ecf22b-9f0a-42b8-94df-c46f890b5fa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09508c03135f44619b6de91aa04a5b83', 'request_id': 'req-57ecf22b-9f0a-42b8-94df-c46f890b5fa1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:53.367588 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-57ecf22b-9f0a-42b8-94df-c46f890b5fa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09508c03135f44619b6de91aa04a5b83', 'request_id': 'req-57ecf22b-9f0a-42b8-94df-c46f890b5fa1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:53.381337 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-57ecf22b-9f0a-42b8-94df-c46f890b5fa1 admin admin] The token cache is being invalidate because project 09508c03135f44619b6de91aa04a5b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:39:53.385612 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-57ecf22b-9f0a-42b8-94df-c46f890b5fa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:53.385612 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-57ecf22b-9f0a-42b8-94df-c46f890b5fa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:53.386435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1345/2696] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:39:53 2022] DELETE /identity/v3/projects/09508c03135f44619b6de91aa04a5b83 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:53.391891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0722d0f-7d49-4be0-83e5-cac9426626a1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:53.392418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0722d0f-7d49-4be0-83e5-cac9426626a1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:53.392418 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0722d0f-7d49-4be0-83e5-cac9426626a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:53.414265 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e0722d0f-7d49-4be0-83e5-cac9426626a1 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:53.415873 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e0722d0f-7d49-4be0-83e5-cac9426626a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:53.478890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1352/2697] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:53.486997 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6b885-4915-4dbe-835f-ab01f9d64d19 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:53.487347 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6b885-4915-4dbe-835f-ab01f9d64d19 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:53.487706 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6b885-4915-4dbe-835f-ab01f9d64d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:53.508601 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-37a6b885-4915-4dbe-835f-ab01f9d64d19 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:53.509897 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-37a6b885-4915-4dbe-835f-ab01f9d64d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:53.517939 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1346/2698] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:39:53.522287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0722d0f-7d49-4be0-83e5-cac9426626a1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:53.532339 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0722d0f-7d49-4be0-83e5-cac9426626a1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:53.537006 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee399bb-bf16-41e8-a179-1295d26b73c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:53.537612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee399bb-bf16-41e8-a179-1295d26b73c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:53.537919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee399bb-bf16-41e8-a179-1295d26b73c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:53.538190 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee399bb-bf16-41e8-a179-1295d26b73c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:53.538863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee399bb-bf16-41e8-a179-1295d26b73c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:39:53.539163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee399bb-bf16-41e8-a179-1295d26b73c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:53.540761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee399bb-bf16-41e8-a179-1295d26b73c7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:53.553122 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1353/2699] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:39:53.562948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6b885-4915-4dbe-835f-ab01f9d64d19 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:53.573223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6b885-4915-4dbe-835f-ab01f9d64d19 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:53.577973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48177a0e-e4b0-4bad-81cf-ee709ebc6804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:53.578650 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48177a0e-e4b0-4bad-81cf-ee709ebc6804 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:53.579031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48177a0e-e4b0-4bad-81cf-ee709ebc6804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:53.579368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48177a0e-e4b0-4bad-81cf-ee709ebc6804 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:53.580071 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48177a0e-e4b0-4bad-81cf-ee709ebc6804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:53.582068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48177a0e-e4b0-4bad-81cf-ee709ebc6804 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:53.729723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:53.736944 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1347/2700] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:39:53 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:39:53.741259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee399bb-bf16-41e8-a179-1295d26b73c7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:53.751868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee399bb-bf16-41e8-a179-1295d26b73c7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:53.808005 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6732c-1943-465e-bbc4-bf2c34834f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:53.835682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6732c-1943-465e-bbc4-bf2c34834f4d admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:53.835682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6732c-1943-465e-bbc4-bf2c34834f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:53.835682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6732c-1943-465e-bbc4-bf2c34834f4d admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:53.835682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6732c-1943-465e-bbc4-bf2c34834f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:53.835682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6732c-1943-465e-bbc4-bf2c34834f4d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:54.046107 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1354/2701] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:39:53 2022] POST /identity/v3/users => generated 289 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:54.047344 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48177a0e-e4b0-4bad-81cf-ee709ebc6804 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:54.057909 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48177a0e-e4b0-4bad-81cf-ee709ebc6804 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:54.062735 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c9fe3-25a9-46d6-a5df-90aca708a883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:54.063452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c9fe3-25a9-46d6-a5df-90aca708a883 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:54.063808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c9fe3-25a9-46d6-a5df-90aca708a883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:54.064206 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c9fe3-25a9-46d6-a5df-90aca708a883 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:54.064859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c9fe3-25a9-46d6-a5df-90aca708a883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:54.066564 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c9fe3-25a9-46d6-a5df-90aca708a883 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:54.076921 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1348/2702] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:39:54.080809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6732c-1943-465e-bbc4-bf2c34834f4d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:54.086936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:54.087819 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c9fe3-25a9-46d6-a5df-90aca708a883 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:54.089492 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-868c9fe3-25a9-46d6-a5df-90aca708a883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:54.091355 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6732c-1943-465e-bbc4-bf2c34834f4d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:54.096423 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6009e45-d642-45d3-bfa8-a6e834c6effc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:54.097022 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6009e45-d642-45d3-bfa8-a6e834c6effc admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:54.097299 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6009e45-d642-45d3-bfa8-a6e834c6effc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:54.097567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6009e45-d642-45d3-bfa8-a6e834c6effc admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:54.098227 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6009e45-d642-45d3-bfa8-a6e834c6effc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:54.099817 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6009e45-d642-45d3-bfa8-a6e834c6effc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:54.103144 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c9fe3-25a9-46d6-a5df-90aca708a883 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:54.107792 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff6aac-91d1-4ea0-9551-1a26414b23c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:54.108951 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff6aac-91d1-4ea0-9551-1a26414b23c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:54.109229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff6aac-91d1-4ea0-9551-1a26414b23c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:54.109497 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff6aac-91d1-4ea0-9551-1a26414b23c7 admin admin] PATH_INFO: `/v3/users/567e03f47fb049b09c7eae2e57eecd1d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:54.110648 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff6aac-91d1-4ea0-9551-1a26414b23c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=567e03f47fb049b09c7eae2e57eecd1d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:54.111199 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1355/2703] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:54.112619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff6aac-91d1-4ea0-9551-1a26414b23c7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:54.115183 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6009e45-d642-45d3-bfa8-a6e834c6effc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:54.124747 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6009e45-d642-45d3-bfa8-a6e834c6effc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:54.131734 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69e3f6-2d09-4505-ae6a-db72443f4a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:54.132387 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69e3f6-2d09-4505-ae6a-db72443f4a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:54.132660 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69e3f6-2d09-4505-ae6a-db72443f4a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:54.132932 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69e3f6-2d09-4505-ae6a-db72443f4a47 admin admin] PATH_INFO: `/v3/projects/5c250d01a27a4902a9b93fc7e573d4bc/users/b850deeb6706438d9e8347f17689519f/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:54.148008 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69e3f6-2d09-4505-ae6a-db72443f4a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c250d01a27a4902a9b93fc7e573d4bc, user_id=b850deeb6706438d9e8347f17689519f, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:54.150663 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69e3f6-2d09-4505-ae6a-db72443f4a47 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:54.246415 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1356/2704] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:54 2022] PUT /identity/v3/projects/5c250d01a27a4902a9b93fc7e573d4bc/users/b850deeb6706438d9e8347f17689519f/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:54.256849 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314702c-38c9-44dc-88b0-264a1e56771a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:54.257128 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314702c-38c9-44dc-88b0-264a1e56771a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:54.257420 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314702c-38c9-44dc-88b0-264a1e56771a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:54.288744 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d314702c-38c9-44dc-88b0-264a1e56771a None None] MFA Rules not processed for user `b850deeb6706438d9e8347f17689519f`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:54.290188 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d314702c-38c9-44dc-88b0-264a1e56771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:54.359947 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1357/2705] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:39:54.364448 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314702c-38c9-44dc-88b0-264a1e56771a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:54.367035 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-24ff6aac-91d1-4ea0-9551-1a26414b23c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '567e03f47fb049b09c7eae2e57eecd1d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:54.379340 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-24ff6aac-91d1-4ea0-9551-1a26414b23c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '567e03f47fb049b09c7eae2e57eecd1d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:54.386010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-24ff6aac-91d1-4ea0-9551-1a26414b23c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '567e03f47fb049b09c7eae2e57eecd1d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:54.386684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-24ff6aac-91d1-4ea0-9551-1a26414b23c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '567e03f47fb049b09c7eae2e57eecd1d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:54.426275 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314702c-38c9-44dc-88b0-264a1e56771a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:54.430918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ec431-efb4-46df-a1c3-b57552bff19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:54.431514 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ec431-efb4-46df-a1c3-b57552bff19a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:54.431790 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ec431-efb4-46df-a1c3-b57552bff19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:54.432060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ec431-efb4-46df-a1c3-b57552bff19a admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:54.432691 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ec431-efb4-46df-a1c3-b57552bff19a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:54.434635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ec431-efb4-46df-a1c3-b57552bff19a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:54.583013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-24ff6aac-91d1-4ea0-9551-1a26414b23c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '567e03f47fb049b09c7eae2e57eecd1d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:54.589486 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1349/2706] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:54 2022] DELETE /identity/v3/users/567e03f47fb049b09c7eae2e57eecd1d => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:54.593396 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1358/2707] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:39:54 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:54.593760 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60192322-0ef0-48b6-a9f4-79f9e1a49862 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:54.594053 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60192322-0ef0-48b6-a9f4-79f9e1a49862 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:54.594324 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60192322-0ef0-48b6-a9f4-79f9e1a49862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:54.594447 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ec431-efb4-46df-a1c3-b57552bff19a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:54.595991 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a53ec431-efb4-46df-a1c3-b57552bff19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:54.613362 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-60192322-0ef0-48b6-a9f4-79f9e1a49862 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:54.614580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-60192322-0ef0-48b6-a9f4-79f9e1a49862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:54.664269 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ec431-efb4-46df-a1c3-b57552bff19a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:54.669424 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb4fbe-1376-43f4-9227-a660e8f4975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:54.670058 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb4fbe-1376-43f4-9227-a660e8f4975e admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:54.670348 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb4fbe-1376-43f4-9227-a660e8f4975e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:54.670620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb4fbe-1376-43f4-9227-a660e8f4975e admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:54.671243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb4fbe-1376-43f4-9227-a660e8f4975e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:54.673153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb4fbe-1376-43f4-9227-a660e8f4975e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:54.674030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1350/2708] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:54.683927 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60192322-0ef0-48b6-a9f4-79f9e1a49862 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:54.685336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-60192322-0ef0-48b6-a9f4-79f9e1a49862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:54.740968 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60192322-0ef0-48b6-a9f4-79f9e1a49862 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:54.744944 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4e0b2-5394-4ce8-9d51-1e4bbb6c343d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:54.745556 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4e0b2-5394-4ce8-9d51-1e4bbb6c343d service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:54.745888 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4e0b2-5394-4ce8-9d51-1e4bbb6c343d service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:54.746157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4e0b2-5394-4ce8-9d51-1e4bbb6c343d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:54.755674 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4e0b2-5394-4ce8-9d51-1e4bbb6c343d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:54.757210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4e0b2-5394-4ce8-9d51-1e4bbb6c343d service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:54.767732 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1351/2709] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:39:54.773436 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1359/2710] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:39:54 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:54.779025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4e0b2-5394-4ce8-9d51-1e4bbb6c343d service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:54.789039 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4e0b2-5394-4ce8-9d51-1e4bbb6c343d service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:54.793964 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4937a96-9001-430a-b580-ef407db6ef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:54.794477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4937a96-9001-430a-b580-ef407db6ef38 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:54.794762 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4937a96-9001-430a-b580-ef407db6ef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:54.795036 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4937a96-9001-430a-b580-ef407db6ef38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:54.795677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4937a96-9001-430a-b580-ef407db6ef38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:54.797320 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4937a96-9001-430a-b580-ef407db6ef38 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:54.807279 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1352/2711] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:39:54.812459 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb4fbe-1376-43f4-9227-a660e8f4975e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:54.822686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb4fbe-1376-43f4-9227-a660e8f4975e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:54.828796 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ce218-5cd7-40c0-941d-fdd9ce93d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:54.829557 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ce218-5cd7-40c0-941d-fdd9ce93d7df admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:54.829875 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ce218-5cd7-40c0-941d-fdd9ce93d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:54.830146 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ce218-5cd7-40c0-941d-fdd9ce93d7df admin admin] PATH_INFO: `/v3/projects/c80cceb809db49a5b6dfdb7ecff8e217/users/941166aafcd04684aec415be55a14a6a/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:54.844894 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ce218-5cd7-40c0-941d-fdd9ce93d7df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c80cceb809db49a5b6dfdb7ecff8e217, user_id=941166aafcd04684aec415be55a14a6a, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:54.847567 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ce218-5cd7-40c0-941d-fdd9ce93d7df admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:54.920987 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1360/2712] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:54 2022] PUT /identity/v3/projects/c80cceb809db49a5b6dfdb7ecff8e217/users/941166aafcd04684aec415be55a14a6a/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:54.927982 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4937a96-9001-430a-b580-ef407db6ef38 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:54.938622 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4937a96-9001-430a-b580-ef407db6ef38 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:55.004821 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb0358-9a8b-4162-a058-f252d1dfec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:55.005623 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb0358-9a8b-4162-a058-f252d1dfec50 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:55.005989 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb0358-9a8b-4162-a058-f252d1dfec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:55.006371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb0358-9a8b-4162-a058-f252d1dfec50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:55.007032 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb0358-9a8b-4162-a058-f252d1dfec50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:55.008620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb0358-9a8b-4162-a058-f252d1dfec50 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:55.018793 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1353/2713] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:55.023486 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ce218-5cd7-40c0-941d-fdd9ce93d7df admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:55.034159 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ce218-5cd7-40c0-941d-fdd9ce93d7df admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:55.044175 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0792d0-d29f-4a70-8600-e9c07ff487b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:55.044175 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0792d0-d29f-4a70-8600-e9c07ff487b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:55.044175 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0792d0-d29f-4a70-8600-e9c07ff487b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:55.044175 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0792d0-d29f-4a70-8600-e9c07ff487b9 admin admin] PATH_INFO: `/v3/projects/c80cceb809db49a5b6dfdb7ecff8e217/users/941166aafcd04684aec415be55a14a6a/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:55.044719 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0792d0-d29f-4a70-8600-e9c07ff487b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c80cceb809db49a5b6dfdb7ecff8e217, user_id=941166aafcd04684aec415be55a14a6a, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:55.045888 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0792d0-d29f-4a70-8600-e9c07ff487b9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:55.056279 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1361/2714] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:55 2022] PUT /identity/v3/projects/c80cceb809db49a5b6dfdb7ecff8e217/users/941166aafcd04684aec415be55a14a6a/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:55.068413 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167c878-ab13-46c0-b891-5b06f14b78f9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:55.068905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167c878-ab13-46c0-b891-5b06f14b78f9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:55.069008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167c878-ab13-46c0-b891-5b06f14b78f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:55.096414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1167c878-ab13-46c0-b891-5b06f14b78f9 None None] MFA Rules not processed for user `941166aafcd04684aec415be55a14a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:55.097557 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1167c878-ab13-46c0-b891-5b06f14b78f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:55.164417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1354/2715] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:55.177243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0792d0-d29f-4a70-8600-e9c07ff487b9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:55.178986 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cd0792d0-d29f-4a70-8600-e9c07ff487b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:55.224739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167c878-ab13-46c0-b891-5b06f14b78f9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:55.230822 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1167c878-ab13-46c0-b891-5b06f14b78f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:55.240680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0792d0-d29f-4a70-8600-e9c07ff487b9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:55.245126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c598e4-d2e6-4194-80a7-b821d60b65b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:55.245759 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c598e4-d2e6-4194-80a7-b821d60b65b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:55.246054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c598e4-d2e6-4194-80a7-b821d60b65b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:55.246323 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c598e4-d2e6-4194-80a7-b821d60b65b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:55.257560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c598e4-d2e6-4194-80a7-b821d60b65b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:55.259030 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c598e4-d2e6-4194-80a7-b821d60b65b2 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:55.268598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1362/2716] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:39:55.317150 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167c878-ab13-46c0-b891-5b06f14b78f9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:55.323213 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:55.323812 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:55.324164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:55.324514 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0 admin admin] PATH_INFO: `/v3/projects/b25c0cbcd19a46aab890bbf447978ecd` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:55.325809 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25c0cbcd19a46aab890bbf447978ecd)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:55.327886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:55.441314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:55.466513 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25c0cbcd19a46aab890bbf447978ecd', 'request_id': 'req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:55.505386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:55.565431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25c0cbcd19a46aab890bbf447978ecd', 'request_id': 'req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:55.571750 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25c0cbcd19a46aab890bbf447978ecd', 'request_id': 'req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:55.583458 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0 admin admin] The token cache is being invalidate because project b25c0cbcd19a46aab890bbf447978ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:39:55.583746 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:55.584387 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:55.585901 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1355/2717] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:39:55 2022] DELETE /identity/v3/projects/b25c0cbcd19a46aab890bbf447978ecd => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:55.589968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c598e4-d2e6-4194-80a7-b821d60b65b2 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:55.600373 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c598e4-d2e6-4194-80a7-b821d60b65b2 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:55.655313 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35822386-89d1-440c-b796-e22e814383dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:55.656113 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35822386-89d1-440c-b796-e22e814383dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:55.656391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35822386-89d1-440c-b796-e22e814383dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:55.656664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35822386-89d1-440c-b796-e22e814383dd admin admin] PATH_INFO: `/v3/users/2129e988b36d4ca9be3dae47b782c762` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:55.657925 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35822386-89d1-440c-b796-e22e814383dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2129e988b36d4ca9be3dae47b782c762)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:55.659875 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35822386-89d1-440c-b796-e22e814383dd admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:55.918254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-35822386-89d1-440c-b796-e22e814383dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2129e988b36d4ca9be3dae47b782c762'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:55.930476 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-35822386-89d1-440c-b796-e22e814383dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2129e988b36d4ca9be3dae47b782c762'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:55.937807 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-35822386-89d1-440c-b796-e22e814383dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2129e988b36d4ca9be3dae47b782c762'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:55.938485 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-35822386-89d1-440c-b796-e22e814383dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2129e988b36d4ca9be3dae47b782c762'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:56.007609 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-35822386-89d1-440c-b796-e22e814383dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2129e988b36d4ca9be3dae47b782c762'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:56.013973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1363/2718] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:55 2022] DELETE /identity/v3/users/2129e988b36d4ca9be3dae47b782c762 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:56.085860 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:56.133488 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:56.401333 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:56.402823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:56.465853 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d9d3a-90a4-46f3-83c3-d8010a2b66a0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:56.515831 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35822386-89d1-440c-b796-e22e814383dd admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:56.530691 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-35822386-89d1-440c-b796-e22e814383dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:56.541754 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d232ebc-7ebd-4d1e-931b-07ee4ac0ad08 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941166aafcd04684aec415be55a14a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c80cceb809db49a5b6dfdb7ecff8e217', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:56.542392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d232ebc-7ebd-4d1e-931b-07ee4ac0ad08 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:56.542744 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d232ebc-7ebd-4d1e-931b-07ee4ac0ad08 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:56.542944 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d232ebc-7ebd-4d1e-931b-07ee4ac0ad08 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:56.543839 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d232ebc-7ebd-4d1e-931b-07ee4ac0ad08 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:39:56.544172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d232ebc-7ebd-4d1e-931b-07ee4ac0ad08 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:56.545787 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d232ebc-7ebd-4d1e-931b-07ee4ac0ad08 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:56.578684 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1356/2719] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:39:56.579857 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d232ebc-7ebd-4d1e-931b-07ee4ac0ad08 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:56.582464 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5d232ebc-7ebd-4d1e-931b-07ee4ac0ad08 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:56.601354 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d232ebc-7ebd-4d1e-931b-07ee4ac0ad08 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:56.606958 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9861afd-f6c7-41ec-b549-7cdc69ba5fca tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941166aafcd04684aec415be55a14a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c80cceb809db49a5b6dfdb7ecff8e217', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:56.612534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9861afd-f6c7-41ec-b549-7cdc69ba5fca tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:56.612534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9861afd-f6c7-41ec-b549-7cdc69ba5fca tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:56.612534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9861afd-f6c7-41ec-b549-7cdc69ba5fca tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:56.612534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9861afd-f6c7-41ec-b549-7cdc69ba5fca tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:56.612534 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9861afd-f6c7-41ec-b549-7cdc69ba5fca tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:56.612962 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35822386-89d1-440c-b796-e22e814383dd admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:56.617762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94e4ce-806c-4fda-894c-e627c482a655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:56.618533 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94e4ce-806c-4fda-894c-e627c482a655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:56.618836 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94e4ce-806c-4fda-894c-e627c482a655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:56.619114 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94e4ce-806c-4fda-894c-e627c482a655 admin admin] PATH_INFO: `/v3/projects/b9bc062ff55d45c7aa098162460d783b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:56.620505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94e4ce-806c-4fda-894c-e627c482a655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9bc062ff55d45c7aa098162460d783b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:56.622587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94e4ce-806c-4fda-894c-e627c482a655 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:56.782222 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1357/2720] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:39:56 2022] POST /identity/v3/projects => generated 352 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:56.783378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9861afd-f6c7-41ec-b549-7cdc69ba5fca tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:56.799833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ab94e4ce-806c-4fda-894c-e627c482a655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9bc062ff55d45c7aa098162460d783b', 'request_id': 'req-ab94e4ce-806c-4fda-894c-e627c482a655'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:56.814222 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:56.847969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9861afd-f6c7-41ec-b549-7cdc69ba5fca tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:56.901722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333b134-1a8b-480a-a749-f85db5333a71 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941166aafcd04684aec415be55a14a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c80cceb809db49a5b6dfdb7ecff8e217', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:56.902345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333b134-1a8b-480a-a749-f85db5333a71 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:56.902624 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333b134-1a8b-480a-a749-f85db5333a71 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:56.902894 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333b134-1a8b-480a-a749-f85db5333a71 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:56.903592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333b134-1a8b-480a-a749-f85db5333a71 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:39:56.903896 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333b134-1a8b-480a-a749-f85db5333a71 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:56.906298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333b134-1a8b-480a-a749-f85db5333a71 tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:56.916494 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ab94e4ce-806c-4fda-894c-e627c482a655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9bc062ff55d45c7aa098162460d783b', 'request_id': 'req-ab94e4ce-806c-4fda-894c-e627c482a655'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:56.917267 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1358/2721] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:39:56.924430 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ab94e4ce-806c-4fda-894c-e627c482a655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9bc062ff55d45c7aa098162460d783b', 'request_id': 'req-ab94e4ce-806c-4fda-894c-e627c482a655'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:56.935071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ab94e4ce-806c-4fda-894c-e627c482a655 admin admin] The token cache is being invalidate because project b9bc062ff55d45c7aa098162460d783b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:39:56.935356 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ab94e4ce-806c-4fda-894c-e627c482a655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:56.935998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ab94e4ce-806c-4fda-894c-e627c482a655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:56.937448 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1364/2722] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:39:56 2022] DELETE /identity/v3/projects/b9bc062ff55d45c7aa098162460d783b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:56.942332 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179187e-41ea-414b-8bd7-26f619b45b96 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:56.942639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179187e-41ea-414b-8bd7-26f619b45b96 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:56.942915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179187e-41ea-414b-8bd7-26f619b45b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:56.955250 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94e4ce-806c-4fda-894c-e627c482a655 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:56.956681 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ab94e4ce-806c-4fda-894c-e627c482a655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:56.962893 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d179187e-41ea-414b-8bd7-26f619b45b96 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:56.964079 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d179187e-41ea-414b-8bd7-26f619b45b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:56.975892 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94e4ce-806c-4fda-894c-e627c482a655 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:56.980589 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eb7b8-f285-419b-808f-b2681529d8bc tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '941166aafcd04684aec415be55a14a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c80cceb809db49a5b6dfdb7ecff8e217', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:56.981227 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eb7b8-f285-419b-808f-b2681529d8bc tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:56.981626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eb7b8-f285-419b-808f-b2681529d8bc tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:56.981930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eb7b8-f285-419b-808f-b2681529d8bc tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] PATH_INFO: `/v3/projects/e75670f7f8ff4833b81b4a374c0a7e73` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:56.983741 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eb7b8-f285-419b-808f-b2681529d8bc tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e75670f7f8ff4833b81b4a374c0a7e73)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:56.985679 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eb7b8-f285-419b-808f-b2681529d8bc tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:57.035379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1359/2723] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:57.042999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d870a-aea8-4ae6-afe2-306488a2edd1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:57.043331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d870a-aea8-4ae6-afe2-306488a2edd1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:57.043607 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d870a-aea8-4ae6-afe2-306488a2edd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:57.063710 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a30d870a-aea8-4ae6-afe2-306488a2edd1 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:57.064912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a30d870a-aea8-4ae6-afe2-306488a2edd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:57.073164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1360/2724] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:39:57.077350 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d870a-aea8-4ae6-afe2-306488a2edd1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:57.086410 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d870a-aea8-4ae6-afe2-306488a2edd1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:57.091244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ce193-d023-40f1-b114-c4885802e451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:57.091826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ce193-d023-40f1-b114-c4885802e451 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:57.092098 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ce193-d023-40f1-b114-c4885802e451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:57.092895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ce193-d023-40f1-b114-c4885802e451 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:57.093533 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ce193-d023-40f1-b114-c4885802e451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:39:57.093864 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ce193-d023-40f1-b114-c4885802e451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:57.095421 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ce193-d023-40f1-b114-c4885802e451 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:57.106791 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1361/2725] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:39:57.111930 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ce193-d023-40f1-b114-c4885802e451 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:57.121286 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ce193-d023-40f1-b114-c4885802e451 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:57.125803 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07040861-a06c-4b3b-b1f0-fc3f9ede010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:57.126428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07040861-a06c-4b3b-b1f0-fc3f9ede010e admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:57.126705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07040861-a06c-4b3b-b1f0-fc3f9ede010e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:57.126971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07040861-a06c-4b3b-b1f0-fc3f9ede010e admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:57.127574 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07040861-a06c-4b3b-b1f0-fc3f9ede010e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:57.129604 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07040861-a06c-4b3b-b1f0-fc3f9ede010e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:57.140472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:57.146954 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-144eb7b8-f285-419b-808f-b2681529d8bc tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75670f7f8ff4833b81b4a374c0a7e73', 'request_id': 'req-144eb7b8-f285-419b-808f-b2681529d8bc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:57.251694 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-144eb7b8-f285-419b-808f-b2681529d8bc tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75670f7f8ff4833b81b4a374c0a7e73', 'request_id': 'req-144eb7b8-f285-419b-808f-b2681529d8bc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:57.258863 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-144eb7b8-f285-419b-808f-b2681529d8bc tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75670f7f8ff4833b81b4a374c0a7e73', 'request_id': 'req-144eb7b8-f285-419b-808f-b2681529d8bc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:57.263431 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1362/2726] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:39:57 2022] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:39:57.265626 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07040861-a06c-4b3b-b1f0-fc3f9ede010e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:57.284163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-144eb7b8-f285-419b-808f-b2681529d8bc tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] The token cache is being invalidate because project e75670f7f8ff4833b81b4a374c0a7e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:39:57.284457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-144eb7b8-f285-419b-808f-b2681529d8bc tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:57.285246 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-144eb7b8-f285-419b-808f-b2681529d8bc tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:57.290192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1365/2727] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:39:56 2022] DELETE /identity/v3/projects/e75670f7f8ff4833b81b4a374c0a7e73 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:57.333043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07040861-a06c-4b3b-b1f0-fc3f9ede010e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:57.338416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc5217-b338-4ea1-b97d-bf5c693bf141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:57.339018 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc5217-b338-4ea1-b97d-bf5c693bf141 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:57.339300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc5217-b338-4ea1-b97d-bf5c693bf141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:57.340015 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc5217-b338-4ea1-b97d-bf5c693bf141 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:57.340703 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc5217-b338-4ea1-b97d-bf5c693bf141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:57.343300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc5217-b338-4ea1-b97d-bf5c693bf141 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:57.349241 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:57.434860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1363/2728] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:39:57 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:57.438805 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eb7b8-f285-419b-808f-b2681529d8bc tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:57.440123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-144eb7b8-f285-419b-808f-b2681529d8bc tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:57.513387 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eb7b8-f285-419b-808f-b2681529d8bc tempest-VolumeQuotaClassesTest-1628120661 tempest-VolumeQuotaClassesTest-1628120661-project-admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:57.518534 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcc98f-b21d-4e20-b2ef-96817fdc1f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:57.519136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcc98f-b21d-4e20-b2ef-96817fdc1f30 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:57.519546 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcc98f-b21d-4e20-b2ef-96817fdc1f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:57.519687 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcc98f-b21d-4e20-b2ef-96817fdc1f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:57.520323 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bcc98f-b21d-4e20-b2ef-96817fdc1f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:57.521951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bcc98f-b21d-4e20-b2ef-96817fdc1f30 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:57.532550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1366/2729] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:57.536628 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc5217-b338-4ea1-b97d-bf5c693bf141 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:57.546661 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc5217-b338-4ea1-b97d-bf5c693bf141 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:57.554487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be265758-7847-4c8e-8c60-041a468807fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:57.554487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be265758-7847-4c8e-8c60-041a468807fa admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:57.554487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be265758-7847-4c8e-8c60-041a468807fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:57.554487 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be265758-7847-4c8e-8c60-041a468807fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:57.554893 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be265758-7847-4c8e-8c60-041a468807fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:57.556506 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be265758-7847-4c8e-8c60-041a468807fa admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:57.566869 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1364/2730] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:39:57.571103 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcc98f-b21d-4e20-b2ef-96817fdc1f30 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:57.581425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcc98f-b21d-4e20-b2ef-96817fdc1f30 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:57.586026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b953254-1409-471f-8223-0a067677aed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:57.586662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b953254-1409-471f-8223-0a067677aed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:57.586944 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b953254-1409-471f-8223-0a067677aed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:57.587218 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b953254-1409-471f-8223-0a067677aed0 admin admin] PATH_INFO: `/v3/projects/5617e9563453469b9cf327421bf18626/users/a234356216184b1daf65042764730216/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:57.601968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b953254-1409-471f-8223-0a067677aed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5617e9563453469b9cf327421bf18626, user_id=a234356216184b1daf65042764730216, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:57.610697 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b953254-1409-471f-8223-0a067677aed0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:57.806237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1367/2731] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:57 2022] PUT /identity/v3/projects/5617e9563453469b9cf327421bf18626/users/a234356216184b1daf65042764730216/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:57.816752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e2f57-a42b-424b-a0cd-bdd50f776db1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:57.817046 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e2f57-a42b-424b-a0cd-bdd50f776db1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:57.817325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e2f57-a42b-424b-a0cd-bdd50f776db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:57.846552 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a51e2f57-a42b-424b-a0cd-bdd50f776db1 None None] MFA Rules not processed for user `a234356216184b1daf65042764730216`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:57.847764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a51e2f57-a42b-424b-a0cd-bdd50f776db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:57.924317 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1365/2732] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:39:57.935852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b953254-1409-471f-8223-0a067677aed0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:58.020176 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b953254-1409-471f-8223-0a067677aed0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:58.024800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbb2b7-4847-479b-94a7-874a8dd86b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:58.025395 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbb2b7-4847-479b-94a7-874a8dd86b56 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:58.025671 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbb2b7-4847-479b-94a7-874a8dd86b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:58.025979 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbb2b7-4847-479b-94a7-874a8dd86b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:58.026606 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbb2b7-4847-479b-94a7-874a8dd86b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:58.028572 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbb2b7-4847-479b-94a7-874a8dd86b56 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:58.063215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e2f57-a42b-424b-a0cd-bdd50f776db1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:58.064645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a51e2f57-a42b-424b-a0cd-bdd50f776db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:58.078460 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e2f57-a42b-424b-a0cd-bdd50f776db1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:58.083086 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbfe6e-ab8c-4ca7-aacb-aa6ec062b14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:58.083699 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbfe6e-ab8c-4ca7-aacb-aa6ec062b14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:58.083975 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbfe6e-ab8c-4ca7-aacb-aa6ec062b14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:58.084247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbfe6e-ab8c-4ca7-aacb-aa6ec062b14e admin admin] PATH_INFO: `/v3/users/b850deeb6706438d9e8347f17689519f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:58.085365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbfe6e-ab8c-4ca7-aacb-aa6ec062b14e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b850deeb6706438d9e8347f17689519f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:58.087308 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbfe6e-ab8c-4ca7-aacb-aa6ec062b14e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:58.195850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1368/2733] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:39:57 2022] POST /identity/v3/projects => generated 393 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:39:58.199795 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbb2b7-4847-479b-94a7-874a8dd86b56 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:58.228712 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:58.260537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbb2b7-4847-479b-94a7-874a8dd86b56 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:58.265181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bd39e-c3ca-4ce5-bce4-3ec22c193a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:58.278231 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bd39e-c3ca-4ce5-bce4-3ec22c193a90 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:58.278231 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bd39e-c3ca-4ce5-bce4-3ec22c193a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:58.278231 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bd39e-c3ca-4ce5-bce4-3ec22c193a90 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:58.278231 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bd39e-c3ca-4ce5-bce4-3ec22c193a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:58.278231 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bd39e-c3ca-4ce5-bce4-3ec22c193a90 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:58.341274 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b8bbfe6e-ab8c-4ca7-aacb-aa6ec062b14e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b850deeb6706438d9e8347f17689519f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:58.354052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b8bbfe6e-ab8c-4ca7-aacb-aa6ec062b14e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b850deeb6706438d9e8347f17689519f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:58.361757 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b8bbfe6e-ab8c-4ca7-aacb-aa6ec062b14e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b850deeb6706438d9e8347f17689519f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:58.362427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b8bbfe6e-ab8c-4ca7-aacb-aa6ec062b14e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b850deeb6706438d9e8347f17689519f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:58.379007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1369/2734] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:39:58 2022] POST /identity/v3/users => generated 303 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:39:58.387345 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bd39e-c3ca-4ce5-bce4-3ec22c193a90 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:58.387345 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-392bd39e-c3ca-4ce5-bce4-3ec22c193a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:58.397446 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bd39e-c3ca-4ce5-bce4-3ec22c193a90 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:58.402406 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9ba98-9c47-4019-a150-f6a5d2f10789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:58.403025 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ba98-9c47-4019-a150-f6a5d2f10789 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:58.403305 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ba98-9c47-4019-a150-f6a5d2f10789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:58.403613 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ba98-9c47-4019-a150-f6a5d2f10789 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:58.404243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9ba98-9c47-4019-a150-f6a5d2f10789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:58.406761 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9ba98-9c47-4019-a150-f6a5d2f10789 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:58.418080 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1370/2735] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:39:58.422809 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9ba98-9c47-4019-a150-f6a5d2f10789 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:58.432103 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9ba98-9c47-4019-a150-f6a5d2f10789 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:58.436653 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690584d-1868-4ef7-9e0f-a504610feb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:58.437255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690584d-1868-4ef7-9e0f-a504610feb19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:58.437526 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690584d-1868-4ef7-9e0f-a504610feb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:58.437822 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690584d-1868-4ef7-9e0f-a504610feb19 admin admin] PATH_INFO: `/v3/projects/f18bcf64497e4e4c94226677ca0d39fc/users/a76501754f8b4149aa24e2b4de8c1c24/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:58.451455 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690584d-1868-4ef7-9e0f-a504610feb19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18bcf64497e4e4c94226677ca0d39fc, user_id=a76501754f8b4149aa24e2b4de8c1c24, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:58.454162 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690584d-1868-4ef7-9e0f-a504610feb19 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:58.481722 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b8bbfe6e-ab8c-4ca7-aacb-aa6ec062b14e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b850deeb6706438d9e8347f17689519f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:58.488679 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1366/2736] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:58 2022] DELETE /identity/v3/users/b850deeb6706438d9e8347f17689519f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:58.493015 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f629003-350c-4f4b-8e80-b97053dbc221 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:58.493301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f629003-350c-4f4b-8e80-b97053dbc221 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:58.493582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f629003-350c-4f4b-8e80-b97053dbc221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:58.501332 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:58.512196 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1f629003-350c-4f4b-8e80-b97053dbc221 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:58.513409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1f629003-350c-4f4b-8e80-b97053dbc221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:58.545310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1371/2737] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:58 2022] PUT /identity/v3/projects/f18bcf64497e4e4c94226677ca0d39fc/users/a76501754f8b4149aa24e2b4de8c1c24/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:58.549989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690584d-1868-4ef7-9e0f-a504610feb19 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:58.575709 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1367/2738] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:58.586141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f629003-350c-4f4b-8e80-b97053dbc221 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:58.587480 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1f629003-350c-4f4b-8e80-b97053dbc221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:58.616295 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690584d-1868-4ef7-9e0f-a504610feb19 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:58.621071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5589d15-b9ac-4cbe-bd73-571bf6d06cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:58.621667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5589d15-b9ac-4cbe-bd73-571bf6d06cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:58.621977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5589d15-b9ac-4cbe-bd73-571bf6d06cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:58.622240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5589d15-b9ac-4cbe-bd73-571bf6d06cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:58.622870 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5589d15-b9ac-4cbe-bd73-571bf6d06cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:58.624520 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5589d15-b9ac-4cbe-bd73-571bf6d06cb1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:58.634332 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1372/2739] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:39:58.638483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5589d15-b9ac-4cbe-bd73-571bf6d06cb1 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:58.643223 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f629003-350c-4f4b-8e80-b97053dbc221 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:58.647743 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5589d15-b9ac-4cbe-bd73-571bf6d06cb1 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:58.652493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf3a18-0df0-456d-9295-7b9479143ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:58.653127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf3a18-0df0-456d-9295-7b9479143ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:58.653401 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf3a18-0df0-456d-9295-7b9479143ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:58.653670 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf3a18-0df0-456d-9295-7b9479143ff4 admin admin] PATH_INFO: `/v3/projects/f18bcf64497e4e4c94226677ca0d39fc/users/a76501754f8b4149aa24e2b4de8c1c24/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:58.656480 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf3a18-0df0-456d-9295-7b9479143ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18bcf64497e4e4c94226677ca0d39fc, user_id=a76501754f8b4149aa24e2b4de8c1c24, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:58.659221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf3a18-0df0-456d-9295-7b9479143ff4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:58.669465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1373/2740] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:39:58 2022] PUT /identity/v3/projects/f18bcf64497e4e4c94226677ca0d39fc/users/a76501754f8b4149aa24e2b4de8c1c24/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:58.680989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf206f-e391-4e64-bb18-8da9c4c3b441 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:58.681521 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf206f-e391-4e64-bb18-8da9c4c3b441 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:58.682007 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf206f-e391-4e64-bb18-8da9c4c3b441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:58.694118 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee242a4c-29d1-4d01-8cf1-b681c12de762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:58.694727 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee242a4c-29d1-4d01-8cf1-b681c12de762 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:58.695004 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee242a4c-29d1-4d01-8cf1-b681c12de762 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:58.695276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee242a4c-29d1-4d01-8cf1-b681c12de762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:58.705104 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee242a4c-29d1-4d01-8cf1-b681c12de762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:58.706618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee242a4c-29d1-4d01-8cf1-b681c12de762 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:58.710040 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c9cf206f-e391-4e64-bb18-8da9c4c3b441 None None] MFA Rules not processed for user `a76501754f8b4149aa24e2b4de8c1c24`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:58.711221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c9cf206f-e391-4e64-bb18-8da9c4c3b441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:58.716807 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1368/2741] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:39:58.762387 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:58.782338 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1374/2742] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:39:58.793128 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee242a4c-29d1-4d01-8cf1-b681c12de762 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:58.794550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ee242a4c-29d1-4d01-8cf1-b681c12de762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:58.836937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf206f-e391-4e64-bb18-8da9c4c3b441 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:58.839059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c9cf206f-e391-4e64-bb18-8da9c4c3b441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:58.852427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee242a4c-29d1-4d01-8cf1-b681c12de762 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:58.868688 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:58.903938 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf206f-e391-4e64-bb18-8da9c4c3b441 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:58.904178 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171abb5-767a-46e6-8e46-f26108570588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:58.905725 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171abb5-767a-46e6-8e46-f26108570588 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:58.905974 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171abb5-767a-46e6-8e46-f26108570588 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:58.906342 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171abb5-767a-46e6-8e46-f26108570588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:58.909541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4731735-8d32-4378-a4c3-86e49b1d9060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:58.910291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4731735-8d32-4378-a4c3-86e49b1d9060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:58.910963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4731735-8d32-4378-a4c3-86e49b1d9060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:58.911089 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4731735-8d32-4378-a4c3-86e49b1d9060 admin admin] PATH_INFO: `/v3/users/97f1d752ef36424a8606db64c2fe2a14` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:58.912804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4731735-8d32-4378-a4c3-86e49b1d9060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f1d752ef36424a8606db64c2fe2a14)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:58.914764 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4731735-8d32-4378-a4c3-86e49b1d9060 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:58.916246 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171abb5-767a-46e6-8e46-f26108570588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:58.917887 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171abb5-767a-46e6-8e46-f26108570588 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:58.937831 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1369/2743] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:39:58.984820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171abb5-767a-46e6-8e46-f26108570588 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:58.986385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3171abb5-767a-46e6-8e46-f26108570588 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:58.998326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171abb5-767a-46e6-8e46-f26108570588 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:59.002700 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdcbda-2d07-4e6c-abcc-1bcdd37266ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:59.004915 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdcbda-2d07-4e6c-abcc-1bcdd37266ed service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:59.005312 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdcbda-2d07-4e6c-abcc-1bcdd37266ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:59.006160 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdcbda-2d07-4e6c-abcc-1bcdd37266ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:59.008678 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-55fdcbda-2d07-4e6c-abcc-1bcdd37266ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:59.076058 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdcbda-2d07-4e6c-abcc-1bcdd37266ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:59.079161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdcbda-2d07-4e6c-abcc-1bcdd37266ed service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:59.090033 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1370/2744] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:39:59.093782 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c4731735-8d32-4378-a4c3-86e49b1d9060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f1d752ef36424a8606db64c2fe2a14'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:59.106867 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c4731735-8d32-4378-a4c3-86e49b1d9060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f1d752ef36424a8606db64c2fe2a14'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:59.115048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c4731735-8d32-4378-a4c3-86e49b1d9060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f1d752ef36424a8606db64c2fe2a14'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:59.115825 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c4731735-8d32-4378-a4c3-86e49b1d9060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f1d752ef36424a8606db64c2fe2a14'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:59.152535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdcbda-2d07-4e6c-abcc-1bcdd37266ed service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:59.154097 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-55fdcbda-2d07-4e6c-abcc-1bcdd37266ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:59.170068 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdcbda-2d07-4e6c-abcc-1bcdd37266ed service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:59.175345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa01c2-e7b0-492d-87d8-2a2d124bc204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:59.176053 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa01c2-e7b0-492d-87d8-2a2d124bc204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:59.176372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa01c2-e7b0-492d-87d8-2a2d124bc204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:59.176714 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa01c2-e7b0-492d-87d8-2a2d124bc204 admin admin] PATH_INFO: `/v3/projects/5c250d01a27a4902a9b93fc7e573d4bc` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:59.178008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa01c2-e7b0-492d-87d8-2a2d124bc204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c250d01a27a4902a9b93fc7e573d4bc)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:59.179998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa01c2-e7b0-492d-87d8-2a2d124bc204 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:59.198825 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c4731735-8d32-4378-a4c3-86e49b1d9060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f1d752ef36424a8606db64c2fe2a14'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:59.202825 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1375/2745] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:58 2022] DELETE /identity/v3/users/97f1d752ef36424a8606db64c2fe2a14 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:39:59.206810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143371-29c4-42b5-acf5-cecbb2da1625 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:59.207552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143371-29c4-42b5-acf5-cecbb2da1625 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:59.207552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143371-29c4-42b5-acf5-cecbb2da1625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:59.230464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bf143371-29c4-42b5-acf5-cecbb2da1625 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:39:59.231731 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bf143371-29c4-42b5-acf5-cecbb2da1625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:59.291474 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1376/2746] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:39:59.301054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf143371-29c4-42b5-acf5-cecbb2da1625 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:59.302816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bf143371-29c4-42b5-acf5-cecbb2da1625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:59.309998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-11aa01c2-e7b0-492d-87d8-2a2d124bc204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c250d01a27a4902a9b93fc7e573d4bc', 'request_id': 'req-11aa01c2-e7b0-492d-87d8-2a2d124bc204'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:59.313599 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:59.359143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf143371-29c4-42b5-acf5-cecbb2da1625 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:59.394154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-11aa01c2-e7b0-492d-87d8-2a2d124bc204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c250d01a27a4902a9b93fc7e573d4bc', 'request_id': 'req-11aa01c2-e7b0-492d-87d8-2a2d124bc204'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:59.400157 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-11aa01c2-e7b0-492d-87d8-2a2d124bc204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c250d01a27a4902a9b93fc7e573d4bc', 'request_id': 'req-11aa01c2-e7b0-492d-87d8-2a2d124bc204'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:59.406676 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b7383-6184-4b53-a5de-e8da8cb7e266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:59.407280 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b7383-6184-4b53-a5de-e8da8cb7e266 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:59.407562 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b7383-6184-4b53-a5de-e8da8cb7e266 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:59.407832 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b7383-6184-4b53-a5de-e8da8cb7e266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:59.411913 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-11aa01c2-e7b0-492d-87d8-2a2d124bc204 admin admin] The token cache is being invalidate because project 5c250d01a27a4902a9b93fc7e573d4bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:39:59.412206 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-11aa01c2-e7b0-492d-87d8-2a2d124bc204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:59.412937 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-11aa01c2-e7b0-492d-87d8-2a2d124bc204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:59.414551 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1371/2747] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:39:59 2022] DELETE /identity/v3/projects/5c250d01a27a4902a9b93fc7e573d4bc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:39:59.418572 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa01c2-e7b0-492d-87d8-2a2d124bc204 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:39:59.419987 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-11aa01c2-e7b0-492d-87d8-2a2d124bc204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:39:59.470140 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:39:59.471012 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b7383-6184-4b53-a5de-e8da8cb7e266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:59.472523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b7383-6184-4b53-a5de-e8da8cb7e266 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:59.481981 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1377/2748] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:39:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:39:59.488615 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa01c2-e7b0-492d-87d8-2a2d124bc204 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:39:59.493428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66e540-655b-402d-b5fa-2ca56066711d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:39:59.494109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66e540-655b-402d-b5fa-2ca56066711d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:39:59.494392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66e540-655b-402d-b5fa-2ca56066711d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:39:59.494668 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66e540-655b-402d-b5fa-2ca56066711d admin admin] PATH_INFO: `/v3/users/941166aafcd04684aec415be55a14a6a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:39:59.495850 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66e540-655b-402d-b5fa-2ca56066711d admin admin] RBAC: Authorizing `identity:delete_user(user_id=941166aafcd04684aec415be55a14a6a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:39:59.497963 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66e540-655b-402d-b5fa-2ca56066711d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:39:59.849159 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0e66e540-655b-402d-b5fa-2ca56066711d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '941166aafcd04684aec415be55a14a6a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:59.861420 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0e66e540-655b-402d-b5fa-2ca56066711d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '941166aafcd04684aec415be55a14a6a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:59.868248 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0e66e540-655b-402d-b5fa-2ca56066711d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '941166aafcd04684aec415be55a14a6a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:59.868981 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0e66e540-655b-402d-b5fa-2ca56066711d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '941166aafcd04684aec415be55a14a6a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:59.982717 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0e66e540-655b-402d-b5fa-2ca56066711d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '941166aafcd04684aec415be55a14a6a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:39:59.990523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1372/2749] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:39:59 2022] DELETE /identity/v3/users/941166aafcd04684aec415be55a14a6a => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:00.235063 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b7383-6184-4b53-a5de-e8da8cb7e266 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:00.237152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-543b7383-6184-4b53-a5de-e8da8cb7e266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:00.266758 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b7383-6184-4b53-a5de-e8da8cb7e266 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:00.326890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62764a5-6a3c-49fa-b8ad-275cde67e095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:00.327566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62764a5-6a3c-49fa-b8ad-275cde67e095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:00.327792 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62764a5-6a3c-49fa-b8ad-275cde67e095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:00.328071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62764a5-6a3c-49fa-b8ad-275cde67e095 admin admin] PATH_INFO: `/v3/projects/620961838fd443f0b8ec766233ad6a66` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:00.329225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62764a5-6a3c-49fa-b8ad-275cde67e095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=620961838fd443f0b8ec766233ad6a66)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:00.331234 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62764a5-6a3c-49fa-b8ad-275cde67e095 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:00.349532 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:00.440211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c62764a5-6a3c-49fa-b8ad-275cde67e095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '620961838fd443f0b8ec766233ad6a66', 'request_id': 'req-c62764a5-6a3c-49fa-b8ad-275cde67e095'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:00.526782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66e540-655b-402d-b5fa-2ca56066711d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:00.529414 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0e66e540-655b-402d-b5fa-2ca56066711d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:00.538475 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c62764a5-6a3c-49fa-b8ad-275cde67e095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '620961838fd443f0b8ec766233ad6a66', 'request_id': 'req-c62764a5-6a3c-49fa-b8ad-275cde67e095'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:00.543614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66e540-655b-402d-b5fa-2ca56066711d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:00.560964 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c62764a5-6a3c-49fa-b8ad-275cde67e095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '620961838fd443f0b8ec766233ad6a66', 'request_id': 'req-c62764a5-6a3c-49fa-b8ad-275cde67e095'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:00.571545 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c62764a5-6a3c-49fa-b8ad-275cde67e095 admin admin] The token cache is being invalidate because project 620961838fd443f0b8ec766233ad6a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:40:00.572110 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c62764a5-6a3c-49fa-b8ad-275cde67e095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:00.572775 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c62764a5-6a3c-49fa-b8ad-275cde67e095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:00.574292 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1378/2750] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:40:00 2022] DELETE /identity/v3/projects/620961838fd443f0b8ec766233ad6a66 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:00.579512 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ff25d-bae2-4b07-952e-840f6fcf3d9e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:00.579656 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ff25d-bae2-4b07-952e-840f6fcf3d9e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:00.579919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ff25d-bae2-4b07-952e-840f6fcf3d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:00.601486 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-618ff25d-bae2-4b07-952e-840f6fcf3d9e None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:00.602757 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-618ff25d-bae2-4b07-952e-840f6fcf3d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:00.605419 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12460f0-0461-4fc7-9d23-963dab24130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:00.606089 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12460f0-0461-4fc7-9d23-963dab24130b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:00.606368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12460f0-0461-4fc7-9d23-963dab24130b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:00.606639 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12460f0-0461-4fc7-9d23-963dab24130b admin admin] PATH_INFO: `/v3/projects/c80cceb809db49a5b6dfdb7ecff8e217` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:00.607752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12460f0-0461-4fc7-9d23-963dab24130b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c80cceb809db49a5b6dfdb7ecff8e217)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:00.610456 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12460f0-0461-4fc7-9d23-963dab24130b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:00.611286 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1379/2751] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:00.618951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdae30-d98e-45f8-98b1-8c1046329f3d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:00.619236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdae30-d98e-45f8-98b1-8c1046329f3d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:00.619507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdae30-d98e-45f8-98b1-8c1046329f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:00.638716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5fcdae30-d98e-45f8-98b1-8c1046329f3d None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:00.639948 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5fcdae30-d98e-45f8-98b1-8c1046329f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:00.647793 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1380/2752] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:40:00.651899 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdae30-d98e-45f8-98b1-8c1046329f3d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:00.661546 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdae30-d98e-45f8-98b1-8c1046329f3d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:00.666144 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35088e3-0bbe-4d7b-9e5c-b3add8647ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:00.666692 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35088e3-0bbe-4d7b-9e5c-b3add8647ffc admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:00.667047 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35088e3-0bbe-4d7b-9e5c-b3add8647ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:00.667314 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35088e3-0bbe-4d7b-9e5c-b3add8647ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:00.667936 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35088e3-0bbe-4d7b-9e5c-b3add8647ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:40:00.668232 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35088e3-0bbe-4d7b-9e5c-b3add8647ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:00.669842 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35088e3-0bbe-4d7b-9e5c-b3add8647ffc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:00.681896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1381/2753] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:40:00.686078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35088e3-0bbe-4d7b-9e5c-b3add8647ffc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:00.695625 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35088e3-0bbe-4d7b-9e5c-b3add8647ffc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:00.700331 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5184862-c6d5-49c5-95b1-e7a930ac5d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:00.700896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5184862-c6d5-49c5-95b1-e7a930ac5d9a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:00.701174 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5184862-c6d5-49c5-95b1-e7a930ac5d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:00.701445 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5184862-c6d5-49c5-95b1-e7a930ac5d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:00.702138 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5184862-c6d5-49c5-95b1-e7a930ac5d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:00.704086 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5184862-c6d5-49c5-95b1-e7a930ac5d9a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:00.728702 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e12460f0-0461-4fc7-9d23-963dab24130b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c80cceb809db49a5b6dfdb7ecff8e217', 'request_id': 'req-e12460f0-0461-4fc7-9d23-963dab24130b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:00.790098 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e12460f0-0461-4fc7-9d23-963dab24130b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c80cceb809db49a5b6dfdb7ecff8e217', 'request_id': 'req-e12460f0-0461-4fc7-9d23-963dab24130b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:00.797341 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e12460f0-0461-4fc7-9d23-963dab24130b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c80cceb809db49a5b6dfdb7ecff8e217', 'request_id': 'req-e12460f0-0461-4fc7-9d23-963dab24130b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:00.798215 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1382/2754] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:40:00 2022] POST /identity/v3/projects => generated 361 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:40:00.798711 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:00.803360 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5184862-c6d5-49c5-95b1-e7a930ac5d9a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:00.809557 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e12460f0-0461-4fc7-9d23-963dab24130b admin admin] The token cache is being invalidate because project c80cceb809db49a5b6dfdb7ecff8e217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:40:00.809880 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e12460f0-0461-4fc7-9d23-963dab24130b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:00.810558 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e12460f0-0461-4fc7-9d23-963dab24130b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:00.812126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1373/2755] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:40:00 2022] DELETE /identity/v3/projects/c80cceb809db49a5b6dfdb7ecff8e217 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:40:00.816828 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28bfcb-82ce-43d4-bb85-6b7d4e0ea53b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:00.817113 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28bfcb-82ce-43d4-bb85-6b7d4e0ea53b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:00.817385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28bfcb-82ce-43d4-bb85-6b7d4e0ea53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:00.837007 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-af28bfcb-82ce-43d4-bb85-6b7d4e0ea53b None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:00.838254 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-af28bfcb-82ce-43d4-bb85-6b7d4e0ea53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:00.866196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5184862-c6d5-49c5-95b1-e7a930ac5d9a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:00.870870 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf279a-f05a-4db5-adb2-70cf154324d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:00.871466 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf279a-f05a-4db5-adb2-70cf154324d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:00.871744 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf279a-f05a-4db5-adb2-70cf154324d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:00.872012 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf279a-f05a-4db5-adb2-70cf154324d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:00.872635 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf279a-f05a-4db5-adb2-70cf154324d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:00.874591 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf279a-f05a-4db5-adb2-70cf154324d5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:00.898305 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1374/2756] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:40:00.906575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b5c71-69ed-4509-85df-9792bec8a599 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:00.906860 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b5c71-69ed-4509-85df-9792bec8a599 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:00.907136 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b5c71-69ed-4509-85df-9792bec8a599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:00.926630 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8a9b5c71-69ed-4509-85df-9792bec8a599 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:00.927943 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8a9b5c71-69ed-4509-85df-9792bec8a599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:00.936357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1375/2757] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:40:00.940504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b5c71-69ed-4509-85df-9792bec8a599 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:00.948944 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b5c71-69ed-4509-85df-9792bec8a599 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:00.954047 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a765b71-5a35-42e1-ab53-5fabb291cd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:00.954602 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a765b71-5a35-42e1-ab53-5fabb291cd1d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:00.954874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a765b71-5a35-42e1-ab53-5fabb291cd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:00.955143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a765b71-5a35-42e1-ab53-5fabb291cd1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:00.955765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a765b71-5a35-42e1-ab53-5fabb291cd1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:40:00.956062 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a765b71-5a35-42e1-ab53-5fabb291cd1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:00.957630 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a765b71-5a35-42e1-ab53-5fabb291cd1d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:00.965262 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1383/2758] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:40:00 2022] POST /identity/v3/users => generated 281 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:40:00.970485 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf279a-f05a-4db5-adb2-70cf154324d5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:00.970485 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b3cf279a-f05a-4db5-adb2-70cf154324d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:00.973695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1376/2759] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:40:00.974648 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a765b71-5a35-42e1-ab53-5fabb291cd1d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:00.981438 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf279a-f05a-4db5-adb2-70cf154324d5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:00.984858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a765b71-5a35-42e1-ab53-5fabb291cd1d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:00.986293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ef054-e04e-4052-b06a-12d106dc0957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:00.986896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ef054-e04e-4052-b06a-12d106dc0957 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:00.987163 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ef054-e04e-4052-b06a-12d106dc0957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:00.987433 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ef054-e04e-4052-b06a-12d106dc0957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:00.988077 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ef054-e04e-4052-b06a-12d106dc0957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:00.989453 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b623f58-d418-40b7-8fb7-060a4d55bf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:00.989874 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ef054-e04e-4052-b06a-12d106dc0957 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:00.990070 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b623f58-d418-40b7-8fb7-060a4d55bf7a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:00.990344 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b623f58-d418-40b7-8fb7-060a4d55bf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:00.990618 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b623f58-d418-40b7-8fb7-060a4d55bf7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:00.991237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b623f58-d418-40b7-8fb7-060a4d55bf7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:00.993085 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b623f58-d418-40b7-8fb7-060a4d55bf7a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:01.002991 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1384/2760] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:01.003982 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ef054-e04e-4052-b06a-12d106dc0957 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:01.013926 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ef054-e04e-4052-b06a-12d106dc0957 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:01.019185 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaba785-fa59-4ad3-adf5-b5baf8fa87af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:01.019878 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaba785-fa59-4ad3-adf5-b5baf8fa87af admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:01.020203 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaba785-fa59-4ad3-adf5-b5baf8fa87af admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:01.020477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaba785-fa59-4ad3-adf5-b5baf8fa87af admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:01.021115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaba785-fa59-4ad3-adf5-b5baf8fa87af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:01.022723 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaba785-fa59-4ad3-adf5-b5baf8fa87af admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:01.034668 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1385/2761] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:01.038854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaba785-fa59-4ad3-adf5-b5baf8fa87af admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:01.048753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaba785-fa59-4ad3-adf5-b5baf8fa87af admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:01.054207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c533b9-ef18-47ac-a08f-466a98f66af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:01.057501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c533b9-ef18-47ac-a08f-466a98f66af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:01.057501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c533b9-ef18-47ac-a08f-466a98f66af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:01.057501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c533b9-ef18-47ac-a08f-466a98f66af5 admin admin] PATH_INFO: `/v3/projects/5c40025edf164a4ba5f2202d0ff9b5eb/users/343844c8d28e4558b0c48ddb00aca408/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:01.070998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c533b9-ef18-47ac-a08f-466a98f66af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c40025edf164a4ba5f2202d0ff9b5eb, user_id=343844c8d28e4558b0c48ddb00aca408, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:01.073667 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c533b9-ef18-47ac-a08f-466a98f66af5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:01.106386 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1377/2762] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:40:00 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:40:01.110554 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b623f58-d418-40b7-8fb7-060a4d55bf7a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:01.171398 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b623f58-d418-40b7-8fb7-060a4d55bf7a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:01.176009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9f88-c740-4713-bc7c-849d18cd9a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:01.176598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9f88-c740-4713-bc7c-849d18cd9a22 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:01.176876 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9f88-c740-4713-bc7c-849d18cd9a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:01.177145 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9f88-c740-4713-bc7c-849d18cd9a22 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:01.177799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae9f88-c740-4713-bc7c-849d18cd9a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:01.179697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae9f88-c740-4713-bc7c-849d18cd9a22 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:01.195552 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:01.200372 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1386/2763] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:40:01 2022] PUT /identity/v3/projects/5c40025edf164a4ba5f2202d0ff9b5eb/users/343844c8d28e4558b0c48ddb00aca408/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:40:01.211971 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757abe4-df07-4705-a85d-9ced91d1bcb2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:01.212254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757abe4-df07-4705-a85d-9ced91d1bcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:01.212526 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757abe4-df07-4705-a85d-9ced91d1bcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:01.239597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7757abe4-df07-4705-a85d-9ced91d1bcb2 None None] MFA Rules not processed for user `343844c8d28e4558b0c48ddb00aca408`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:01.240786 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7757abe4-df07-4705-a85d-9ced91d1bcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:01.294103 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1378/2764] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:40:01 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:40:01.298698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9f88-c740-4713-bc7c-849d18cd9a22 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:01.303776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1387/2765] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:40:01.308558 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9f88-c740-4713-bc7c-849d18cd9a22 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:01.343446 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757abe4-df07-4705-a85d-9ced91d1bcb2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:01.345105 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7757abe4-df07-4705-a85d-9ced91d1bcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:01.356462 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:01.375010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065edf43-4e6c-4661-9080-328a40a1d772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:01.375768 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065edf43-4e6c-4661-9080-328a40a1d772 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:01.376043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065edf43-4e6c-4661-9080-328a40a1d772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:01.376378 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065edf43-4e6c-4661-9080-328a40a1d772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:01.377204 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065edf43-4e6c-4661-9080-328a40a1d772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:01.378886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065edf43-4e6c-4661-9080-328a40a1d772 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:01.390766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1379/2766] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:01.394851 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065edf43-4e6c-4661-9080-328a40a1d772 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:01.405844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065edf43-4e6c-4661-9080-328a40a1d772 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:01.411194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f66046-81bf-43e5-910b-12f60a3ef385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:01.413890 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757abe4-df07-4705-a85d-9ced91d1bcb2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:01.414025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f66046-81bf-43e5-910b-12f60a3ef385 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:01.414025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f66046-81bf-43e5-910b-12f60a3ef385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:01.414025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f66046-81bf-43e5-910b-12f60a3ef385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:01.414025 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f66046-81bf-43e5-910b-12f60a3ef385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:01.414763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f66046-81bf-43e5-910b-12f60a3ef385 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:01.415337 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228b5bc-af4f-4bf6-9b46-249396d07831 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:01.416099 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228b5bc-af4f-4bf6-9b46-249396d07831 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:01.416389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228b5bc-af4f-4bf6-9b46-249396d07831 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:01.416660 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228b5bc-af4f-4bf6-9b46-249396d07831 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:01.426388 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228b5bc-af4f-4bf6-9b46-249396d07831 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:01.430820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1380/2767] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:40:01.430985 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228b5bc-af4f-4bf6-9b46-249396d07831 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:01.432171 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f66046-81bf-43e5-910b-12f60a3ef385 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:01.438127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1388/2768] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:40:01.455535 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228b5bc-af4f-4bf6-9b46-249396d07831 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:01.458105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f66046-81bf-43e5-910b-12f60a3ef385 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:01.466083 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059311e-fc0e-41f0-bb25-bc7d13fd9517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:01.466756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059311e-fc0e-41f0-bb25-bc7d13fd9517 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:01.467589 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228b5bc-af4f-4bf6-9b46-249396d07831 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:01.467723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059311e-fc0e-41f0-bb25-bc7d13fd9517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:01.467945 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059311e-fc0e-41f0-bb25-bc7d13fd9517 admin admin] PATH_INFO: `/v3/projects/c8fbeb1472414c0c802ef565f0096a07/users/d31426803bcb40b9ad3b7a28effbbf9d/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:01.474187 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765af6e3-2b81-4066-8a9a-f3bdadc57be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:01.474921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765af6e3-2b81-4066-8a9a-f3bdadc57be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:01.475296 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765af6e3-2b81-4066-8a9a-f3bdadc57be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:01.480135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765af6e3-2b81-4066-8a9a-f3bdadc57be0 admin admin] PATH_INFO: `/v3/users/343844c8d28e4558b0c48ddb00aca408` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:01.480135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765af6e3-2b81-4066-8a9a-f3bdadc57be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=343844c8d28e4558b0c48ddb00aca408)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:01.480135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765af6e3-2b81-4066-8a9a-f3bdadc57be0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:01.488989 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059311e-fc0e-41f0-bb25-bc7d13fd9517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fbeb1472414c0c802ef565f0096a07, user_id=d31426803bcb40b9ad3b7a28effbbf9d, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:01.491301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059311e-fc0e-41f0-bb25-bc7d13fd9517 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:01.620646 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1381/2769] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:40:01 2022] PUT /identity/v3/projects/c8fbeb1472414c0c802ef565f0096a07/users/d31426803bcb40b9ad3b7a28effbbf9d/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:01.635122 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f2198-5247-4c84-bf87-38aa5b712f8c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:01.635122 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f2198-5247-4c84-bf87-38aa5b712f8c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:01.635122 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f2198-5247-4c84-bf87-38aa5b712f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:01.669774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-428f2198-5247-4c84-bf87-38aa5b712f8c None None] MFA Rules not processed for user `d31426803bcb40b9ad3b7a28effbbf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:01.671510 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-428f2198-5247-4c84-bf87-38aa5b712f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:01.734864 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1382/2770] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:40:01.745979 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f2198-5247-4c84-bf87-38aa5b712f8c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:01.747270 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-428f2198-5247-4c84-bf87-38aa5b712f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:01.790576 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-765af6e3-2b81-4066-8a9a-f3bdadc57be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343844c8d28e4558b0c48ddb00aca408'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:01.805649 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-765af6e3-2b81-4066-8a9a-f3bdadc57be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343844c8d28e4558b0c48ddb00aca408'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:01.806281 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f2198-5247-4c84-bf87-38aa5b712f8c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:01.809961 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfc59f-83c2-468b-bd31-e2899584456f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:01.810558 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfc59f-83c2-468b-bd31-e2899584456f service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:01.810834 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfc59f-83c2-468b-bd31-e2899584456f service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:01.811671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfc59f-83c2-468b-bd31-e2899584456f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:01.812849 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-765af6e3-2b81-4066-8a9a-f3bdadc57be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343844c8d28e4558b0c48ddb00aca408'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:01.813583 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-765af6e3-2b81-4066-8a9a-f3bdadc57be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343844c8d28e4558b0c48ddb00aca408'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:01.821998 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfc59f-83c2-468b-bd31-e2899584456f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:01.823559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfc59f-83c2-468b-bd31-e2899584456f service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:01.832758 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1383/2771] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:40:01.851739 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfc59f-83c2-468b-bd31-e2899584456f service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:01.870417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-765af6e3-2b81-4066-8a9a-f3bdadc57be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343844c8d28e4558b0c48ddb00aca408'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:01.883995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1389/2772] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:40:01 2022] DELETE /identity/v3/users/343844c8d28e4558b0c48ddb00aca408 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:40:01.883995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175802ef-f5e3-466b-b784-fb9a55ba3073 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:01.883995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175802ef-f5e3-466b-b784-fb9a55ba3073 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:01.883995 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175802ef-f5e3-466b-b784-fb9a55ba3073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:01.893900 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:01.898105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:01.905387 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-175802ef-f5e3-466b-b784-fb9a55ba3073 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:01.906991 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-175802ef-f5e3-466b-b784-fb9a55ba3073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:01.923740 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfc59f-83c2-468b-bd31-e2899584456f service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:01.970737 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1390/2773] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:40:01.980709 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175802ef-f5e3-466b-b784-fb9a55ba3073 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:01.982188 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-175802ef-f5e3-466b-b784-fb9a55ba3073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:02.013153 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e932d-f12f-4562-936c-2321ecacf38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:02.013802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e932d-f12f-4562-936c-2321ecacf38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:02.014110 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e932d-f12f-4562-936c-2321ecacf38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:02.014385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e932d-f12f-4562-936c-2321ecacf38b admin admin] PATH_INFO: `/v3/users/d31426803bcb40b9ad3b7a28effbbf9d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:02.015950 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e932d-f12f-4562-936c-2321ecacf38b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31426803bcb40b9ad3b7a28effbbf9d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:02.017597 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e932d-f12f-4562-936c-2321ecacf38b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:02.051021 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175802ef-f5e3-466b-b784-fb9a55ba3073 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:02.059882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43c259-877d-4d85-9bd3-c59954c5730d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:02.059882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43c259-877d-4d85-9bd3-c59954c5730d service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:02.059882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43c259-877d-4d85-9bd3-c59954c5730d service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:02.059882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43c259-877d-4d85-9bd3-c59954c5730d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:02.070059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43c259-877d-4d85-9bd3-c59954c5730d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:02.071595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43c259-877d-4d85-9bd3-c59954c5730d service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:02.083011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1391/2774] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:40:02.231180 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-009e932d-f12f-4562-936c-2321ecacf38b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31426803bcb40b9ad3b7a28effbbf9d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:02.244120 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-009e932d-f12f-4562-936c-2321ecacf38b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31426803bcb40b9ad3b7a28effbbf9d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:02.251619 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-009e932d-f12f-4562-936c-2321ecacf38b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31426803bcb40b9ad3b7a28effbbf9d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:02.252507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-009e932d-f12f-4562-936c-2321ecacf38b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31426803bcb40b9ad3b7a28effbbf9d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:02.340012 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-009e932d-f12f-4562-936c-2321ecacf38b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31426803bcb40b9ad3b7a28effbbf9d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:02.347491 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1384/2775] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:40:01 2022] DELETE /identity/v3/users/d31426803bcb40b9ad3b7a28effbbf9d => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:40:02.351847 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596af17-0980-4e9b-84d0-0b9f67f33492 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:02.352739 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596af17-0980-4e9b-84d0-0b9f67f33492 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:02.353024 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596af17-0980-4e9b-84d0-0b9f67f33492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:02.375854 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f596af17-0980-4e9b-84d0-0b9f67f33492 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:02.378756 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f596af17-0980-4e9b-84d0-0b9f67f33492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:02.436578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1392/2776] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:02.446059 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e932d-f12f-4562-936c-2321ecacf38b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:02.447441 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-009e932d-f12f-4562-936c-2321ecacf38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:02.510003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e932d-f12f-4562-936c-2321ecacf38b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:02.513545 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485866e-8527-49b8-a75f-73a07bc60056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:02.514697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485866e-8527-49b8-a75f-73a07bc60056 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:02.514971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485866e-8527-49b8-a75f-73a07bc60056 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:02.515240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485866e-8527-49b8-a75f-73a07bc60056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:02.523989 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485866e-8527-49b8-a75f-73a07bc60056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:02.529009 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485866e-8527-49b8-a75f-73a07bc60056 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:02.535583 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1385/2777] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:40:02.556804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596af17-0980-4e9b-84d0-0b9f67f33492 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:02.558221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f596af17-0980-4e9b-84d0-0b9f67f33492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:02.577465 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596af17-0980-4e9b-84d0-0b9f67f33492 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:02.579278 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b135e-3bee-4c0a-a5c7-dbd57100a87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:02.579907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b135e-3bee-4c0a-a5c7-dbd57100a87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:02.580181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b135e-3bee-4c0a-a5c7-dbd57100a87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:02.580500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b135e-3bee-4c0a-a5c7-dbd57100a87b admin admin] PATH_INFO: `/v3/projects/5c40025edf164a4ba5f2202d0ff9b5eb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:02.582136 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b135e-3bee-4c0a-a5c7-dbd57100a87b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c40025edf164a4ba5f2202d0ff9b5eb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:02.584225 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b135e-3bee-4c0a-a5c7-dbd57100a87b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:02.798391 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:02.803748 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5f9b135e-3bee-4c0a-a5c7-dbd57100a87b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c40025edf164a4ba5f2202d0ff9b5eb', 'request_id': 'req-5f9b135e-3bee-4c0a-a5c7-dbd57100a87b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:02.885841 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5f9b135e-3bee-4c0a-a5c7-dbd57100a87b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c40025edf164a4ba5f2202d0ff9b5eb', 'request_id': 'req-5f9b135e-3bee-4c0a-a5c7-dbd57100a87b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:02.894083 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5f9b135e-3bee-4c0a-a5c7-dbd57100a87b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c40025edf164a4ba5f2202d0ff9b5eb', 'request_id': 'req-5f9b135e-3bee-4c0a-a5c7-dbd57100a87b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:02.904826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5f9b135e-3bee-4c0a-a5c7-dbd57100a87b admin admin] The token cache is being invalidate because project 5c40025edf164a4ba5f2202d0ff9b5eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:40:02.905823 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5f9b135e-3bee-4c0a-a5c7-dbd57100a87b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:02.906037 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5f9b135e-3bee-4c0a-a5c7-dbd57100a87b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:02.907551 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1393/2778] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:40:02 2022] DELETE /identity/v3/projects/5c40025edf164a4ba5f2202d0ff9b5eb => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:02.912399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949decd0-2131-4d83-b703-47a488affe87 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:02.917535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949decd0-2131-4d83-b703-47a488affe87 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:02.917535 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949decd0-2131-4d83-b703-47a488affe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:02.922849 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:02.934721 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-949decd0-2131-4d83-b703-47a488affe87 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:02.935638 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-949decd0-2131-4d83-b703-47a488affe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:02.996301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1386/2779] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:03.004595 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cd930-25fa-4168-b412-78096915f10b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.004901 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cd930-25fa-4168-b412-78096915f10b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.005180 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cd930-25fa-4168-b412-78096915f10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.025307 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-392cd930-25fa-4168-b412-78096915f10b None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:03.026522 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-392cd930-25fa-4168-b412-78096915f10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:03.034623 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1394/2780] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:03.038843 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949decd0-2131-4d83-b703-47a488affe87 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:03.048508 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949decd0-2131-4d83-b703-47a488affe87 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:03.053436 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eede79b-342f-4c90-990b-8e756d26f351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:03.054099 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eede79b-342f-4c90-990b-8e756d26f351 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.054383 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eede79b-342f-4c90-990b-8e756d26f351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.054665 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eede79b-342f-4c90-990b-8e756d26f351 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.055325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eede79b-342f-4c90-990b-8e756d26f351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:40:03.056837 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eede79b-342f-4c90-990b-8e756d26f351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:03.057319 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eede79b-342f-4c90-990b-8e756d26f351 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:03.068797 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cd930-25fa-4168-b412-78096915f10b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:03.071254 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-392cd930-25fa-4168-b412-78096915f10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:03.078443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1387/2781] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:40:03.079919 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eede79b-342f-4c90-990b-8e756d26f351 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:03.092482 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eede79b-342f-4c90-990b-8e756d26f351 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:03.093196 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cd930-25fa-4168-b412-78096915f10b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:03.097394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935bbac-9b1e-436c-a40d-9f9b008b3237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:03.098048 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935bbac-9b1e-436c-a40d-9f9b008b3237 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.098330 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935bbac-9b1e-436c-a40d-9f9b008b3237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.098604 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935bbac-9b1e-436c-a40d-9f9b008b3237 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.099242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935bbac-9b1e-436c-a40d-9f9b008b3237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:03.099710 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f4d6a-ca5c-46c9-9fab-1365d30b5be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:03.100612 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f4d6a-ca5c-46c9-9fab-1365d30b5be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.100898 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f4d6a-ca5c-46c9-9fab-1365d30b5be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.101170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f4d6a-ca5c-46c9-9fab-1365d30b5be6 admin admin] PATH_INFO: `/v3/projects/c8fbeb1472414c0c802ef565f0096a07` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.101339 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935bbac-9b1e-436c-a40d-9f9b008b3237 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:03.102481 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f4d6a-ca5c-46c9-9fab-1365d30b5be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8fbeb1472414c0c802ef565f0096a07)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:03.105509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f4d6a-ca5c-46c9-9fab-1365d30b5be6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:03.231845 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1388/2782] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:40:03 2022] POST /identity/v3/projects => generated 363 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:40:03.236443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935bbac-9b1e-436c-a40d-9f9b008b3237 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:03.242658 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-536f4d6a-ca5c-46c9-9fab-1365d30b5be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8fbeb1472414c0c802ef565f0096a07', 'request_id': 'req-536f4d6a-ca5c-46c9-9fab-1365d30b5be6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:03.299319 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935bbac-9b1e-436c-a40d-9f9b008b3237 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:03.304060 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad58529-c6ad-48f7-9eb1-06cb80c03693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:03.304346 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-536f4d6a-ca5c-46c9-9fab-1365d30b5be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8fbeb1472414c0c802ef565f0096a07', 'request_id': 'req-536f4d6a-ca5c-46c9-9fab-1365d30b5be6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:03.304740 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad58529-c6ad-48f7-9eb1-06cb80c03693 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.305040 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad58529-c6ad-48f7-9eb1-06cb80c03693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.305292 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad58529-c6ad-48f7-9eb1-06cb80c03693 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.305948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad58529-c6ad-48f7-9eb1-06cb80c03693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:03.307905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad58529-c6ad-48f7-9eb1-06cb80c03693 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:03.311968 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-536f4d6a-ca5c-46c9-9fab-1365d30b5be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8fbeb1472414c0c802ef565f0096a07', 'request_id': 'req-536f4d6a-ca5c-46c9-9fab-1365d30b5be6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:03.323312 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-536f4d6a-ca5c-46c9-9fab-1365d30b5be6 admin admin] The token cache is being invalidate because project c8fbeb1472414c0c802ef565f0096a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:40:03.323607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-536f4d6a-ca5c-46c9-9fab-1365d30b5be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:03.324297 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-536f4d6a-ca5c-46c9-9fab-1365d30b5be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:03.325858 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1395/2783] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:40:03 2022] DELETE /identity/v3/projects/c8fbeb1472414c0c802ef565f0096a07 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:40:03.330417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e105b59-2240-4ed7-b7a9-f8fd3fe0fffc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.330643 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e105b59-2240-4ed7-b7a9-f8fd3fe0fffc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.330921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e105b59-2240-4ed7-b7a9-f8fd3fe0fffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.351227 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5e105b59-2240-4ed7-b7a9-f8fd3fe0fffc None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:03.352479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5e105b59-2240-4ed7-b7a9-f8fd3fe0fffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:03.361891 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1396/2784] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:40:03.369636 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d88d9e-e7e1-4792-b911-3bc89eae212c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.369946 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d88d9e-e7e1-4792-b911-3bc89eae212c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.370221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d88d9e-e7e1-4792-b911-3bc89eae212c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.390052 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-90d88d9e-e7e1-4792-b911-3bc89eae212c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:03.391250 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-90d88d9e-e7e1-4792-b911-3bc89eae212c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:03.397190 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1389/2785] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:40:03 2022] POST /identity/v3/users => generated 282 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:40:03.398142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad58529-c6ad-48f7-9eb1-06cb80c03693 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:03.399658 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0ad58529-c6ad-48f7-9eb1-06cb80c03693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:03.399918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1397/2786] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:40:03.403597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d88d9e-e7e1-4792-b911-3bc89eae212c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:03.411828 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad58529-c6ad-48f7-9eb1-06cb80c03693 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:03.412617 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d88d9e-e7e1-4792-b911-3bc89eae212c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:03.416789 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f397530-2c12-4d38-bbbf-02901b32c1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:03.417432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f397530-2c12-4d38-bbbf-02901b32c1fa admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.417713 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f397530-2c12-4d38-bbbf-02901b32c1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.417847 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca86e0-0145-4c79-a44d-bf7c62fac9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:03.422648 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f397530-2c12-4d38-bbbf-02901b32c1fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.422759 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca86e0-0145-4c79-a44d-bf7c62fac9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.422874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f397530-2c12-4d38-bbbf-02901b32c1fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:03.422970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca86e0-0145-4c79-a44d-bf7c62fac9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.422970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca86e0-0145-4c79-a44d-bf7c62fac9a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.422970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca86e0-0145-4c79-a44d-bf7c62fac9a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:40:03.422970 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca86e0-0145-4c79-a44d-bf7c62fac9a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:03.423323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f397530-2c12-4d38-bbbf-02901b32c1fa admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:03.423415 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca86e0-0145-4c79-a44d-bf7c62fac9a5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:03.431070 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1390/2787] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:40:03.434568 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1398/2788] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:40:03.438526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f397530-2c12-4d38-bbbf-02901b32c1fa admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:03.439291 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca86e0-0145-4c79-a44d-bf7c62fac9a5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:03.448368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f397530-2c12-4d38-bbbf-02901b32c1fa admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:03.449017 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca86e0-0145-4c79-a44d-bf7c62fac9a5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:03.453345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9a836-ea3b-4c8c-92cf-98142174426d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:03.453797 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75fbd9-cd60-4471-ad73-08e2f3923f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:03.453966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9a836-ea3b-4c8c-92cf-98142174426d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.454242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9a836-ea3b-4c8c-92cf-98142174426d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.454357 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75fbd9-cd60-4471-ad73-08e2f3923f44 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.454511 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9a836-ea3b-4c8c-92cf-98142174426d admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.454638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75fbd9-cd60-4471-ad73-08e2f3923f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.454907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75fbd9-cd60-4471-ad73-08e2f3923f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.455164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9a836-ea3b-4c8c-92cf-98142174426d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:03.455518 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75fbd9-cd60-4471-ad73-08e2f3923f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:03.456729 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9a836-ea3b-4c8c-92cf-98142174426d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:03.457480 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75fbd9-cd60-4471-ad73-08e2f3923f44 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:03.468139 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1391/2789] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:03.472301 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9a836-ea3b-4c8c-92cf-98142174426d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:03.482093 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9a836-ea3b-4c8c-92cf-98142174426d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:03.487255 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f8bf4-146d-4f85-93bd-0ef6460015ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:03.487912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f8bf4-146d-4f85-93bd-0ef6460015ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.488192 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f8bf4-146d-4f85-93bd-0ef6460015ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.488463 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f8bf4-146d-4f85-93bd-0ef6460015ed admin admin] PATH_INFO: `/v3/projects/5a6c9cfd8d5443a7a5dbdb5fe7656a12/users/c37bf80de0d947cc860475fbc0234f65/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.504394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f8bf4-146d-4f85-93bd-0ef6460015ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6c9cfd8d5443a7a5dbdb5fe7656a12, user_id=c37bf80de0d947cc860475fbc0234f65, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:03.507278 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f8bf4-146d-4f85-93bd-0ef6460015ed admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:03.586130 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1399/2790] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:40:03 2022] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:40:03.590028 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75fbd9-cd60-4471-ad73-08e2f3923f44 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:03.650669 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75fbd9-cd60-4471-ad73-08e2f3923f44 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:03.654464 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:03.656893 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1392/2791] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:40:03 2022] PUT /identity/v3/projects/5a6c9cfd8d5443a7a5dbdb5fe7656a12/users/c37bf80de0d947cc860475fbc0234f65/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:40:03.667208 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdcd75-84a2-40cd-8a87-46906b73c18e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.667492 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdcd75-84a2-40cd-8a87-46906b73c18e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.667761 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdcd75-84a2-40cd-8a87-46906b73c18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.697592 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ebcdcd75-84a2-40cd-8a87-46906b73c18e None None] MFA Rules not processed for user `c37bf80de0d947cc860475fbc0234f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:03.698886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ebcdcd75-84a2-40cd-8a87-46906b73c18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:03.710626 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ec372-a63d-4b29-974e-5c8fcff7c74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:03.711240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ec372-a63d-4b29-974e-5c8fcff7c74f admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.711521 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ec372-a63d-4b29-974e-5c8fcff7c74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.711796 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ec372-a63d-4b29-974e-5c8fcff7c74f admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.712456 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ec372-a63d-4b29-974e-5c8fcff7c74f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:03.714429 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ec372-a63d-4b29-974e-5c8fcff7c74f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:03.761509 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1393/2792] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:40:03.772978 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdcd75-84a2-40cd-8a87-46906b73c18e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:03.780116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ebcdcd75-84a2-40cd-8a87-46906b73c18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:03.833043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdcd75-84a2-40cd-8a87-46906b73c18e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:03.836799 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9652398-1c05-46df-91ef-5f52c7b007f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:03.837343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9652398-1c05-46df-91ef-5f52c7b007f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.837620 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9652398-1c05-46df-91ef-5f52c7b007f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.838335 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9652398-1c05-46df-91ef-5f52c7b007f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.846807 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9652398-1c05-46df-91ef-5f52c7b007f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:03.848226 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9652398-1c05-46df-91ef-5f52c7b007f9 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:03.857978 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1394/2793] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:40:03.907639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1400/2794] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:40:03 2022] POST /identity/v3/users => generated 285 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:40:03.912428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9652398-1c05-46df-91ef-5f52c7b007f9 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:03.924661 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9652398-1c05-46df-91ef-5f52c7b007f9 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:03.929633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801641c-8421-416a-b9c5-57ea1d4a75a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:03.930380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801641c-8421-416a-b9c5-57ea1d4a75a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.931825 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801641c-8421-416a-b9c5-57ea1d4a75a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.931825 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801641c-8421-416a-b9c5-57ea1d4a75a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.931825 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801641c-8421-416a-b9c5-57ea1d4a75a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:03.933309 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801641c-8421-416a-b9c5-57ea1d4a75a7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:03.943817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1395/2795] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:03.947993 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ec372-a63d-4b29-974e-5c8fcff7c74f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:03.961479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ec372-a63d-4b29-974e-5c8fcff7c74f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:03.969324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d95e37-1180-4ad5-b8d6-9b24fc323903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:03.970983 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d95e37-1180-4ad5-b8d6-9b24fc323903 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:03.971422 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d95e37-1180-4ad5-b8d6-9b24fc323903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:03.971910 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d95e37-1180-4ad5-b8d6-9b24fc323903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:03.973629 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d95e37-1180-4ad5-b8d6-9b24fc323903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:03.975536 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d95e37-1180-4ad5-b8d6-9b24fc323903 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:03.986543 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1401/2796] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:03.990584 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801641c-8421-416a-b9c5-57ea1d4a75a7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:04.001907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801641c-8421-416a-b9c5-57ea1d4a75a7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:04.006802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7878b-6d96-41d8-a9f4-3c873cd6545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:04.007454 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7878b-6d96-41d8-a9f4-3c873cd6545b admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:04.007733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7878b-6d96-41d8-a9f4-3c873cd6545b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:04.008001 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7878b-6d96-41d8-a9f4-3c873cd6545b admin admin] PATH_INFO: `/v3/projects/4b0fff6bd6b74db28209c0ba261d9f33/users/d22aae53e038497bb01ede7c95d9570a/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:04.022771 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:04.029185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7878b-6d96-41d8-a9f4-3c873cd6545b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0fff6bd6b74db28209c0ba261d9f33, user_id=d22aae53e038497bb01ede7c95d9570a, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:04.033949 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7878b-6d96-41d8-a9f4-3c873cd6545b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:04.133796 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1396/2797] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:40:03 2022] PUT /identity/v3/projects/4b0fff6bd6b74db28209c0ba261d9f33/users/d22aae53e038497bb01ede7c95d9570a/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:04.138743 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d8d65-f506-48cc-af98-4bff0207d770 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:04.139056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d8d65-f506-48cc-af98-4bff0207d770 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:04.139350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d8d65-f506-48cc-af98-4bff0207d770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:04.159696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8b5d8d65-f506-48cc-af98-4bff0207d770 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:04.160937 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8b5d8d65-f506-48cc-af98-4bff0207d770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:04.219379 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1402/2798] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:04.229042 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7878b-6d96-41d8-a9f4-3c873cd6545b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:04.230782 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-48c7878b-6d96-41d8-a9f4-3c873cd6545b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:04.289649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7878b-6d96-41d8-a9f4-3c873cd6545b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:04.293408 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc3db2-7f56-48e7-b7d0-61f429e6b726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:04.294049 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc3db2-7f56-48e7-b7d0-61f429e6b726 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:04.294323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc3db2-7f56-48e7-b7d0-61f429e6b726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:04.294595 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc3db2-7f56-48e7-b7d0-61f429e6b726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:04.304670 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc3db2-7f56-48e7-b7d0-61f429e6b726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:04.306142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc3db2-7f56-48e7-b7d0-61f429e6b726 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:04.315683 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1397/2799] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:40:04.501357 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d8d65-f506-48cc-af98-4bff0207d770 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:04.502751 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8b5d8d65-f506-48cc-af98-4bff0207d770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:04.514862 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d8d65-f506-48cc-af98-4bff0207d770 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:04.519311 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd5a00-dfbf-42fe-8d15-b2b9116a5dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:04.519921 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd5a00-dfbf-42fe-8d15-b2b9116a5dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:04.520432 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd5a00-dfbf-42fe-8d15-b2b9116a5dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:04.520558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd5a00-dfbf-42fe-8d15-b2b9116a5dc4 admin admin] PATH_INFO: `/v3/users/a234356216184b1daf65042764730216` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:04.521655 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd5a00-dfbf-42fe-8d15-b2b9116a5dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a234356216184b1daf65042764730216)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:04.523584 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd5a00-dfbf-42fe-8d15-b2b9116a5dc4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:04.809433 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-84dd5a00-dfbf-42fe-8d15-b2b9116a5dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a234356216184b1daf65042764730216'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:04.823016 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-84dd5a00-dfbf-42fe-8d15-b2b9116a5dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a234356216184b1daf65042764730216'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:04.831607 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-84dd5a00-dfbf-42fe-8d15-b2b9116a5dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a234356216184b1daf65042764730216'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:04.832318 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-84dd5a00-dfbf-42fe-8d15-b2b9116a5dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a234356216184b1daf65042764730216'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:04.978689 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-84dd5a00-dfbf-42fe-8d15-b2b9116a5dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a234356216184b1daf65042764730216'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:04.985330 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1403/2800] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:40:04 2022] DELETE /identity/v3/users/a234356216184b1daf65042764730216 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:04.990137 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7687-9c3e-47e6-9ef4-11b4011f53cc None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:04.990673 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7687-9c3e-47e6-9ef4-11b4011f53cc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:04.990833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7687-9c3e-47e6-9ef4-11b4011f53cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:05.013650 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2d5b7687-9c3e-47e6-9ef4-11b4011f53cc None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:05.014899 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2d5b7687-9c3e-47e6-9ef4-11b4011f53cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:05.024001 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:05.069340 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:05.074055 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1398/2801] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:05.085813 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd5a00-dfbf-42fe-8d15-b2b9116a5dc4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:05.087238 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-84dd5a00-dfbf-42fe-8d15-b2b9116a5dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:05.147082 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd5a00-dfbf-42fe-8d15-b2b9116a5dc4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:05.150950 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d6a38-a15b-42c9-8f25-96a30f4a1321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:05.151620 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d6a38-a15b-42c9-8f25-96a30f4a1321 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:05.151963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d6a38-a15b-42c9-8f25-96a30f4a1321 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:05.152298 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d6a38-a15b-42c9-8f25-96a30f4a1321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:05.162171 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d6a38-a15b-42c9-8f25-96a30f4a1321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:05.163772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d6a38-a15b-42c9-8f25-96a30f4a1321 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:05.173697 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1404/2802] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:40:06.286990 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7687-9c3e-47e6-9ef4-11b4011f53cc None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:06.288506 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2d5b7687-9c3e-47e6-9ef4-11b4011f53cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:06.300403 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7687-9c3e-47e6-9ef4-11b4011f53cc None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:06.304887 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc9d1c-7015-4dfe-9231-e65fbb902469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:06.305516 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc9d1c-7015-4dfe-9231-e65fbb902469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:06.305820 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc9d1c-7015-4dfe-9231-e65fbb902469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:06.306092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc9d1c-7015-4dfe-9231-e65fbb902469 admin admin] PATH_INFO: `/v3/projects/5617e9563453469b9cf327421bf18626` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:06.307221 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc9d1c-7015-4dfe-9231-e65fbb902469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5617e9563453469b9cf327421bf18626)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:06.309119 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc9d1c-7015-4dfe-9231-e65fbb902469 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:06.469927 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-bbbc9d1c-7015-4dfe-9231-e65fbb902469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5617e9563453469b9cf327421bf18626', 'request_id': 'req-bbbc9d1c-7015-4dfe-9231-e65fbb902469'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:06.488853 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c965a-c46c-426f-860b-68ca2f0f6044 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:06.489377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c965a-c46c-426f-860b-68ca2f0f6044 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:06.489528 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c965a-c46c-426f-860b-68ca2f0f6044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:06.535407 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-023c965a-c46c-426f-860b-68ca2f0f6044 None None] MFA Rules not processed for user `d22aae53e038497bb01ede7c95d9570a`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:06.538229 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-023c965a-c46c-426f-860b-68ca2f0f6044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:06.556540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-bbbc9d1c-7015-4dfe-9231-e65fbb902469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5617e9563453469b9cf327421bf18626', 'request_id': 'req-bbbc9d1c-7015-4dfe-9231-e65fbb902469'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:06.565435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-bbbc9d1c-7015-4dfe-9231-e65fbb902469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5617e9563453469b9cf327421bf18626', 'request_id': 'req-bbbc9d1c-7015-4dfe-9231-e65fbb902469'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:06.584879 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-bbbc9d1c-7015-4dfe-9231-e65fbb902469 admin admin] The token cache is being invalidate because project 5617e9563453469b9cf327421bf18626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:40:06.585330 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-bbbc9d1c-7015-4dfe-9231-e65fbb902469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:06.586095 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-bbbc9d1c-7015-4dfe-9231-e65fbb902469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:06.590878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1399/2803] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:40:06 2022] DELETE /identity/v3/projects/5617e9563453469b9cf327421bf18626 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:06.591816 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc9d1c-7015-4dfe-9231-e65fbb902469 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:06.593326 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bbbc9d1c-7015-4dfe-9231-e65fbb902469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:06.629789 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1405/2804] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:06.641527 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c965a-c46c-426f-860b-68ca2f0f6044 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:06.642218 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-023c965a-c46c-426f-860b-68ca2f0f6044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:06.751218 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc9d1c-7015-4dfe-9231-e65fbb902469 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:06.751456 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c965a-c46c-426f-860b-68ca2f0f6044 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:06.754880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c19c6-c8f6-4076-8fb5-fa888af8438d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:06.755493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c19c6-c8f6-4076-8fb5-fa888af8438d service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:06.755775 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c19c6-c8f6-4076-8fb5-fa888af8438d service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:06.756045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42807f6-b149-4570-aa1f-57f46996ee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:06.756170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c19c6-c8f6-4076-8fb5-fa888af8438d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:06.756732 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42807f6-b149-4570-aa1f-57f46996ee99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:06.757022 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42807f6-b149-4570-aa1f-57f46996ee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:06.757319 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42807f6-b149-4570-aa1f-57f46996ee99 admin admin] PATH_INFO: `/v3/users/a76501754f8b4149aa24e2b4de8c1c24` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:06.758560 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42807f6-b149-4570-aa1f-57f46996ee99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76501754f8b4149aa24e2b4de8c1c24)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:06.760598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42807f6-b149-4570-aa1f-57f46996ee99 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:06.765322 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c19c6-c8f6-4076-8fb5-fa888af8438d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:06.767387 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c19c6-c8f6-4076-8fb5-fa888af8438d service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:06.777010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1406/2805] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:40:07.009065 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:07.015107 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b42807f6-b149-4570-aa1f-57f46996ee99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76501754f8b4149aa24e2b4de8c1c24'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:07.026690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b42807f6-b149-4570-aa1f-57f46996ee99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76501754f8b4149aa24e2b4de8c1c24'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:07.033786 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b42807f6-b149-4570-aa1f-57f46996ee99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76501754f8b4149aa24e2b4de8c1c24'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:07.037567 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b42807f6-b149-4570-aa1f-57f46996ee99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76501754f8b4149aa24e2b4de8c1c24'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:07.138940 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b42807f6-b149-4570-aa1f-57f46996ee99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76501754f8b4149aa24e2b4de8c1c24'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:07.145206 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1400/2806] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:40:06 2022] DELETE /identity/v3/users/a76501754f8b4149aa24e2b4de8c1c24 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:07.598693 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c19c6-c8f6-4076-8fb5-fa888af8438d service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:07.616728 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c19c6-c8f6-4076-8fb5-fa888af8438d service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:07.650192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:07.680864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37682e36-8422-469d-a958-9b0a6f6e2d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:07.681505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37682e36-8422-469d-a958-9b0a6f6e2d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:07.681814 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37682e36-8422-469d-a958-9b0a6f6e2d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:07.682089 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37682e36-8422-469d-a958-9b0a6f6e2d2e admin admin] PATH_INFO: `/v3/projects/f18bcf64497e4e4c94226677ca0d39fc` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:07.683236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37682e36-8422-469d-a958-9b0a6f6e2d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f18bcf64497e4e4c94226677ca0d39fc)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:07.685186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37682e36-8422-469d-a958-9b0a6f6e2d2e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:07.802922 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-37682e36-8422-469d-a958-9b0a6f6e2d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18bcf64497e4e4c94226677ca0d39fc', 'request_id': 'req-37682e36-8422-469d-a958-9b0a6f6e2d2e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:07.892819 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-37682e36-8422-469d-a958-9b0a6f6e2d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18bcf64497e4e4c94226677ca0d39fc', 'request_id': 'req-37682e36-8422-469d-a958-9b0a6f6e2d2e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:07.899477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-37682e36-8422-469d-a958-9b0a6f6e2d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18bcf64497e4e4c94226677ca0d39fc', 'request_id': 'req-37682e36-8422-469d-a958-9b0a6f6e2d2e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:07.911279 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-37682e36-8422-469d-a958-9b0a6f6e2d2e admin admin] The token cache is being invalidate because project f18bcf64497e4e4c94226677ca0d39fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:40:07.911565 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-37682e36-8422-469d-a958-9b0a6f6e2d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:07.912186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-37682e36-8422-469d-a958-9b0a6f6e2d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:07.913661 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1407/2807] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:40:07 2022] DELETE /identity/v3/projects/f18bcf64497e4e4c94226677ca0d39fc => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:07.918652 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe133570-f7cc-4c08-9b0a-e0a020a038e9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:07.919122 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe133570-f7cc-4c08-9b0a-e0a020a038e9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:07.919219 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe133570-f7cc-4c08-9b0a-e0a020a038e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:07.939178 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fe133570-f7cc-4c08-9b0a-e0a020a038e9 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:07.940474 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fe133570-f7cc-4c08-9b0a-e0a020a038e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:08.000309 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1401/2808] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:08.008186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c463-b2d2-4cb2-9e8f-bc0dcada7667 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:08.008473 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c463-b2d2-4cb2-9e8f-bc0dcada7667 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:08.008747 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c463-b2d2-4cb2-9e8f-bc0dcada7667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:08.029171 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8772c463-b2d2-4cb2-9e8f-bc0dcada7667 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:08.030379 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8772c463-b2d2-4cb2-9e8f-bc0dcada7667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:08.038490 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1408/2809] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:08.042752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe133570-f7cc-4c08-9b0a-e0a020a038e9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:08.052291 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe133570-f7cc-4c08-9b0a-e0a020a038e9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:08.057918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9bcf1-ecdc-415f-81c9-5c43ce2ddc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:08.057918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9bcf1-ecdc-415f-81c9-5c43ce2ddc08 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:08.057918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9bcf1-ecdc-415f-81c9-5c43ce2ddc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:08.058327 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9bcf1-ecdc-415f-81c9-5c43ce2ddc08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:08.058972 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9bcf1-ecdc-415f-81c9-5c43ce2ddc08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:40:08.059276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9bcf1-ecdc-415f-81c9-5c43ce2ddc08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:08.060895 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9bcf1-ecdc-415f-81c9-5c43ce2ddc08 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:08.072965 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1402/2810] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:40:08.077221 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772c463-b2d2-4cb2-9e8f-bc0dcada7667 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:08.086989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772c463-b2d2-4cb2-9e8f-bc0dcada7667 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:08.091658 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae03fd-62ea-4855-9a63-ef02ec9e486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:08.092243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae03fd-62ea-4855-9a63-ef02ec9e486c admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:08.092587 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae03fd-62ea-4855-9a63-ef02ec9e486c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:08.092893 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae03fd-62ea-4855-9a63-ef02ec9e486c admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:08.093542 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae03fd-62ea-4855-9a63-ef02ec9e486c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:08.095664 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae03fd-62ea-4855-9a63-ef02ec9e486c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:08.202713 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1409/2811] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:40:08 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:40:08.207907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9bcf1-ecdc-415f-81c9-5c43ce2ddc08 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:08.217848 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9bcf1-ecdc-415f-81c9-5c43ce2ddc08 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:08.274003 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e86ef-b358-455e-a2dd-8963a5a89459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:08.274686 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e86ef-b358-455e-a2dd-8963a5a89459 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:08.274966 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e86ef-b358-455e-a2dd-8963a5a89459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:08.275236 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e86ef-b358-455e-a2dd-8963a5a89459 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:08.275892 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e86ef-b358-455e-a2dd-8963a5a89459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:08.277811 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e86ef-b358-455e-a2dd-8963a5a89459 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:08.354348 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1403/2812] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:40:08 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:40:08.358477 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae03fd-62ea-4855-9a63-ef02ec9e486c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:08.369204 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae03fd-62ea-4855-9a63-ef02ec9e486c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:08.373866 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5f4f7-c210-4755-809e-e08ae7a69421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:08.374450 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5f4f7-c210-4755-809e-e08ae7a69421 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:08.375343 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5f4f7-c210-4755-809e-e08ae7a69421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:08.375636 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5f4f7-c210-4755-809e-e08ae7a69421 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:08.376325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5f4f7-c210-4755-809e-e08ae7a69421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:08.377981 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5f4f7-c210-4755-809e-e08ae7a69421 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:08.388053 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1410/2813] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:08.391965 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e86ef-b358-455e-a2dd-8963a5a89459 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:08.402338 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e86ef-b358-455e-a2dd-8963a5a89459 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:08.407300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092986b1-4260-4c4b-bff2-47d178965a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:08.411506 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092986b1-4260-4c4b-bff2-47d178965a06 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:08.411506 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092986b1-4260-4c4b-bff2-47d178965a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:08.411506 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092986b1-4260-4c4b-bff2-47d178965a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:08.411506 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092986b1-4260-4c4b-bff2-47d178965a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:08.411506 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092986b1-4260-4c4b-bff2-47d178965a06 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:08.421200 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1404/2814] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:08.425885 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5f4f7-c210-4755-809e-e08ae7a69421 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:08.435847 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5f4f7-c210-4755-809e-e08ae7a69421 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:08.441186 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a0433-09e0-47e8-a369-78ad68cf8c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:08.441857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a0433-09e0-47e8-a369-78ad68cf8c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:08.442135 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a0433-09e0-47e8-a369-78ad68cf8c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:08.442406 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a0433-09e0-47e8-a369-78ad68cf8c05 admin admin] PATH_INFO: `/v3/projects/5cb09c2461d540c389d29f759daa43c8/users/3d8063f4957c445dad5f62ab8024c72f/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:08.456952 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a0433-09e0-47e8-a369-78ad68cf8c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cb09c2461d540c389d29f759daa43c8, user_id=3d8063f4957c445dad5f62ab8024c72f, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:08.459716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a0433-09e0-47e8-a369-78ad68cf8c05 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:08.533682 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1411/2815] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:40:08 2022] PUT /identity/v3/projects/5cb09c2461d540c389d29f759daa43c8/users/3d8063f4957c445dad5f62ab8024c72f/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:08.544098 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844074d0-2dde-46fe-9620-255c8c145fb4 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:08.544382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844074d0-2dde-46fe-9620-255c8c145fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:08.544655 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844074d0-2dde-46fe-9620-255c8c145fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:08.573687 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-844074d0-2dde-46fe-9620-255c8c145fb4 None None] MFA Rules not processed for user `3d8063f4957c445dad5f62ab8024c72f`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:08.574929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-844074d0-2dde-46fe-9620-255c8c145fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:08.584210 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:08.620255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a553837-13b3-48c9-b908-e97ba2e438d2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:08.620853 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a553837-13b3-48c9-b908-e97ba2e438d2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:08.620853 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a553837-13b3-48c9-b908-e97ba2e438d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:08.642457 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6a553837-13b3-48c9-b908-e97ba2e438d2 None None] MFA Rules not processed for user `d22aae53e038497bb01ede7c95d9570a`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:08.643164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1405/2816] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:08.643818 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6a553837-13b3-48c9-b908-e97ba2e438d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:08.660092 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844074d0-2dde-46fe-9620-255c8c145fb4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:08.661698 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-844074d0-2dde-46fe-9620-255c8c145fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:08.716688 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1412/2817] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:40:08.725004 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844074d0-2dde-46fe-9620-255c8c145fb4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:08.728973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b867329-5a55-4d4b-988c-29cfc2e36d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:08.729302 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b867329-5a55-4d4b-988c-29cfc2e36d1b service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:08.729582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b867329-5a55-4d4b-988c-29cfc2e36d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:08.729918 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b867329-5a55-4d4b-988c-29cfc2e36d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:08.739134 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b867329-5a55-4d4b-988c-29cfc2e36d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:08.740709 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b867329-5a55-4d4b-988c-29cfc2e36d1b service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:08.750805 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1406/2818] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:40:08.774637 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a553837-13b3-48c9-b908-e97ba2e438d2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:08.779760 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:08.843358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a553837-13b3-48c9-b908-e97ba2e438d2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:08.850293 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807e626-3f95-4064-8291-231839f7611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:08.850951 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807e626-3f95-4064-8291-231839f7611c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:08.851201 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807e626-3f95-4064-8291-231839f7611c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:08.851469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807e626-3f95-4064-8291-231839f7611c admin admin] PATH_INFO: `/v3/users/3d8063f4957c445dad5f62ab8024c72f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:08.853585 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807e626-3f95-4064-8291-231839f7611c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d8063f4957c445dad5f62ab8024c72f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:08.857599 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807e626-3f95-4064-8291-231839f7611c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:09.067654 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1807e626-3f95-4064-8291-231839f7611c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d8063f4957c445dad5f62ab8024c72f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:09.080333 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1807e626-3f95-4064-8291-231839f7611c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d8063f4957c445dad5f62ab8024c72f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:09.087271 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1807e626-3f95-4064-8291-231839f7611c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d8063f4957c445dad5f62ab8024c72f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:09.088040 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1807e626-3f95-4064-8291-231839f7611c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d8063f4957c445dad5f62ab8024c72f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:09.188962 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1807e626-3f95-4064-8291-231839f7611c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d8063f4957c445dad5f62ab8024c72f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:09.195603 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1413/2819] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:40:08 2022] DELETE /identity/v3/users/3d8063f4957c445dad5f62ab8024c72f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:09.200242 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f5c76-a79f-4a89-ae3d-a8ee34181365 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:09.200752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f5c76-a79f-4a89-ae3d-a8ee34181365 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:09.201600 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f5c76-a79f-4a89-ae3d-a8ee34181365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:09.221878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b97f5c76-a79f-4a89-ae3d-a8ee34181365 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:09.228542 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b97f5c76-a79f-4a89-ae3d-a8ee34181365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:09.286417 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1407/2820] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:09.296171 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807e626-3f95-4064-8291-231839f7611c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:09.297699 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1807e626-3f95-4064-8291-231839f7611c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:09.354300 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807e626-3f95-4064-8291-231839f7611c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:09.357832 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe81a3-cc92-453c-aada-264db1481739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:09.358402 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe81a3-cc92-453c-aada-264db1481739 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:09.358678 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe81a3-cc92-453c-aada-264db1481739 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:09.358994 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe81a3-cc92-453c-aada-264db1481739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:09.367939 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe81a3-cc92-453c-aada-264db1481739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:09.369363 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe81a3-cc92-453c-aada-264db1481739 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:09.379195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1414/2821] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:40:09.832644 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f5c76-a79f-4a89-ae3d-a8ee34181365 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:09.834388 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b97f5c76-a79f-4a89-ae3d-a8ee34181365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:09.846100 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f5c76-a79f-4a89-ae3d-a8ee34181365 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:09.850719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8cba6-7d16-4d03-909f-04d575d76bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:09.851350 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8cba6-7d16-4d03-909f-04d575d76bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:09.851629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8cba6-7d16-4d03-909f-04d575d76bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:09.851903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8cba6-7d16-4d03-909f-04d575d76bd0 admin admin] PATH_INFO: `/v3/projects/5cb09c2461d540c389d29f759daa43c8` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:09.853023 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8cba6-7d16-4d03-909f-04d575d76bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cb09c2461d540c389d29f759daa43c8)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:09.854937 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8cba6-7d16-4d03-909f-04d575d76bd0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:09.986889 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5ca8cba6-7d16-4d03-909f-04d575d76bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cb09c2461d540c389d29f759daa43c8', 'request_id': 'req-5ca8cba6-7d16-4d03-909f-04d575d76bd0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:09.988723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:10.071164 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5ca8cba6-7d16-4d03-909f-04d575d76bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cb09c2461d540c389d29f759daa43c8', 'request_id': 'req-5ca8cba6-7d16-4d03-909f-04d575d76bd0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:10.079066 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5ca8cba6-7d16-4d03-909f-04d575d76bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cb09c2461d540c389d29f759daa43c8', 'request_id': 'req-5ca8cba6-7d16-4d03-909f-04d575d76bd0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:10.091258 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5ca8cba6-7d16-4d03-909f-04d575d76bd0 admin admin] The token cache is being invalidate because project 5cb09c2461d540c389d29f759daa43c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:40:10.091550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5ca8cba6-7d16-4d03-909f-04d575d76bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:10.092212 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5ca8cba6-7d16-4d03-909f-04d575d76bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:10.094102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1408/2822] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:40:09 2022] DELETE /identity/v3/projects/5cb09c2461d540c389d29f759daa43c8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:10.099001 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4710-d035-42ce-8598-22297b490306 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:10.099492 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4710-d035-42ce-8598-22297b490306 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:10.099601 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4710-d035-42ce-8598-22297b490306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:10.121170 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-337c4710-d035-42ce-8598-22297b490306 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:10.122469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-337c4710-d035-42ce-8598-22297b490306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:10.145045 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:10.186570 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1415/2823] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:10.249548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c3212-5b0d-4e2c-bbe7-2db89e8b2fb3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:10.250802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c3212-5b0d-4e2c-bbe7-2db89e8b2fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:10.250802 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c3212-5b0d-4e2c-bbe7-2db89e8b2fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:10.271147 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-423c3212-5b0d-4e2c-bbe7-2db89e8b2fb3 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:10.272343 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-423c3212-5b0d-4e2c-bbe7-2db89e8b2fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:10.281854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1409/2824] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:10.285833 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4710-d035-42ce-8598-22297b490306 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:10.295442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4710-d035-42ce-8598-22297b490306 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:10.300677 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa13106-e7b6-43d9-baef-6724fd865dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:10.301266 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa13106-e7b6-43d9-baef-6724fd865dec admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:10.301543 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa13106-e7b6-43d9-baef-6724fd865dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:10.301864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa13106-e7b6-43d9-baef-6724fd865dec admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:10.302503 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa13106-e7b6-43d9-baef-6724fd865dec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:40:10.302803 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa13106-e7b6-43d9-baef-6724fd865dec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:10.304392 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa13106-e7b6-43d9-baef-6724fd865dec admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:10.315696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1416/2825] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:40:10.320346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c3212-5b0d-4e2c-bbe7-2db89e8b2fb3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:10.328669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c3212-5b0d-4e2c-bbe7-2db89e8b2fb3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:10.333394 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2904351-def7-4c46-99cf-d768d2a4258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:10.334018 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2904351-def7-4c46-99cf-d768d2a4258e admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:10.334296 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2904351-def7-4c46-99cf-d768d2a4258e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:10.334567 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2904351-def7-4c46-99cf-d768d2a4258e admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:10.335202 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2904351-def7-4c46-99cf-d768d2a4258e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:10.337087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2904351-def7-4c46-99cf-d768d2a4258e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:10.467506 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1410/2826] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:40:10 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:40:10.472208 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa13106-e7b6-43d9-baef-6724fd865dec admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:10.482097 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa13106-e7b6-43d9-baef-6724fd865dec admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:10.542630 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2face65-f20b-4213-a082-2015b60ad8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:10.543236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2face65-f20b-4213-a082-2015b60ad8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:10.543548 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2face65-f20b-4213-a082-2015b60ad8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:10.543852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2face65-f20b-4213-a082-2015b60ad8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:10.544681 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2face65-f20b-4213-a082-2015b60ad8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:10.547380 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2face65-f20b-4213-a082-2015b60ad8a1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:10.636804 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1417/2827] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:40:10 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:40:10.641844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2904351-def7-4c46-99cf-d768d2a4258e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:10.652074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2904351-def7-4c46-99cf-d768d2a4258e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:10.657555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2a391-89a4-4721-9cf6-13fe9a8a1d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:10.658206 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2a391-89a4-4721-9cf6-13fe9a8a1d2f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:10.658653 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2a391-89a4-4721-9cf6-13fe9a8a1d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:10.658929 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2a391-89a4-4721-9cf6-13fe9a8a1d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:10.659572 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2a391-89a4-4721-9cf6-13fe9a8a1d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:10.661159 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2a391-89a4-4721-9cf6-13fe9a8a1d2f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:10.671526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1411/2828] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:40:10.677826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2face65-f20b-4213-a082-2015b60ad8a1 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:10.687902 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2face65-f20b-4213-a082-2015b60ad8a1 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:10.692820 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bffadb-95cc-4ffa-8cc6-74f186694a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:10.693435 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bffadb-95cc-4ffa-8cc6-74f186694a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:10.693710 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bffadb-95cc-4ffa-8cc6-74f186694a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:10.694021 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bffadb-95cc-4ffa-8cc6-74f186694a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:10.694681 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bffadb-95cc-4ffa-8cc6-74f186694a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:10.696350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bffadb-95cc-4ffa-8cc6-74f186694a1c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:10.707294 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1418/2829] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:10.712192 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2a391-89a4-4721-9cf6-13fe9a8a1d2f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:10.722833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2a391-89a4-4721-9cf6-13fe9a8a1d2f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:10.727446 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f604b-fcac-4b95-98a5-57d03614d0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:10.728074 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f604b-fcac-4b95-98a5-57d03614d0c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:10.728349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f604b-fcac-4b95-98a5-57d03614d0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:10.728625 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f604b-fcac-4b95-98a5-57d03614d0c7 admin admin] PATH_INFO: `/v3/projects/d86bc6fab38a400c93822ba370ecf77b/users/2c37dc3f640f4c6ea3f22e708e4cdcbc/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:10.743034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f604b-fcac-4b95-98a5-57d03614d0c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86bc6fab38a400c93822ba370ecf77b, user_id=2c37dc3f640f4c6ea3f22e708e4cdcbc, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:10.745680 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f604b-fcac-4b95-98a5-57d03614d0c7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:10.841082 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1412/2830] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:40:10 2022] PUT /identity/v3/projects/d86bc6fab38a400c93822ba370ecf77b/users/2c37dc3f640f4c6ea3f22e708e4cdcbc/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:10.851259 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533fa01-e4e1-4948-9227-92d00be0f54c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:10.851560 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533fa01-e4e1-4948-9227-92d00be0f54c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:10.851834 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533fa01-e4e1-4948-9227-92d00be0f54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:10.879608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f533fa01-e4e1-4948-9227-92d00be0f54c None None] MFA Rules not processed for user `2c37dc3f640f4c6ea3f22e708e4cdcbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:10.880948 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f533fa01-e4e1-4948-9227-92d00be0f54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:10.945710 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1419/2831] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:10.957299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f604b-fcac-4b95-98a5-57d03614d0c7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:10.958996 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b17f604b-fcac-4b95-98a5-57d03614d0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:11.016499 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f604b-fcac-4b95-98a5-57d03614d0c7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:11.020170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d34656-7cb5-4adb-a178-679161fe4ddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:11.020766 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d34656-7cb5-4adb-a178-679161fe4ddf service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:11.021038 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d34656-7cb5-4adb-a178-679161fe4ddf service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:11.021314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d34656-7cb5-4adb-a178-679161fe4ddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:11.029833 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d34656-7cb5-4adb-a178-679161fe4ddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:11.031573 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d34656-7cb5-4adb-a178-679161fe4ddf service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:11.040416 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1413/2832] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:40:20.942741 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=87,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:21.037878 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=59 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:27.882349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39765b-022e-4400-9320-7ee0a367f690 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:27.882850 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39765b-022e-4400-9320-7ee0a367f690 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:27.882963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39765b-022e-4400-9320-7ee0a367f690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:27.902056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7b39765b-022e-4400-9320-7ee0a367f690 None None] MFA Rules not processed for user `d22aae53e038497bb01ede7c95d9570a`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:27.903326 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7b39765b-022e-4400-9320-7ee0a367f690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:27.961078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1420/2833] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:40:28.196991 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d34656-7cb5-4adb-a178-679161fe4ddf service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:28.198505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d1d34656-7cb5-4adb-a178-679161fe4ddf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:28.259124 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d34656-7cb5-4adb-a178-679161fe4ddf service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:28.263367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3daf28-0815-4562-a693-ebbc06b0bc9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:28.264155 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3daf28-0815-4562-a693-ebbc06b0bc9d service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:28.264467 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3daf28-0815-4562-a693-ebbc06b0bc9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:28.264840 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3daf28-0815-4562-a693-ebbc06b0bc9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:28.266765 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9b3daf28-0815-4562-a693-ebbc06b0bc9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:28.276921 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3daf28-0815-4562-a693-ebbc06b0bc9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:28.278385 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3daf28-0815-4562-a693-ebbc06b0bc9d service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:28.286862 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1414/2834] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:40:28.604072 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39765b-022e-4400-9320-7ee0a367f690 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:28.672262 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39765b-022e-4400-9320-7ee0a367f690 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:28.677066 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eded6-a88d-4e49-b3b8-cc4327445a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:28.677727 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eded6-a88d-4e49-b3b8-cc4327445a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:28.678033 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eded6-a88d-4e49-b3b8-cc4327445a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:28.678305 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eded6-a88d-4e49-b3b8-cc4327445a49 admin admin] PATH_INFO: `/v3/users/2c37dc3f640f4c6ea3f22e708e4cdcbc` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:28.679638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0eded6-a88d-4e49-b3b8-cc4327445a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c37dc3f640f4c6ea3f22e708e4cdcbc)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:28.681604 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0eded6-a88d-4e49-b3b8-cc4327445a49 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:28.960820 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ba0eded6-a88d-4e49-b3b8-cc4327445a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c37dc3f640f4c6ea3f22e708e4cdcbc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:28.975266 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ba0eded6-a88d-4e49-b3b8-cc4327445a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c37dc3f640f4c6ea3f22e708e4cdcbc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:28.981989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ba0eded6-a88d-4e49-b3b8-cc4327445a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c37dc3f640f4c6ea3f22e708e4cdcbc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:28.982696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ba0eded6-a88d-4e49-b3b8-cc4327445a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c37dc3f640f4c6ea3f22e708e4cdcbc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:29.096436 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ba0eded6-a88d-4e49-b3b8-cc4327445a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c37dc3f640f4c6ea3f22e708e4cdcbc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:29.102818 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1421/2835] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:40:28 2022] DELETE /identity/v3/users/2c37dc3f640f4c6ea3f22e708e4cdcbc => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:29.107163 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c40f9-954c-4eb0-a35c-c86b845c9cf4 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:29.107454 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c40f9-954c-4eb0-a35c-c86b845c9cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:29.107775 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c40f9-954c-4eb0-a35c-c86b845c9cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:29.127359 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fe0c40f9-954c-4eb0-a35c-c86b845c9cf4 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:29.128601 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fe0c40f9-954c-4eb0-a35c-c86b845c9cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:29.195658 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1415/2836] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:29.205930 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eded6-a88d-4e49-b3b8-cc4327445a49 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:29.207336 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ba0eded6-a88d-4e49-b3b8-cc4327445a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:29.235240 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:29.264462 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eded6-a88d-4e49-b3b8-cc4327445a49 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:29.268868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a422a-8b42-40ea-9cec-ad56601c9f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:29.269520 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a422a-8b42-40ea-9cec-ad56601c9f75 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:29.269811 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a422a-8b42-40ea-9cec-ad56601c9f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:29.270087 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a422a-8b42-40ea-9cec-ad56601c9f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:29.279775 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a422a-8b42-40ea-9cec-ad56601c9f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:29.281502 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a422a-8b42-40ea-9cec-ad56601c9f75 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:29.290992 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1422/2837] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:40:29.831146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c40f9-954c-4eb0-a35c-c86b845c9cf4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:29.832784 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fe0c40f9-954c-4eb0-a35c-c86b845c9cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:29.847523 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c40f9-954c-4eb0-a35c-c86b845c9cf4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:29.856608 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058999be-025b-4daf-9ef0-3a51fb8390dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:29.856608 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058999be-025b-4daf-9ef0-3a51fb8390dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:29.856608 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058999be-025b-4daf-9ef0-3a51fb8390dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:29.856608 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058999be-025b-4daf-9ef0-3a51fb8390dc admin admin] PATH_INFO: `/v3/projects/d86bc6fab38a400c93822ba370ecf77b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:29.857028 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058999be-025b-4daf-9ef0-3a51fb8390dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d86bc6fab38a400c93822ba370ecf77b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:29.858176 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058999be-025b-4daf-9ef0-3a51fb8390dc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:29.990286 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-058999be-025b-4daf-9ef0-3a51fb8390dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd86bc6fab38a400c93822ba370ecf77b', 'request_id': 'req-058999be-025b-4daf-9ef0-3a51fb8390dc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:30.080185 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a422a-8b42-40ea-9cec-ad56601c9f75 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:30.081303 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-058999be-025b-4daf-9ef0-3a51fb8390dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd86bc6fab38a400c93822ba370ecf77b', 'request_id': 'req-058999be-025b-4daf-9ef0-3a51fb8390dc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:30.081592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7f8a422a-8b42-40ea-9cec-ad56601c9f75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:30.088240 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-058999be-025b-4daf-9ef0-3a51fb8390dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd86bc6fab38a400c93822ba370ecf77b', 'request_id': 'req-058999be-025b-4daf-9ef0-3a51fb8390dc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:30.102681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-058999be-025b-4daf-9ef0-3a51fb8390dc admin admin] The token cache is being invalidate because project d86bc6fab38a400c93822ba370ecf77b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:40:30.102971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-058999be-025b-4daf-9ef0-3a51fb8390dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:30.103617 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-058999be-025b-4daf-9ef0-3a51fb8390dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:30.105353 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1416/2838] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:40:29 2022] DELETE /identity/v3/projects/d86bc6fab38a400c93822ba370ecf77b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:30.110514 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b0915-3217-4f4e-afdc-888710cd511a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:30.110936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b0915-3217-4f4e-afdc-888710cd511a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:30.111367 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b0915-3217-4f4e-afdc-888710cd511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:30.133244 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-946b0915-3217-4f4e-afdc-888710cd511a None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:30.134603 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-946b0915-3217-4f4e-afdc-888710cd511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:30.156269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:30.178202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a422a-8b42-40ea-9cec-ad56601c9f75 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:30.198871 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1417/2839] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:30.207718 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6c615-f9c0-4a45-b927-dfce7f041607 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:30.208005 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6c615-f9c0-4a45-b927-dfce7f041607 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:30.208277 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6c615-f9c0-4a45-b927-dfce7f041607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:30.235826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-73c6c615-f9c0-4a45-b927-dfce7f041607 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:30.235826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-73c6c615-f9c0-4a45-b927-dfce7f041607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:30.238696 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1418/2840] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:40:30.242868 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6c615-f9c0-4a45-b927-dfce7f041607 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:30.248683 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce842a6-7dfc-478f-be42-0b49a666482f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25109eeb1b34b3689b10e3f7c44a6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:30.250004 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce842a6-7dfc-478f-be42-0b49a666482f service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:30.250290 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce842a6-7dfc-478f-be42-0b49a666482f service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:30.250566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce842a6-7dfc-478f-be42-0b49a666482f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:30.252337 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7ce842a6-7dfc-478f-be42-0b49a666482f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:30.252699 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6c615-f9c0-4a45-b927-dfce7f041607 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:30.257827 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf71280-c54c-4083-9728-c20d5a2401ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:30.258411 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf71280-c54c-4083-9728-c20d5a2401ae admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:30.258690 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf71280-c54c-4083-9728-c20d5a2401ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:30.258960 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf71280-c54c-4083-9728-c20d5a2401ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:30.259631 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf71280-c54c-4083-9728-c20d5a2401ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:40:30.259925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf71280-c54c-4083-9728-c20d5a2401ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:30.261542 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf71280-c54c-4083-9728-c20d5a2401ae admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:30.263963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce842a6-7dfc-478f-be42-0b49a666482f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:30.265575 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce842a6-7dfc-478f-be42-0b49a666482f service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:30.272893 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1419/2841] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:40:30.277060 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1423/2842] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:40:30.277217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf71280-c54c-4083-9728-c20d5a2401ae admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:30.288121 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf71280-c54c-4083-9728-c20d5a2401ae admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:30.292976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84450bbb-8412-4a15-8e2a-f09d519a2585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:30.293681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84450bbb-8412-4a15-8e2a-f09d519a2585 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:30.294106 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84450bbb-8412-4a15-8e2a-f09d519a2585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:30.294401 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84450bbb-8412-4a15-8e2a-f09d519a2585 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:30.295051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84450bbb-8412-4a15-8e2a-f09d519a2585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:30.297572 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84450bbb-8412-4a15-8e2a-f09d519a2585 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:30.402756 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1420/2843] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:40:30 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:40:30.407303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce842a6-7dfc-478f-be42-0b49a666482f service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:30.417792 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce842a6-7dfc-478f-be42-0b49a666482f service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:30.456703 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:30.476126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198058f-176c-4640-b1ee-f76ecfe3e650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:30.476756 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198058f-176c-4640-b1ee-f76ecfe3e650 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:30.477039 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198058f-176c-4640-b1ee-f76ecfe3e650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:30.477313 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198058f-176c-4640-b1ee-f76ecfe3e650 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:30.477972 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198058f-176c-4640-b1ee-f76ecfe3e650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:30.479922 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198058f-176c-4640-b1ee-f76ecfe3e650 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:30.648205 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1424/2844] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:40:30 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:40:30.650574 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84450bbb-8412-4a15-8e2a-f09d519a2585 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:30.662201 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84450bbb-8412-4a15-8e2a-f09d519a2585 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:30.666616 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec42d3-1a75-4adc-bff5-da4f9f94bf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:30.667203 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec42d3-1a75-4adc-bff5-da4f9f94bf9d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:30.667478 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec42d3-1a75-4adc-bff5-da4f9f94bf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:30.667746 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec42d3-1a75-4adc-bff5-da4f9f94bf9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:30.668643 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec42d3-1a75-4adc-bff5-da4f9f94bf9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:30.670251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec42d3-1a75-4adc-bff5-da4f9f94bf9d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:30.681905 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1421/2845] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 15:40:30.685859 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198058f-176c-4640-b1ee-f76ecfe3e650 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:30.696852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198058f-176c-4640-b1ee-f76ecfe3e650 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:30.701781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ad0a5-2252-4eb2-af4c-aa220abfcfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:30.702358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ad0a5-2252-4eb2-af4c-aa220abfcfed admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:30.707940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ad0a5-2252-4eb2-af4c-aa220abfcfed admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:30.707940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ad0a5-2252-4eb2-af4c-aa220abfcfed admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:30.707940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ad0a5-2252-4eb2-af4c-aa220abfcfed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:30.707940 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ad0a5-2252-4eb2-af4c-aa220abfcfed admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:30.715243 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1425/2846] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:30.720051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec42d3-1a75-4adc-bff5-da4f9f94bf9d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:30.730282 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec42d3-1a75-4adc-bff5-da4f9f94bf9d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:30.735733 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526826e-aa15-4765-a2a4-c0c062ade9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:30.736380 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526826e-aa15-4765-a2a4-c0c062ade9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:30.736792 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526826e-aa15-4765-a2a4-c0c062ade9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:30.736958 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526826e-aa15-4765-a2a4-c0c062ade9b2 admin admin] PATH_INFO: `/v3/projects/ebba5e549e2d48cea41622881038f06c/users/ada07d07b89844de94f38ef63e753a01/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:30.753669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526826e-aa15-4765-a2a4-c0c062ade9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebba5e549e2d48cea41622881038f06c, user_id=ada07d07b89844de94f38ef63e753a01, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:30.756415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526826e-aa15-4765-a2a4-c0c062ade9b2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:30.870669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1422/2847] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:40:30 2022] PUT /identity/v3/projects/ebba5e549e2d48cea41622881038f06c/users/ada07d07b89844de94f38ef63e753a01/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:30.880950 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502a0a-56e8-4da2-8d80-95fdd70a17e0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:30.881237 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502a0a-56e8-4da2-8d80-95fdd70a17e0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:30.881511 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502a0a-56e8-4da2-8d80-95fdd70a17e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:30.914526 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-66502a0a-56e8-4da2-8d80-95fdd70a17e0 None None] MFA Rules not processed for user `ada07d07b89844de94f38ef63e753a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:30.915883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-66502a0a-56e8-4da2-8d80-95fdd70a17e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:31.003872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1426/2848] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:31.012161 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526826e-aa15-4765-a2a4-c0c062ade9b2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:31.074119 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526826e-aa15-4765-a2a4-c0c062ade9b2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:31.079269 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45429d5-ec69-43e6-8657-30cacf0ef0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:31.079866 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45429d5-ec69-43e6-8657-30cacf0ef0dd admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:31.080144 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45429d5-ec69-43e6-8657-30cacf0ef0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:31.080415 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45429d5-ec69-43e6-8657-30cacf0ef0dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:31.081127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45429d5-ec69-43e6-8657-30cacf0ef0dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:31.083230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45429d5-ec69-43e6-8657-30cacf0ef0dd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:31.224610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1423/2849] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:40:31 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:40:31.228680 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66502a0a-56e8-4da2-8d80-95fdd70a17e0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:31.240892 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66502a0a-56e8-4da2-8d80-95fdd70a17e0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:31.299194 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8496cf1-0fc4-4a97-83b2-8ebd6ee1da31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:31.299798 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8496cf1-0fc4-4a97-83b2-8ebd6ee1da31 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:31.300079 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8496cf1-0fc4-4a97-83b2-8ebd6ee1da31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:31.300349 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8496cf1-0fc4-4a97-83b2-8ebd6ee1da31 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:31.300988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8496cf1-0fc4-4a97-83b2-8ebd6ee1da31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:31.303011 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8496cf1-0fc4-4a97-83b2-8ebd6ee1da31 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:31.429481 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1427/2850] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:40:31 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:40:31.433494 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45429d5-ec69-43e6-8657-30cacf0ef0dd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:31.443559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45429d5-ec69-43e6-8657-30cacf0ef0dd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:31.448043 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81378386-9081-4940-9f7c-a8244567ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:31.448629 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81378386-9081-4940-9f7c-a8244567ae7a admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:31.448928 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81378386-9081-4940-9f7c-a8244567ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:31.449197 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81378386-9081-4940-9f7c-a8244567ae7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:31.449866 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81378386-9081-4940-9f7c-a8244567ae7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:31.451507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81378386-9081-4940-9f7c-a8244567ae7a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:31.461919 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1424/2851] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:31.471470 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8496cf1-0fc4-4a97-83b2-8ebd6ee1da31 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:31.481505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8496cf1-0fc4-4a97-83b2-8ebd6ee1da31 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:31.487223 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d4f76-abac-45a3-817b-a3b4a6e933e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:31.487834 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d4f76-abac-45a3-817b-a3b4a6e933e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:31.488107 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d4f76-abac-45a3-817b-a3b4a6e933e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:31.488376 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d4f76-abac-45a3-817b-a3b4a6e933e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:31.489017 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d4f76-abac-45a3-817b-a3b4a6e933e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:31.490637 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d4f76-abac-45a3-817b-a3b4a6e933e4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:31.501160 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1428/2852] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:31.506102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81378386-9081-4940-9f7c-a8244567ae7a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:31.516087 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81378386-9081-4940-9f7c-a8244567ae7a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:31.520920 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755b70b-6875-44b9-809e-2b67aa0850fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:31.521644 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b70b-6875-44b9-809e-2b67aa0850fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:31.522021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b70b-6875-44b9-809e-2b67aa0850fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:31.522366 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b70b-6875-44b9-809e-2b67aa0850fd admin admin] PATH_INFO: `/v3/projects/373093630ccc49a6a21755d5d0d18cb1/users/2a3913080674454382cdce4b32e88830/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:31.538443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755b70b-6875-44b9-809e-2b67aa0850fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=373093630ccc49a6a21755d5d0d18cb1, user_id=2a3913080674454382cdce4b32e88830, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:31.543498 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755b70b-6875-44b9-809e-2b67aa0850fd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:31.654438 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:31.659826 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1425/2853] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:40:31 2022] PUT /identity/v3/projects/373093630ccc49a6a21755d5d0d18cb1/users/2a3913080674454382cdce4b32e88830/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:40:31.670272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af1d88-299e-4fef-a47f-36ebfd474c0e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:31.670558 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af1d88-299e-4fef-a47f-36ebfd474c0e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:31.670835 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af1d88-299e-4fef-a47f-36ebfd474c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:31.698596 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-28af1d88-299e-4fef-a47f-36ebfd474c0e None None] MFA Rules not processed for user `2a3913080674454382cdce4b32e88830`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:31.699812 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-28af1d88-299e-4fef-a47f-36ebfd474c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:31.713707 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:31.765971 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1429/2854] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:31.770647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755b70b-6875-44b9-809e-2b67aa0850fd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:31.834006 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755b70b-6875-44b9-809e-2b67aa0850fd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:31.839768 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263edf8-78b8-4929-b214-27e8c119ba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:31.840379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263edf8-78b8-4929-b214-27e8c119ba90 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:31.840664 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263edf8-78b8-4929-b214-27e8c119ba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:31.840936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263edf8-78b8-4929-b214-27e8c119ba90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:31.841586 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263edf8-78b8-4929-b214-27e8c119ba90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:31.844146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263edf8-78b8-4929-b214-27e8c119ba90 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:31.958291 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1426/2855] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:40:31 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:40:31.962409 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af1d88-299e-4fef-a47f-36ebfd474c0e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:31.978051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af1d88-299e-4fef-a47f-36ebfd474c0e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:32.048756 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f8bac-a0c7-4d8d-ae4e-6800527fb1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:32.050206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f8bac-a0c7-4d8d-ae4e-6800527fb1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:32.050643 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f8bac-a0c7-4d8d-ae4e-6800527fb1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:32.051302 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f8bac-a0c7-4d8d-ae4e-6800527fb1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:32.052151 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f8bac-a0c7-4d8d-ae4e-6800527fb1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:32.054608 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f8bac-a0c7-4d8d-ae4e-6800527fb1c5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:32.148371 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1430/2856] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:40:31 2022] POST /identity/v3/users => generated 295 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:40:32.152977 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263edf8-78b8-4929-b214-27e8c119ba90 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:32.163728 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263edf8-78b8-4929-b214-27e8c119ba90 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:32.168316 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a58d4b-3fb5-4e8e-80cf-71875fe60386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:32.168911 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a58d4b-3fb5-4e8e-80cf-71875fe60386 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:32.169194 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a58d4b-3fb5-4e8e-80cf-71875fe60386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:32.169556 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a58d4b-3fb5-4e8e-80cf-71875fe60386 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:32.170217 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a58d4b-3fb5-4e8e-80cf-71875fe60386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:32.171823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a58d4b-3fb5-4e8e-80cf-71875fe60386 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:32.182493 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1427/2857] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:32.186614 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f8bac-a0c7-4d8d-ae4e-6800527fb1c5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:32.196869 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f8bac-a0c7-4d8d-ae4e-6800527fb1c5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:32.201505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffdad7-322b-4217-aa3c-84401da6c2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:32.202211 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffdad7-322b-4217-aa3c-84401da6c2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:32.209051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffdad7-322b-4217-aa3c-84401da6c2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:32.209051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffdad7-322b-4217-aa3c-84401da6c2ae admin admin] PATH_INFO: `/v3/projects/5216b56de57c4c27ad67386fbbd9d7f5/users/cb8154d1b2294af2ba0e1b0f07ec0089/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:32.221578 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffdad7-322b-4217-aa3c-84401da6c2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5216b56de57c4c27ad67386fbbd9d7f5, user_id=cb8154d1b2294af2ba0e1b0f07ec0089, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:32.224206 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffdad7-322b-4217-aa3c-84401da6c2ae admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:32.309252 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1431/2858] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:40:32 2022] PUT /identity/v3/projects/5216b56de57c4c27ad67386fbbd9d7f5/users/cb8154d1b2294af2ba0e1b0f07ec0089/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:32.314538 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a58d4b-3fb5-4e8e-80cf-71875fe60386 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:32.331498 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a58d4b-3fb5-4e8e-80cf-71875fe60386 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:32.395854 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049ea3-c95c-4971-9346-d8f12c107570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:32.396464 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049ea3-c95c-4971-9346-d8f12c107570 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:32.396763 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049ea3-c95c-4971-9346-d8f12c107570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:32.397031 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049ea3-c95c-4971-9346-d8f12c107570 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:32.397669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6049ea3-c95c-4971-9346-d8f12c107570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:32.399302 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6049ea3-c95c-4971-9346-d8f12c107570 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:32.409452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1428/2859] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:32.413598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffdad7-322b-4217-aa3c-84401da6c2ae admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:32.424277 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffdad7-322b-4217-aa3c-84401da6c2ae admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:32.428866 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6a6dc-c769-4af0-8ade-f9fb63096e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:32.429503 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6a6dc-c769-4af0-8ade-f9fb63096e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:32.429810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6a6dc-c769-4af0-8ade-f9fb63096e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:32.430093 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6a6dc-c769-4af0-8ade-f9fb63096e7b admin admin] PATH_INFO: `/v3/projects/5216b56de57c4c27ad67386fbbd9d7f5/users/cb8154d1b2294af2ba0e1b0f07ec0089/roles/8d0092d5ad4d467fa020a2b9fbf55ceb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:32.432026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6a6dc-c769-4af0-8ade-f9fb63096e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5216b56de57c4c27ad67386fbbd9d7f5, user_id=cb8154d1b2294af2ba0e1b0f07ec0089, role_id=8d0092d5ad4d467fa020a2b9fbf55ceb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:32.434638 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6a6dc-c769-4af0-8ade-f9fb63096e7b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:32.445662 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1432/2860] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:40:32 2022] PUT /identity/v3/projects/5216b56de57c4c27ad67386fbbd9d7f5/users/cb8154d1b2294af2ba0e1b0f07ec0089/roles/8d0092d5ad4d467fa020a2b9fbf55ceb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:32.456971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6e941-2c45-4d63-87e6-f96257543d46 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:32.457331 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6e941-2c45-4d63-87e6-f96257543d46 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:32.457605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6e941-2c45-4d63-87e6-f96257543d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:32.485247 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c0f6e941-2c45-4d63-87e6-f96257543d46 None None] MFA Rules not processed for user `cb8154d1b2294af2ba0e1b0f07ec0089`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:32.486477 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c0f6e941-2c45-4d63-87e6-f96257543d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:32.551502 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:32.565105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1429/2861] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:32.576615 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6a6dc-c769-4af0-8ade-f9fb63096e7b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:32.578468 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0ab6a6dc-c769-4af0-8ade-f9fb63096e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:32.639260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6a6dc-c769-4af0-8ade-f9fb63096e7b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:32.643054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ad331-10a0-4dc7-988e-3e8568f7e4b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:32.643713 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ad331-10a0-4dc7-988e-3e8568f7e4b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:32.644016 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ad331-10a0-4dc7-988e-3e8568f7e4b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:32.644288 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ad331-10a0-4dc7-988e-3e8568f7e4b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:32.665686 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:32.703725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ad331-10a0-4dc7-988e-3e8568f7e4b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:32.705189 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ad331-10a0-4dc7-988e-3e8568f7e4b6 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:32.715285 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1433/2862] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:40:34.888844 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6e941-2c45-4d63-87e6-f96257543d46 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:34.899207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6e941-2c45-4d63-87e6-f96257543d46 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:34.902823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461207db-677d-45c9-8894-e90f24c617f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:34.903418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461207db-677d-45c9-8894-e90f24c617f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:34.903697 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461207db-677d-45c9-8894-e90f24c617f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:34.903971 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461207db-677d-45c9-8894-e90f24c617f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:34.963816 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461207db-677d-45c9-8894-e90f24c617f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:34.965368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461207db-677d-45c9-8894-e90f24c617f7 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:34.975540 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1430/2863] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:40:36.390472 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ad331-10a0-4dc7-988e-3e8568f7e4b6 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:36.391923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b57ad331-10a0-4dc7-988e-3e8568f7e4b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:36.403145 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ad331-10a0-4dc7-988e-3e8568f7e4b6 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:36.407721 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704a7d6-b863-4932-a37c-c364e26f58a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:36.408314 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704a7d6-b863-4932-a37c-c364e26f58a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:36.408594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704a7d6-b863-4932-a37c-c364e26f58a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:36.408867 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704a7d6-b863-4932-a37c-c364e26f58a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:36.417988 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704a7d6-b863-4932-a37c-c364e26f58a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:36.419452 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704a7d6-b863-4932-a37c-c364e26f58a9 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:36.428805 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1434/2864] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:40:41.190077 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461207db-677d-45c9-8894-e90f24c617f7 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:41.251291 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461207db-677d-45c9-8894-e90f24c617f7 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:41.255775 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b76dc-ef5e-4537-ab35-578fda9d7af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:41.256382 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b76dc-ef5e-4537-ab35-578fda9d7af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:41.256657 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b76dc-ef5e-4537-ab35-578fda9d7af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:41.256925 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b76dc-ef5e-4537-ab35-578fda9d7af3 admin admin] PATH_INFO: `/v3/users/ada07d07b89844de94f38ef63e753a01` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:41.258052 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b76dc-ef5e-4537-ab35-578fda9d7af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada07d07b89844de94f38ef63e753a01)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:41.259933 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b76dc-ef5e-4537-ab35-578fda9d7af3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:41.396528 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704a7d6-b863-4932-a37c-c364e26f58a9 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:41.397963 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c704a7d6-b863-4932-a37c-c364e26f58a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:41.412762 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704a7d6-b863-4932-a37c-c364e26f58a9 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:41.417459 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd692e-8e5e-4646-a8ae-d7c6bff0276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:41.418058 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd692e-8e5e-4646-a8ae-d7c6bff0276b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:41.418362 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd692e-8e5e-4646-a8ae-d7c6bff0276b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:41.418616 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd692e-8e5e-4646-a8ae-d7c6bff0276b admin admin] PATH_INFO: `/v3/users/c37bf80de0d947cc860475fbc0234f65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:41.419800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd692e-8e5e-4646-a8ae-d7c6bff0276b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c37bf80de0d947cc860475fbc0234f65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:41.421769 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd692e-8e5e-4646-a8ae-d7c6bff0276b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:41.438942 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1f3b76dc-ef5e-4537-ab35-578fda9d7af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada07d07b89844de94f38ef63e753a01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:41.454451 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1f3b76dc-ef5e-4537-ab35-578fda9d7af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada07d07b89844de94f38ef63e753a01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:41.461852 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1f3b76dc-ef5e-4537-ab35-578fda9d7af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada07d07b89844de94f38ef63e753a01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:41.462575 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1f3b76dc-ef5e-4537-ab35-578fda9d7af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada07d07b89844de94f38ef63e753a01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:41.544379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1f3b76dc-ef5e-4537-ab35-578fda9d7af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada07d07b89844de94f38ef63e753a01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:41.552381 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1431/2865] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:40:41 2022] DELETE /identity/v3/users/ada07d07b89844de94f38ef63e753a01 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:41.556413 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65569e-ef9f-49e7-a44d-5a5569313e96 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:41.556695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65569e-ef9f-49e7-a44d-5a5569313e96 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:41.556969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65569e-ef9f-49e7-a44d-5a5569313e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:41.583116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ec65569e-ef9f-49e7-a44d-5a5569313e96 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:41.585346 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ec65569e-ef9f-49e7-a44d-5a5569313e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:41.592562 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-becd692e-8e5e-4646-a8ae-d7c6bff0276b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c37bf80de0d947cc860475fbc0234f65'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:41.595614 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:41.607218 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-becd692e-8e5e-4646-a8ae-d7c6bff0276b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c37bf80de0d947cc860475fbc0234f65'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:41.614154 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-becd692e-8e5e-4646-a8ae-d7c6bff0276b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c37bf80de0d947cc860475fbc0234f65'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:41.614864 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-becd692e-8e5e-4646-a8ae-d7c6bff0276b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c37bf80de0d947cc860475fbc0234f65'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:41.648383 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1432/2866] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:40:41.659105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65569e-ef9f-49e7-a44d-5a5569313e96 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:41.660541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ec65569e-ef9f-49e7-a44d-5a5569313e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:41.685339 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-becd692e-8e5e-4646-a8ae-d7c6bff0276b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c37bf80de0d947cc860475fbc0234f65'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:41.691953 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1435/2867] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:40:41 2022] DELETE /identity/v3/users/c37bf80de0d947cc860475fbc0234f65 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:40:41.696416 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09467427-90d4-44d0-bfb5-725c7a5a33e3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:41.696695 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09467427-90d4-44d0-bfb5-725c7a5a33e3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:41.696966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09467427-90d4-44d0-bfb5-725c7a5a33e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:41.716872 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-09467427-90d4-44d0-bfb5-725c7a5a33e3 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:41.718097 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-09467427-90d4-44d0-bfb5-725c7a5a33e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:41.723088 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65569e-ef9f-49e7-a44d-5a5569313e96 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:41.771578 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f454b-415b-4e76-8f68-3f5936dbf27a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:41.772185 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f454b-415b-4e76-8f68-3f5936dbf27a service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:41.772461 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f454b-415b-4e76-8f68-3f5936dbf27a service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:41.772778 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f454b-415b-4e76-8f68-3f5936dbf27a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:41.780403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1436/2868] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:40:41.782734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f454b-415b-4e76-8f68-3f5936dbf27a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:41.784429 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f454b-415b-4e76-8f68-3f5936dbf27a service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:41.790763 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09467427-90d4-44d0-bfb5-725c7a5a33e3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:41.794426 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1433/2869] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:40:41.804157 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09467427-90d4-44d0-bfb5-725c7a5a33e3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:41.807966 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9037b6-d2c9-42dc-934e-005eb22a01d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:41.808715 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9037b6-d2c9-42dc-934e-005eb22a01d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:41.809059 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9037b6-d2c9-42dc-934e-005eb22a01d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:41.809399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9037b6-d2c9-42dc-934e-005eb22a01d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:41.820054 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9037b6-d2c9-42dc-934e-005eb22a01d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:41.821794 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9037b6-d2c9-42dc-934e-005eb22a01d4 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:41.832575 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1437/2870] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:40:42.356794 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f454b-415b-4e76-8f68-3f5936dbf27a service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:42.358296 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-616f454b-415b-4e76-8f68-3f5936dbf27a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:42.371729 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f454b-415b-4e76-8f68-3f5936dbf27a service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:42.376990 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:42.377622 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:42.377936 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:42.378209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8 admin admin] PATH_INFO: `/v3/projects/ebba5e549e2d48cea41622881038f06c` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:42.379325 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebba5e549e2d48cea41622881038f06c)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:42.381227 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:42.404426 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9037b6-d2c9-42dc-934e-005eb22a01d4 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:42.406310 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2a9037b6-d2c9-42dc-934e-005eb22a01d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:42.419529 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9037b6-d2c9-42dc-934e-005eb22a01d4 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:42.424880 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131f776-e3c4-45d3-a0f9-5df65185bcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:42.425503 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131f776-e3c4-45d3-a0f9-5df65185bcba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:42.425808 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131f776-e3c4-45d3-a0f9-5df65185bcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:42.432550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131f776-e3c4-45d3-a0f9-5df65185bcba admin admin] PATH_INFO: `/v3/projects/5a6c9cfd8d5443a7a5dbdb5fe7656a12` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:42.432550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131f776-e3c4-45d3-a0f9-5df65185bcba admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6c9cfd8d5443a7a5dbdb5fe7656a12)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:42.432550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131f776-e3c4-45d3-a0f9-5df65185bcba admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:42.432550 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:42.498117 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebba5e549e2d48cea41622881038f06c', 'request_id': 'req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:42.601417 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f131f776-e3c4-45d3-a0f9-5df65185bcba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6c9cfd8d5443a7a5dbdb5fe7656a12', 'request_id': 'req-f131f776-e3c4-45d3-a0f9-5df65185bcba'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:42.612555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebba5e549e2d48cea41622881038f06c', 'request_id': 'req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:42.618667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebba5e549e2d48cea41622881038f06c', 'request_id': 'req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:42.620621 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:42.629877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8 admin admin] The token cache is being invalidate because project ebba5e549e2d48cea41622881038f06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:40:42.630238 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:42.630986 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:42.632498 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1434/2871] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:40:42 2022] DELETE /identity/v3/projects/ebba5e549e2d48cea41622881038f06c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:42.636526 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:42.637989 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:42.699576 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a11de8-735f-4031-bcc6-d1c6ab56a9d8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:42.713332 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f131f776-e3c4-45d3-a0f9-5df65185bcba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6c9cfd8d5443a7a5dbdb5fe7656a12', 'request_id': 'req-f131f776-e3c4-45d3-a0f9-5df65185bcba'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:42.721272 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f131f776-e3c4-45d3-a0f9-5df65185bcba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6c9cfd8d5443a7a5dbdb5fe7656a12', 'request_id': 'req-f131f776-e3c4-45d3-a0f9-5df65185bcba'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:42.732509 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f131f776-e3c4-45d3-a0f9-5df65185bcba admin admin] The token cache is being invalidate because project 5a6c9cfd8d5443a7a5dbdb5fe7656a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:40:42.732924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f131f776-e3c4-45d3-a0f9-5df65185bcba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:42.733672 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f131f776-e3c4-45d3-a0f9-5df65185bcba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:42.735556 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1438/2872] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:40:42 2022] DELETE /identity/v3/projects/5a6c9cfd8d5443a7a5dbdb5fe7656a12 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:42.740687 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715918ce-de4b-41e2-87fe-6226cd668d70 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:42.741165 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715918ce-de4b-41e2-87fe-6226cd668d70 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:42.741546 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715918ce-de4b-41e2-87fe-6226cd668d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:42.763647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc6357-e14c-45a1-a3de-1739a45f6c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:42.763647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc6357-e14c-45a1-a3de-1739a45f6c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:42.763647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc6357-e14c-45a1-a3de-1739a45f6c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:42.763647 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc6357-e14c-45a1-a3de-1739a45f6c05 admin admin] PATH_INFO: `/v3/users/2a3913080674454382cdce4b32e88830` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:42.764158 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-715918ce-de4b-41e2-87fe-6226cd668d70 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:42.764261 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc6357-e14c-45a1-a3de-1739a45f6c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3913080674454382cdce4b32e88830)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:42.764370 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-715918ce-de4b-41e2-87fe-6226cd668d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:42.765215 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc6357-e14c-45a1-a3de-1739a45f6c05 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:42.771753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1439/2873] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:42.779598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c939ae-8081-46ff-a102-c46538d32152 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:42.779957 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c939ae-8081-46ff-a102-c46538d32152 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:42.780484 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c939ae-8081-46ff-a102-c46538d32152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:42.800592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d5c939ae-8081-46ff-a102-c46538d32152 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:42.801787 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d5c939ae-8081-46ff-a102-c46538d32152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:42.809713 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1440/2874] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:40:42.813868 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c939ae-8081-46ff-a102-c46538d32152 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:42.822687 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c939ae-8081-46ff-a102-c46538d32152 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:42.827260 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768b090-7e1e-4977-81ee-de9aea2b4e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:42.827825 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768b090-7e1e-4977-81ee-de9aea2b4e40 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:42.828131 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768b090-7e1e-4977-81ee-de9aea2b4e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:42.828400 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768b090-7e1e-4977-81ee-de9aea2b4e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:42.829026 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768b090-7e1e-4977-81ee-de9aea2b4e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:40:42.829325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768b090-7e1e-4977-81ee-de9aea2b4e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:42.830942 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768b090-7e1e-4977-81ee-de9aea2b4e40 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:42.842454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1441/2875] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 15:40:42.847125 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768b090-7e1e-4977-81ee-de9aea2b4e40 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:42.856404 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768b090-7e1e-4977-81ee-de9aea2b4e40 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:42.862103 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60558f5f-ee20-4c96-9fe4-91beaf983994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:42.862763 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60558f5f-ee20-4c96-9fe4-91beaf983994 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:42.863140 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60558f5f-ee20-4c96-9fe4-91beaf983994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:42.863443 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60558f5f-ee20-4c96-9fe4-91beaf983994 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:42.864164 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60558f5f-ee20-4c96-9fe4-91beaf983994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:42.866166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60558f5f-ee20-4c96-9fe4-91beaf983994 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:42.997357 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1442/2876] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:40:42 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:40:43.002195 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60558f5f-ee20-4c96-9fe4-91beaf983994 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:43.012969 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-97cc6357-e14c-45a1-a3de-1739a45f6c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3913080674454382cdce4b32e88830'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:43.026327 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-97cc6357-e14c-45a1-a3de-1739a45f6c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3913080674454382cdce4b32e88830'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:43.035999 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-97cc6357-e14c-45a1-a3de-1739a45f6c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3913080674454382cdce4b32e88830'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:43.039186 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-97cc6357-e14c-45a1-a3de-1739a45f6c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3913080674454382cdce4b32e88830'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:43.071700 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60558f5f-ee20-4c96-9fe4-91beaf983994 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:43.076553 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b26d94-575f-4494-8f69-2f4c5f73e363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:43.077166 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b26d94-575f-4494-8f69-2f4c5f73e363 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:43.077441 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b26d94-575f-4494-8f69-2f4c5f73e363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:43.078277 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b26d94-575f-4494-8f69-2f4c5f73e363 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:43.079437 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b26d94-575f-4494-8f69-2f4c5f73e363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:43.080836 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b26d94-575f-4494-8f69-2f4c5f73e363 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:43.115104 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-97cc6357-e14c-45a1-a3de-1739a45f6c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3913080674454382cdce4b32e88830'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:43.121550 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1435/2877] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:40:42 2022] DELETE /identity/v3/users/2a3913080674454382cdce4b32e88830 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:40:43.196027 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1443/2878] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:40:43 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 15:40:43.200387 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc6357-e14c-45a1-a3de-1739a45f6c05 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:43.201941 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-97cc6357-e14c-45a1-a3de-1739a45f6c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:43.229065 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:43.266752 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc6357-e14c-45a1-a3de-1739a45f6c05 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:43.271295 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e298b-68b4-4a94-82c7-350f15e0081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:43.271892 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e298b-68b4-4a94-82c7-350f15e0081c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:43.272211 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e298b-68b4-4a94-82c7-350f15e0081c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:43.272481 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e298b-68b4-4a94-82c7-350f15e0081c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:43.273113 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e298b-68b4-4a94-82c7-350f15e0081c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:43.274723 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e298b-68b4-4a94-82c7-350f15e0081c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:43.284458 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1436/2879] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:43.288744 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b26d94-575f-4494-8f69-2f4c5f73e363 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:43.299332 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b26d94-575f-4494-8f69-2f4c5f73e363 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:43.304397 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4356b-e786-46ee-a08c-25148dd46cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:43.305017 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4356b-e786-46ee-a08c-25148dd46cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:43.305314 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4356b-e786-46ee-a08c-25148dd46cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:43.305563 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4356b-e786-46ee-a08c-25148dd46cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:43.306248 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4356b-e786-46ee-a08c-25148dd46cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:43.307842 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4356b-e786-46ee-a08c-25148dd46cf8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:43.318950 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1444/2880] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:43.323323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e298b-68b4-4a94-82c7-350f15e0081c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:43.335570 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e298b-68b4-4a94-82c7-350f15e0081c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:43.340412 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5b119-50fa-41e5-8ee4-a75361026b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:43.341230 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5b119-50fa-41e5-8ee4-a75361026b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:43.341671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5b119-50fa-41e5-8ee4-a75361026b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:43.341938 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5b119-50fa-41e5-8ee4-a75361026b57 admin admin] PATH_INFO: `/v3/projects/8de9d88d7d624a28b8f036e2f797a606/users/95300aa2b9f34e2c9c08d08f5957f086/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:43.357160 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5b119-50fa-41e5-8ee4-a75361026b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de9d88d7d624a28b8f036e2f797a606, user_id=95300aa2b9f34e2c9c08d08f5957f086, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:43.359865 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5b119-50fa-41e5-8ee4-a75361026b57 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:43.433587 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1437/2881] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:40:43 2022] PUT /identity/v3/projects/8de9d88d7d624a28b8f036e2f797a606/users/95300aa2b9f34e2c9c08d08f5957f086/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 15:40:43.444507 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb176d7-2913-4807-a72b-e74bb092e2d0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:43.446168 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb176d7-2913-4807-a72b-e74bb092e2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:43.446168 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb176d7-2913-4807-a72b-e74bb092e2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:43.473909 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-adb176d7-2913-4807-a72b-e74bb092e2d0 None None] MFA Rules not processed for user `95300aa2b9f34e2c9c08d08f5957f086`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:43.475112 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-adb176d7-2913-4807-a72b-e74bb092e2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:43.484115 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:43.522093 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5b119-50fa-41e5-8ee4-a75361026b57 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:43.523801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-62f5b119-50fa-41e5-8ee4-a75361026b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:43.550623 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1445/2882] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:43.561200 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb176d7-2913-4807-a72b-e74bb092e2d0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:43.563127 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-adb176d7-2913-4807-a72b-e74bb092e2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:43.594021 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5b119-50fa-41e5-8ee4-a75361026b57 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:43.598750 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b9722-1472-4bc3-aad4-6c1eb6ca1320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:43.599368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b9722-1472-4bc3-aad4-6c1eb6ca1320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:43.599644 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b9722-1472-4bc3-aad4-6c1eb6ca1320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:43.599914 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b9722-1472-4bc3-aad4-6c1eb6ca1320 admin admin] PATH_INFO: `/v3/projects/373093630ccc49a6a21755d5d0d18cb1` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:43.601037 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b9722-1472-4bc3-aad4-6c1eb6ca1320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=373093630ccc49a6a21755d5d0d18cb1)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:43.602948 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b9722-1472-4bc3-aad4-6c1eb6ca1320 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:43.621119 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb176d7-2913-4807-a72b-e74bb092e2d0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:43.625559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0ed8e-cf8f-45b7-8b7c-d974d359241a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:43.626193 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0ed8e-cf8f-45b7-8b7c-d974d359241a service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:43.626462 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0ed8e-cf8f-45b7-8b7c-d974d359241a service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:43.626725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0ed8e-cf8f-45b7-8b7c-d974d359241a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:43.635141 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0ed8e-cf8f-45b7-8b7c-d974d359241a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:43.636555 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0ed8e-cf8f-45b7-8b7c-d974d359241a service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:43.645152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1446/2883] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:40:43.722080 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-432b9722-1472-4bc3-aad4-6c1eb6ca1320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373093630ccc49a6a21755d5d0d18cb1', 'request_id': 'req-432b9722-1472-4bc3-aad4-6c1eb6ca1320'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:43.801126 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-432b9722-1472-4bc3-aad4-6c1eb6ca1320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373093630ccc49a6a21755d5d0d18cb1', 'request_id': 'req-432b9722-1472-4bc3-aad4-6c1eb6ca1320'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:43.807633 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-432b9722-1472-4bc3-aad4-6c1eb6ca1320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373093630ccc49a6a21755d5d0d18cb1', 'request_id': 'req-432b9722-1472-4bc3-aad4-6c1eb6ca1320'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:43.819767 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-432b9722-1472-4bc3-aad4-6c1eb6ca1320 admin admin] The token cache is being invalidate because project 373093630ccc49a6a21755d5d0d18cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:40:43.820060 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-432b9722-1472-4bc3-aad4-6c1eb6ca1320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:43.820726 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-432b9722-1472-4bc3-aad4-6c1eb6ca1320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:43.822350 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1438/2884] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:40:43 2022] DELETE /identity/v3/projects/373093630ccc49a6a21755d5d0d18cb1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:43.826442 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0ed8e-cf8f-45b7-8b7c-d974d359241a service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:43.838048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0ed8e-cf8f-45b7-8b7c-d974d359241a service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:43.894421 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994da74d-d3e2-440a-b661-be4da77ecb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:43.895056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994da74d-d3e2-440a-b661-be4da77ecb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:43.895335 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994da74d-d3e2-440a-b661-be4da77ecb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:43.895611 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994da74d-d3e2-440a-b661-be4da77ecb0a admin admin] PATH_INFO: `/v3/users/cb8154d1b2294af2ba0e1b0f07ec0089` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:43.897058 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994da74d-d3e2-440a-b661-be4da77ecb0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb8154d1b2294af2ba0e1b0f07ec0089)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:43.899010 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994da74d-d3e2-440a-b661-be4da77ecb0a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:44.064800 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-994da74d-d3e2-440a-b661-be4da77ecb0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb8154d1b2294af2ba0e1b0f07ec0089'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:44.071959 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:44.077325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-994da74d-d3e2-440a-b661-be4da77ecb0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb8154d1b2294af2ba0e1b0f07ec0089'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:44.084090 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-994da74d-d3e2-440a-b661-be4da77ecb0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb8154d1b2294af2ba0e1b0f07ec0089'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:44.084753 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-994da74d-d3e2-440a-b661-be4da77ecb0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb8154d1b2294af2ba0e1b0f07ec0089'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:44.173588 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-994da74d-d3e2-440a-b661-be4da77ecb0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb8154d1b2294af2ba0e1b0f07ec0089'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:44.179972 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1447/2885] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:40:43 2022] DELETE /identity/v3/users/cb8154d1b2294af2ba0e1b0f07ec0089 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:44.760743 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b9722-1472-4bc3-aad4-6c1eb6ca1320 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:44.762229 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-432b9722-1472-4bc3-aad4-6c1eb6ca1320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:44.776392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b9722-1472-4bc3-aad4-6c1eb6ca1320 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:44.805363 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:44.846364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57682eca-267d-44a7-a353-ebc8f4717a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:44.847000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682eca-267d-44a7-a353-ebc8f4717a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:44.847283 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682eca-267d-44a7-a353-ebc8f4717a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:44.847557 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682eca-267d-44a7-a353-ebc8f4717a7a admin admin] PATH_INFO: `/v3/projects/5216b56de57c4c27ad67386fbbd9d7f5` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:44.848680 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57682eca-267d-44a7-a353-ebc8f4717a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5216b56de57c4c27ad67386fbbd9d7f5)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:44.850610 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57682eca-267d-44a7-a353-ebc8f4717a7a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:44.973145 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-57682eca-267d-44a7-a353-ebc8f4717a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5216b56de57c4c27ad67386fbbd9d7f5', 'request_id': 'req-57682eca-267d-44a7-a353-ebc8f4717a7a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:45.023858 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-57682eca-267d-44a7-a353-ebc8f4717a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5216b56de57c4c27ad67386fbbd9d7f5', 'request_id': 'req-57682eca-267d-44a7-a353-ebc8f4717a7a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:45.029985 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-57682eca-267d-44a7-a353-ebc8f4717a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5216b56de57c4c27ad67386fbbd9d7f5', 'request_id': 'req-57682eca-267d-44a7-a353-ebc8f4717a7a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:45.043612 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-57682eca-267d-44a7-a353-ebc8f4717a7a admin admin] The token cache is being invalidate because project 5216b56de57c4c27ad67386fbbd9d7f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:40:45.043835 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-57682eca-267d-44a7-a353-ebc8f4717a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:45.044512 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-57682eca-267d-44a7-a353-ebc8f4717a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:45.046193 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1439/2886] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:40:44 2022] DELETE /identity/v3/projects/5216b56de57c4c27ad67386fbbd9d7f5 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:45.051350 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703e597-59d5-4f81-8cdc-4c0414d50323 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:45.051738 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703e597-59d5-4f81-8cdc-4c0414d50323 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:45.051942 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703e597-59d5-4f81-8cdc-4c0414d50323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:45.074236 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e703e597-59d5-4f81-8cdc-4c0414d50323 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:45.075806 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e703e597-59d5-4f81-8cdc-4c0414d50323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:45.138153 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1448/2887] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:40:45.147147 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656f777-75c2-4328-aad0-5d6f43bd73b7 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:45.152390 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656f777-75c2-4328-aad0-5d6f43bd73b7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:45.152390 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656f777-75c2-4328-aad0-5d6f43bd73b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:45.169297 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d656f777-75c2-4328-aad0-5d6f43bd73b7 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:45.170559 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d656f777-75c2-4328-aad0-5d6f43bd73b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:45.178665 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1440/2888] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:45.183013 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703e597-59d5-4f81-8cdc-4c0414d50323 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:45.192569 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703e597-59d5-4f81-8cdc-4c0414d50323 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:45.197147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019551ed-577e-48c2-9b9f-440d65be865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:45.197750 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019551ed-577e-48c2-9b9f-440d65be865b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:45.198055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019551ed-577e-48c2-9b9f-440d65be865b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:45.198328 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019551ed-577e-48c2-9b9f-440d65be865b admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:45.198967 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019551ed-577e-48c2-9b9f-440d65be865b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:40:45.199267 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019551ed-577e-48c2-9b9f-440d65be865b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:45.200861 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019551ed-577e-48c2-9b9f-440d65be865b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:45.212977 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1449/2889] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:40:45.217274 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656f777-75c2-4328-aad0-5d6f43bd73b7 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:45.227000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656f777-75c2-4328-aad0-5d6f43bd73b7 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:45.231685 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69dc0d-73ab-4495-8d52-d076976d630c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:45.235599 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69dc0d-73ab-4495-8d52-d076976d630c admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:45.235884 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69dc0d-73ab-4495-8d52-d076976d630c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:45.236158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69dc0d-73ab-4495-8d52-d076976d630c admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:45.236806 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69dc0d-73ab-4495-8d52-d076976d630c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:45.238734 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69dc0d-73ab-4495-8d52-d076976d630c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:45.350462 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1441/2890] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:40:45 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:40:45.356056 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019551ed-577e-48c2-9b9f-440d65be865b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:45.366255 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019551ed-577e-48c2-9b9f-440d65be865b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:45.423882 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dd241-923e-4d2b-a9ee-4a474564b1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:45.424485 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dd241-923e-4d2b-a9ee-4a474564b1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:45.424764 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dd241-923e-4d2b-a9ee-4a474564b1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:45.425037 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dd241-923e-4d2b-a9ee-4a474564b1b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:45.425655 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dd241-923e-4d2b-a9ee-4a474564b1b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:45.427598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dd241-923e-4d2b-a9ee-4a474564b1b7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:45.516252 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1450/2891] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:40:45 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:40:45.521228 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69dc0d-73ab-4495-8d52-d076976d630c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:45.531794 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69dc0d-73ab-4495-8d52-d076976d630c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:45.536557 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef042a-e401-44ba-be74-614ad6843a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:45.537323 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef042a-e401-44ba-be74-614ad6843a61 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:45.537608 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef042a-e401-44ba-be74-614ad6843a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:45.537939 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef042a-e401-44ba-be74-614ad6843a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:45.538580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef042a-e401-44ba-be74-614ad6843a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:45.540418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef042a-e401-44ba-be74-614ad6843a61 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:45.554004 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1442/2892] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:45.554991 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dd241-923e-4d2b-a9ee-4a474564b1b7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:45.582048 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dd241-923e-4d2b-a9ee-4a474564b1b7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:45.584505 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3077c-52c3-4f2d-ba75-97a7b0947c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:45.585314 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3077c-52c3-4f2d-ba75-97a7b0947c47 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:45.585644 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3077c-52c3-4f2d-ba75-97a7b0947c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:45.585950 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3077c-52c3-4f2d-ba75-97a7b0947c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:45.588081 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3077c-52c3-4f2d-ba75-97a7b0947c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:45.589702 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3077c-52c3-4f2d-ba75-97a7b0947c47 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:45.604102 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1451/2893] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:40:45.606298 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef042a-e401-44ba-be74-614ad6843a61 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:45.618296 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef042a-e401-44ba-be74-614ad6843a61 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:45.621011 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514ffbc-97ed-4b7c-8c3b-63d1a8fe7e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:45.621645 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514ffbc-97ed-4b7c-8c3b-63d1a8fe7e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:45.622008 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514ffbc-97ed-4b7c-8c3b-63d1a8fe7e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:45.622224 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514ffbc-97ed-4b7c-8c3b-63d1a8fe7e22 admin admin] PATH_INFO: `/v3/projects/b2ba7e0b070e4dd5b0bc0956463fa417/users/b54ef88bd60146d5adfe9bdc3b51d106/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:45.642489 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514ffbc-97ed-4b7c-8c3b-63d1a8fe7e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ba7e0b070e4dd5b0bc0956463fa417, user_id=b54ef88bd60146d5adfe9bdc3b51d106, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:45.646973 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514ffbc-97ed-4b7c-8c3b-63d1a8fe7e22 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:45.778718 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1443/2894] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:40:45 2022] PUT /identity/v3/projects/b2ba7e0b070e4dd5b0bc0956463fa417/users/b54ef88bd60146d5adfe9bdc3b51d106/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:45.790152 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcea544-a617-4f45-810e-5505cf69cf5e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:45.790451 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcea544-a617-4f45-810e-5505cf69cf5e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:45.790706 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcea544-a617-4f45-810e-5505cf69cf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:45.818214 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-dfcea544-a617-4f45-810e-5505cf69cf5e None None] MFA Rules not processed for user `b54ef88bd60146d5adfe9bdc3b51d106`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:45.819428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-dfcea544-a617-4f45-810e-5505cf69cf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:45.848117 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:45.887376 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1452/2895] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:45.900015 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514ffbc-97ed-4b7c-8c3b-63d1a8fe7e22 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:45.902490 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9514ffbc-97ed-4b7c-8c3b-63d1a8fe7e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:45.959995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514ffbc-97ed-4b7c-8c3b-63d1a8fe7e22 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:45.963719 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfae61e-cb5a-47ba-907e-92ced2801f9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1879a3ad7be74303b9feceff75f62979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:45.964319 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfae61e-cb5a-47ba-907e-92ced2801f9a service glance] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:45.964597 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfae61e-cb5a-47ba-907e-92ced2801f9a service glance] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:45.964874 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfae61e-cb5a-47ba-907e-92ced2801f9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:45.972705 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:45.976608 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfae61e-cb5a-47ba-907e-92ced2801f9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:45.978063 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfae61e-cb5a-47ba-907e-92ced2801f9a service glance] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:45.986859 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1444/2896] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:40:49.146619 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6c2b-9901-4690-9f3c-be585e241eab None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:49.146619 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6c2b-9901-4690-9f3c-be585e241eab None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:49.147323 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6c2b-9901-4690-9f3c-be585e241eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:49.171161 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-19ee6c2b-9901-4690-9f3c-be585e241eab None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:49.173214 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-19ee6c2b-9901-4690-9f3c-be585e241eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:49.240915 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1453/2897] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Sep 23 15:40:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:49.293299 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfae61e-cb5a-47ba-907e-92ced2801f9a service glance] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:49.298571 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bcfae61e-cb5a-47ba-907e-92ced2801f9a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:49.421541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfae61e-cb5a-47ba-907e-92ced2801f9a service glance] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:49.432165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d82ab-0a3d-4c3b-925c-45d43113f301 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:49.433010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d82ab-0a3d-4c3b-925c-45d43113f301 service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:49.433395 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d82ab-0a3d-4c3b-925c-45d43113f301 service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:49.434764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d82ab-0a3d-4c3b-925c-45d43113f301 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:49.457427 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d82ab-0a3d-4c3b-925c-45d43113f301 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:49.460124 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d82ab-0a3d-4c3b-925c-45d43113f301 service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:49.476439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1445/2898] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:40:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 15:40:56.628907 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee6c2b-9901-4690-9f3c-be585e241eab None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:56.630493 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-19ee6c2b-9901-4690-9f3c-be585e241eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:56.709207 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee6c2b-9901-4690-9f3c-be585e241eab None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:56.715700 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91352b-9fd7-40fb-8571-f46cf26afae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:56.716624 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91352b-9fd7-40fb-8571-f46cf26afae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:56.716923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91352b-9fd7-40fb-8571-f46cf26afae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:56.717202 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91352b-9fd7-40fb-8571-f46cf26afae7 admin admin] PATH_INFO: `/v3/users/95300aa2b9f34e2c9c08d08f5957f086` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:56.718456 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91352b-9fd7-40fb-8571-f46cf26afae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95300aa2b9f34e2c9c08d08f5957f086)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:56.720449 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91352b-9fd7-40fb-8571-f46cf26afae7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:56.988231 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7c91352b-9fd7-40fb-8571-f46cf26afae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95300aa2b9f34e2c9c08d08f5957f086'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:57.028768 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7c91352b-9fd7-40fb-8571-f46cf26afae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95300aa2b9f34e2c9c08d08f5957f086'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:57.039068 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:40:57.044143 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7c91352b-9fd7-40fb-8571-f46cf26afae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95300aa2b9f34e2c9c08d08f5957f086'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:57.050192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7c91352b-9fd7-40fb-8571-f46cf26afae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95300aa2b9f34e2c9c08d08f5957f086'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:57.159628 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-7c91352b-9fd7-40fb-8571-f46cf26afae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95300aa2b9f34e2c9c08d08f5957f086'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:57.167566 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1454/2899] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:40:56 2022] DELETE /identity/v3/users/95300aa2b9f34e2c9c08d08f5957f086 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:40:57.173836 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42055b37-03a0-4959-9404-96a11f12fa83 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:57.179665 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42055b37-03a0-4959-9404-96a11f12fa83 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:57.179665 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42055b37-03a0-4959-9404-96a11f12fa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:57.215154 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-42055b37-03a0-4959-9404-96a11f12fa83 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:40:57.216764 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-42055b37-03a0-4959-9404-96a11f12fa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:57.317141 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1446/2900] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:40:57.332765 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91352b-9fd7-40fb-8571-f46cf26afae7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:57.334919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7c91352b-9fd7-40fb-8571-f46cf26afae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:57.438065 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91352b-9fd7-40fb-8571-f46cf26afae7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:57.442989 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc87f44-1e42-42d3-b33b-cf628959ae46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:57.444078 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc87f44-1e42-42d3-b33b-cf628959ae46 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:57.444821 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc87f44-1e42-42d3-b33b-cf628959ae46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:57.445287 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc87f44-1e42-42d3-b33b-cf628959ae46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:57.458479 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc87f44-1e42-42d3-b33b-cf628959ae46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:57.460554 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc87f44-1e42-42d3-b33b-cf628959ae46 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:57.489826 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1455/2901] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:40:58.048830 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42055b37-03a0-4959-9404-96a11f12fa83 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:40:58.050580 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-42055b37-03a0-4959-9404-96a11f12fa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:40:58.068379 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42055b37-03a0-4959-9404-96a11f12fa83 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:40:58.080207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877d5c5-b83f-4cb9-adc2-f5afaf117526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:40:58.081337 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877d5c5-b83f-4cb9-adc2-f5afaf117526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:40:58.081812 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877d5c5-b83f-4cb9-adc2-f5afaf117526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:40:58.082392 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877d5c5-b83f-4cb9-adc2-f5afaf117526 admin admin] PATH_INFO: `/v3/projects/8de9d88d7d624a28b8f036e2f797a606` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:40:58.084368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877d5c5-b83f-4cb9-adc2-f5afaf117526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8de9d88d7d624a28b8f036e2f797a606)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:40:58.086555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877d5c5-b83f-4cb9-adc2-f5afaf117526 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:40:58.197424 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3877d5c5-b83f-4cb9-adc2-f5afaf117526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8de9d88d7d624a28b8f036e2f797a606', 'request_id': 'req-3877d5c5-b83f-4cb9-adc2-f5afaf117526'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:58.303750 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3877d5c5-b83f-4cb9-adc2-f5afaf117526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8de9d88d7d624a28b8f036e2f797a606', 'request_id': 'req-3877d5c5-b83f-4cb9-adc2-f5afaf117526'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:58.311391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3877d5c5-b83f-4cb9-adc2-f5afaf117526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8de9d88d7d624a28b8f036e2f797a606', 'request_id': 'req-3877d5c5-b83f-4cb9-adc2-f5afaf117526'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:58.326059 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3877d5c5-b83f-4cb9-adc2-f5afaf117526 admin admin] The token cache is being invalidate because project 8de9d88d7d624a28b8f036e2f797a606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:40:58.326584 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3877d5c5-b83f-4cb9-adc2-f5afaf117526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:58.331319 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3877d5c5-b83f-4cb9-adc2-f5afaf117526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:40:58.333048 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1447/2902] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:40:58 2022] DELETE /identity/v3/projects/8de9d88d7d624a28b8f036e2f797a606 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:41:01.431604 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4677059-9a2d-472c-8cbe-215f44a9f28a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:01.432126 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4677059-9a2d-472c-8cbe-215f44a9f28a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:01.432347 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4677059-9a2d-472c-8cbe-215f44a9f28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:01.452303 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c4677059-9a2d-472c-8cbe-215f44a9f28a None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:41:01.453623 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c4677059-9a2d-472c-8cbe-215f44a9f28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:01.516241 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1456/2903] 10.222.0.82 () {58 vars in 967 bytes} [Fri Sep 23 15:41:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:41:01.533105 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877d5c5-b83f-4cb9-adc2-f5afaf117526 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:01.534672 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3877d5c5-b83f-4cb9-adc2-f5afaf117526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:01.545695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:41:01.615251 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877d5c5-b83f-4cb9-adc2-f5afaf117526 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:01.620631 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ae80e-c308-47bd-9931-826ec2c5ef4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:01.621455 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ae80e-c308-47bd-9931-826ec2c5ef4f service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:01.621886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ae80e-c308-47bd-9931-826ec2c5ef4f service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:01.622173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ae80e-c308-47bd-9931-826ec2c5ef4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:01.633358 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ae80e-c308-47bd-9931-826ec2c5ef4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:01.635903 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ae80e-c308-47bd-9931-826ec2c5ef4f service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:01.644811 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1448/2904] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:41:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 15:41:11.507767 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=55,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:41:11.668919 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=29 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:41:12.387429 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4677059-9a2d-472c-8cbe-215f44a9f28a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:12.387429 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c4677059-9a2d-472c-8cbe-215f44a9f28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:12.448497 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4677059-9a2d-472c-8cbe-215f44a9f28a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:12.453102 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560415e-486d-42d6-b39d-979bf48cf368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:12.453716 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560415e-486d-42d6-b39d-979bf48cf368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:12.454121 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560415e-486d-42d6-b39d-979bf48cf368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:12.454394 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560415e-486d-42d6-b39d-979bf48cf368 admin admin] PATH_INFO: `/v3/users/a76e02228eed4239954f06e77213f008` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:12.455549 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560415e-486d-42d6-b39d-979bf48cf368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76e02228eed4239954f06e77213f008)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:12.457473 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560415e-486d-42d6-b39d-979bf48cf368 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:12.713997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4560415e-486d-42d6-b39d-979bf48cf368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76e02228eed4239954f06e77213f008'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:12.724359 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4560415e-486d-42d6-b39d-979bf48cf368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76e02228eed4239954f06e77213f008'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:12.730973 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4560415e-486d-42d6-b39d-979bf48cf368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76e02228eed4239954f06e77213f008'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:12.731687 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4560415e-486d-42d6-b39d-979bf48cf368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76e02228eed4239954f06e77213f008'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:12.743830 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714558f0-4bef-402e-ad6a-3d5d3e8f4a0a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:12.743830 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714558f0-4bef-402e-ad6a-3d5d3e8f4a0a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:12.744634 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714558f0-4bef-402e-ad6a-3d5d3e8f4a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:12.763627 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-714558f0-4bef-402e-ad6a-3d5d3e8f4a0a None None] MFA Rules not processed for user `94a8ee59c6b24db9a67eb44a115fae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:41:12.765365 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-714558f0-4bef-402e-ad6a-3d5d3e8f4a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:12.772478 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1449/2905] 10.222.0.82 () {58 vars in 967 bytes} [Fri Sep 23 15:41:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:41:12.785465 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714558f0-4bef-402e-ad6a-3d5d3e8f4a0a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:12.786774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-714558f0-4bef-402e-ad6a-3d5d3e8f4a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:12.801289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714558f0-4bef-402e-ad6a-3d5d3e8f4a0a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:12.806302 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e4865-c19c-4a28-953b-11b79d63e39d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b22406c522e149d8bc462ff2feeec44c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:12.806889 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e4865-c19c-4a28-953b-11b79d63e39d service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:12.807166 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e4865-c19c-4a28-953b-11b79d63e39d service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:12.807439 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e4865-c19c-4a28-953b-11b79d63e39d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:12.815581 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e4865-c19c-4a28-953b-11b79d63e39d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:12.817146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e4865-c19c-4a28-953b-11b79d63e39d service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:12.825285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1450/2906] 10.222.0.82 () {60 vars in 1384 bytes} [Fri Sep 23 15:41:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 15:41:12.840139 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4560415e-486d-42d6-b39d-979bf48cf368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76e02228eed4239954f06e77213f008'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:12.847436 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1457/2907] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:41:12 2022] DELETE /identity/v3/users/a76e02228eed4239954f06e77213f008 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:41:13.098676 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e4865-c19c-4a28-953b-11b79d63e39d service swift] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:13.100204 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-846e4865-c19c-4a28-953b-11b79d63e39d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:13.114823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e4865-c19c-4a28-953b-11b79d63e39d service swift] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:13.174173 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1006ccc-1aae-4851-8967-ea19c7d3ed11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:13.174728 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1006ccc-1aae-4851-8967-ea19c7d3ed11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:13.175023 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1006ccc-1aae-4851-8967-ea19c7d3ed11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:13.175280 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1006ccc-1aae-4851-8967-ea19c7d3ed11 admin admin] PATH_INFO: `/v3/projects/964e1f1332054a97b9acb112cf6bb9a7` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:13.176434 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1006ccc-1aae-4851-8967-ea19c7d3ed11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=964e1f1332054a97b9acb112cf6bb9a7)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:13.178370 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1006ccc-1aae-4851-8967-ea19c7d3ed11 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:13.298613 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a1006ccc-1aae-4851-8967-ea19c7d3ed11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '964e1f1332054a97b9acb112cf6bb9a7', 'request_id': 'req-a1006ccc-1aae-4851-8967-ea19c7d3ed11'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:13.417507 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a1006ccc-1aae-4851-8967-ea19c7d3ed11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '964e1f1332054a97b9acb112cf6bb9a7', 'request_id': 'req-a1006ccc-1aae-4851-8967-ea19c7d3ed11'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:13.424495 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a1006ccc-1aae-4851-8967-ea19c7d3ed11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '964e1f1332054a97b9acb112cf6bb9a7', 'request_id': 'req-a1006ccc-1aae-4851-8967-ea19c7d3ed11'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:13.435886 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a1006ccc-1aae-4851-8967-ea19c7d3ed11 admin admin] The token cache is being invalidate because project 964e1f1332054a97b9acb112cf6bb9a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:41:13.436172 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a1006ccc-1aae-4851-8967-ea19c7d3ed11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:13.437384 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a1006ccc-1aae-4851-8967-ea19c7d3ed11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:13.438995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1451/2908] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:41:13 2022] DELETE /identity/v3/projects/964e1f1332054a97b9acb112cf6bb9a7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:41:13.442961 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560415e-486d-42d6-b39d-979bf48cf368 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:13.453337 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560415e-486d-42d6-b39d-979bf48cf368 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:13.510645 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0d332-0af9-4270-811d-b6ef0a75536e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:13.511270 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0d332-0af9-4270-811d-b6ef0a75536e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:13.511545 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0d332-0af9-4270-811d-b6ef0a75536e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:13.511814 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0d332-0af9-4270-811d-b6ef0a75536e admin admin] PATH_INFO: `/v3/users/2de2bb22997f4b7291b31fbec7aa915c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:13.513008 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0d332-0af9-4270-811d-b6ef0a75536e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de2bb22997f4b7291b31fbec7aa915c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:13.514924 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0d332-0af9-4270-811d-b6ef0a75536e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:13.535998 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:41:13.797086 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0d0d332-0af9-4270-811d-b6ef0a75536e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de2bb22997f4b7291b31fbec7aa915c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:13.812516 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0d0d332-0af9-4270-811d-b6ef0a75536e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de2bb22997f4b7291b31fbec7aa915c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:13.819523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0d0d332-0af9-4270-811d-b6ef0a75536e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de2bb22997f4b7291b31fbec7aa915c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:13.820251 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0d0d332-0af9-4270-811d-b6ef0a75536e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de2bb22997f4b7291b31fbec7aa915c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:13.896132 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0d0d332-0af9-4270-811d-b6ef0a75536e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de2bb22997f4b7291b31fbec7aa915c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:13.902559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1458/2909] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:41:13 2022] DELETE /identity/v3/users/2de2bb22997f4b7291b31fbec7aa915c => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:41:14.184207 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1006ccc-1aae-4851-8967-ea19c7d3ed11 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:14.186209 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a1006ccc-1aae-4851-8967-ea19c7d3ed11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:14.199643 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1006ccc-1aae-4851-8967-ea19c7d3ed11 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:14.255295 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ab9af-b7e3-4c71-822e-4152ce2699c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:14.255921 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ab9af-b7e3-4c71-822e-4152ce2699c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:14.256197 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ab9af-b7e3-4c71-822e-4152ce2699c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:14.256472 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ab9af-b7e3-4c71-822e-4152ce2699c3 admin admin] PATH_INFO: `/v3/projects/2d5965cb22b24bfbbab1630586c215d2` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:14.257582 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ab9af-b7e3-4c71-822e-4152ce2699c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5965cb22b24bfbbab1630586c215d2)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:14.259504 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ab9af-b7e3-4c71-822e-4152ce2699c3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:14.270798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:41:14.365142 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f75ab9af-b7e3-4c71-822e-4152ce2699c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5965cb22b24bfbbab1630586c215d2', 'request_id': 'req-f75ab9af-b7e3-4c71-822e-4152ce2699c3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:14.417500 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f75ab9af-b7e3-4c71-822e-4152ce2699c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5965cb22b24bfbbab1630586c215d2', 'request_id': 'req-f75ab9af-b7e3-4c71-822e-4152ce2699c3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:14.423555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f75ab9af-b7e3-4c71-822e-4152ce2699c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5965cb22b24bfbbab1630586c215d2', 'request_id': 'req-f75ab9af-b7e3-4c71-822e-4152ce2699c3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:14.434674 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f75ab9af-b7e3-4c71-822e-4152ce2699c3 admin admin] The token cache is being invalidate because project 2d5965cb22b24bfbbab1630586c215d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:41:14.434958 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f75ab9af-b7e3-4c71-822e-4152ce2699c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:14.435710 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f75ab9af-b7e3-4c71-822e-4152ce2699c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:14.437677 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1452/2910] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:41:14 2022] DELETE /identity/v3/projects/2d5965cb22b24bfbbab1630586c215d2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:41:16.024203 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0d332-0af9-4270-811d-b6ef0a75536e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:16.026299 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f0d0d332-0af9-4270-811d-b6ef0a75536e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:16.039469 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0d332-0af9-4270-811d-b6ef0a75536e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:16.095251 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d29d12-07dd-4d92-ae3a-58f78f4dbb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:16.095933 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d29d12-07dd-4d92-ae3a-58f78f4dbb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:16.096210 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d29d12-07dd-4d92-ae3a-58f78f4dbb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:16.096510 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d29d12-07dd-4d92-ae3a-58f78f4dbb96 admin admin] PATH_INFO: `/v3/users/d22aae53e038497bb01ede7c95d9570a` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:16.097648 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d29d12-07dd-4d92-ae3a-58f78f4dbb96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22aae53e038497bb01ede7c95d9570a)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:16.099600 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d29d12-07dd-4d92-ae3a-58f78f4dbb96 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:16.299501 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-67d29d12-07dd-4d92-ae3a-58f78f4dbb96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22aae53e038497bb01ede7c95d9570a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:16.312386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-67d29d12-07dd-4d92-ae3a-58f78f4dbb96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22aae53e038497bb01ede7c95d9570a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:16.319499 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-67d29d12-07dd-4d92-ae3a-58f78f4dbb96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22aae53e038497bb01ede7c95d9570a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:16.320169 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-67d29d12-07dd-4d92-ae3a-58f78f4dbb96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22aae53e038497bb01ede7c95d9570a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:16.387214 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-67d29d12-07dd-4d92-ae3a-58f78f4dbb96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22aae53e038497bb01ede7c95d9570a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:16.393684 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1459/2911] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:41:16 2022] DELETE /identity/v3/users/d22aae53e038497bb01ede7c95d9570a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:41:16.676413 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ab9af-b7e3-4c71-822e-4152ce2699c3 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:16.677904 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f75ab9af-b7e3-4c71-822e-4152ce2699c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:16.693040 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ab9af-b7e3-4c71-822e-4152ce2699c3 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:16.749703 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370c0e7-18ee-4366-9875-dc43420ab7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:16.750372 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370c0e7-18ee-4366-9875-dc43420ab7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:16.750671 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370c0e7-18ee-4366-9875-dc43420ab7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:16.750891 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370c0e7-18ee-4366-9875-dc43420ab7eb admin admin] PATH_INFO: `/v3/projects/4b0fff6bd6b74db28209c0ba261d9f33` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:16.752015 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370c0e7-18ee-4366-9875-dc43420ab7eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0fff6bd6b74db28209c0ba261d9f33)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:16.753912 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370c0e7-18ee-4366-9875-dc43420ab7eb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:16.845320 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4370c0e7-18ee-4366-9875-dc43420ab7eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0fff6bd6b74db28209c0ba261d9f33', 'request_id': 'req-4370c0e7-18ee-4366-9875-dc43420ab7eb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:16.897071 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4370c0e7-18ee-4366-9875-dc43420ab7eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0fff6bd6b74db28209c0ba261d9f33', 'request_id': 'req-4370c0e7-18ee-4366-9875-dc43420ab7eb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:16.903084 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4370c0e7-18ee-4366-9875-dc43420ab7eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0fff6bd6b74db28209c0ba261d9f33', 'request_id': 'req-4370c0e7-18ee-4366-9875-dc43420ab7eb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:16.914879 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4370c0e7-18ee-4366-9875-dc43420ab7eb admin admin] The token cache is being invalidate because project 4b0fff6bd6b74db28209c0ba261d9f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:41:16.915163 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4370c0e7-18ee-4366-9875-dc43420ab7eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:16.915808 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4370c0e7-18ee-4366-9875-dc43420ab7eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:16.917276 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1453/2912] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:41:16 2022] DELETE /identity/v3/projects/4b0fff6bd6b74db28209c0ba261d9f33 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:41:16.922841 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeeefec-f5ba-4adc-9276-c4a2b4d0cb7c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:16.923123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeeefec-f5ba-4adc-9276-c4a2b4d0cb7c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:16.923395 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeeefec-f5ba-4adc-9276-c4a2b4d0cb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:16.942342 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6eeeefec-f5ba-4adc-9276-c4a2b4d0cb7c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:41:16.943523 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6eeeefec-f5ba-4adc-9276-c4a2b4d0cb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:16.955181 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:41:17.007896 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1460/2913] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:41:17.017225 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c7ac0-2958-4bc5-a7f8-fcafc64d73ff None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:17.017505 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c7ac0-2958-4bc5-a7f8-fcafc64d73ff None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:17.017911 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c7ac0-2958-4bc5-a7f8-fcafc64d73ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:17.040435 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-707c7ac0-2958-4bc5-a7f8-fcafc64d73ff None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:41:17.041693 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-707c7ac0-2958-4bc5-a7f8-fcafc64d73ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:17.050116 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1454/2914] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:41:17.054709 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeeefec-f5ba-4adc-9276-c4a2b4d0cb7c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:17.064843 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeeefec-f5ba-4adc-9276-c4a2b4d0cb7c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:17.069528 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154c4fd-344e-431f-b7aa-9d1e25e35902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:17.070180 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154c4fd-344e-431f-b7aa-9d1e25e35902 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:17.070455 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154c4fd-344e-431f-b7aa-9d1e25e35902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:17.070725 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154c4fd-344e-431f-b7aa-9d1e25e35902 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:17.071389 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154c4fd-344e-431f-b7aa-9d1e25e35902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:41:17.071671 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154c4fd-344e-431f-b7aa-9d1e25e35902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:17.073283 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154c4fd-344e-431f-b7aa-9d1e25e35902 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:17.086378 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1461/2915] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:41:17.090909 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c7ac0-2958-4bc5-a7f8-fcafc64d73ff None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:17.101404 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c7ac0-2958-4bc5-a7f8-fcafc64d73ff None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:17.106515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa65a6b-e6ca-487c-ba92-8737b7aabe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:17.107146 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa65a6b-e6ca-487c-ba92-8737b7aabe67 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:17.107464 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa65a6b-e6ca-487c-ba92-8737b7aabe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:17.107736 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa65a6b-e6ca-487c-ba92-8737b7aabe67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:17.108475 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa65a6b-e6ca-487c-ba92-8737b7aabe67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:17.110649 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa65a6b-e6ca-487c-ba92-8737b7aabe67 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:17.207284 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1455/2916] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:41:17 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:41:17.211429 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154c4fd-344e-431f-b7aa-9d1e25e35902 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:17.221905 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154c4fd-344e-431f-b7aa-9d1e25e35902 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:17.277743 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ffadd-a8ec-4ed6-a9b0-538487e87025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:17.278386 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ffadd-a8ec-4ed6-a9b0-538487e87025 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:17.278660 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ffadd-a8ec-4ed6-a9b0-538487e87025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:17.278956 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ffadd-a8ec-4ed6-a9b0-538487e87025 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:17.279624 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ffadd-a8ec-4ed6-a9b0-538487e87025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:17.282454 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ffadd-a8ec-4ed6-a9b0-538487e87025 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:17.399906 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1462/2917] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:41:17 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:41:17.404127 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa65a6b-e6ca-487c-ba92-8737b7aabe67 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:17.410265 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:41:17.415437 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa65a6b-e6ca-487c-ba92-8737b7aabe67 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:17.420271 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade23ea-7fdb-4ddb-b5f3-2ea1bf002a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:17.420958 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade23ea-7fdb-4ddb-b5f3-2ea1bf002a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:17.421234 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade23ea-7fdb-4ddb-b5f3-2ea1bf002a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:17.421607 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade23ea-7fdb-4ddb-b5f3-2ea1bf002a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:17.422345 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade23ea-7fdb-4ddb-b5f3-2ea1bf002a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:17.423976 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade23ea-7fdb-4ddb-b5f3-2ea1bf002a18 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:17.433937 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1456/2918] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:41:17.438520 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ffadd-a8ec-4ed6-a9b0-538487e87025 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:17.448403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ffadd-a8ec-4ed6-a9b0-538487e87025 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:17.453666 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc190a-b26e-4bf3-bb4b-861da8a93923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:17.454300 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc190a-b26e-4bf3-bb4b-861da8a93923 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:17.454577 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc190a-b26e-4bf3-bb4b-861da8a93923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:17.454849 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc190a-b26e-4bf3-bb4b-861da8a93923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:17.455478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc190a-b26e-4bf3-bb4b-861da8a93923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:17.457162 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc190a-b26e-4bf3-bb4b-861da8a93923 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:17.467838 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1463/2919] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:41:17.471817 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade23ea-7fdb-4ddb-b5f3-2ea1bf002a18 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:17.482023 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade23ea-7fdb-4ddb-b5f3-2ea1bf002a18 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:17.486681 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df550ae0-5c6d-43aa-91b9-4d6a61a40aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:17.487332 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df550ae0-5c6d-43aa-91b9-4d6a61a40aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:17.487680 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df550ae0-5c6d-43aa-91b9-4d6a61a40aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:17.487949 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df550ae0-5c6d-43aa-91b9-4d6a61a40aa3 admin admin] PATH_INFO: `/v3/projects/f528d553ff584b12ba0ad11f6570d95c/users/cf1f4ada7d8b4f5fb16e7020faa8e18e/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:17.503561 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df550ae0-5c6d-43aa-91b9-4d6a61a40aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f528d553ff584b12ba0ad11f6570d95c, user_id=cf1f4ada7d8b4f5fb16e7020faa8e18e, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:17.506261 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df550ae0-5c6d-43aa-91b9-4d6a61a40aa3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:17.616798 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1457/2920] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:41:17 2022] PUT /identity/v3/projects/f528d553ff584b12ba0ad11f6570d95c/users/cf1f4ada7d8b4f5fb16e7020faa8e18e/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:41:17.680393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4c5ee-9f98-4f22-9e06-d8eda9db67fc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:17.680639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4c5ee-9f98-4f22-9e06-d8eda9db67fc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:17.680865 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4c5ee-9f98-4f22-9e06-d8eda9db67fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:17.709334 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0af4c5ee-9f98-4f22-9e06-d8eda9db67fc None None] MFA Rules not processed for user `cf1f4ada7d8b4f5fb16e7020faa8e18e`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:41:17.710579 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0af4c5ee-9f98-4f22-9e06-d8eda9db67fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:17.774274 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1464/2921] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:41:17.786286 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df550ae0-5c6d-43aa-91b9-4d6a61a40aa3 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:17.787995 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-df550ae0-5c6d-43aa-91b9-4d6a61a40aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:17.845138 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df550ae0-5c6d-43aa-91b9-4d6a61a40aa3 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:17.848801 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739e5bb-5b38-470d-9ec8-c3cfd8012648 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1879a3ad7be74303b9feceff75f62979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:17.849391 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739e5bb-5b38-470d-9ec8-c3cfd8012648 service glance] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:17.849666 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739e5bb-5b38-470d-9ec8-c3cfd8012648 service glance] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:17.849962 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739e5bb-5b38-470d-9ec8-c3cfd8012648 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:17.858045 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739e5bb-5b38-470d-9ec8-c3cfd8012648 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:17.859946 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739e5bb-5b38-470d-9ec8-c3cfd8012648 service glance] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:17.868695 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1458/2922] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:41:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:41:18.447987 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4c5ee-9f98-4f22-9e06-d8eda9db67fc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:18.449461 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0af4c5ee-9f98-4f22-9e06-d8eda9db67fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:18.463701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:41:18.514865 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4c5ee-9f98-4f22-9e06-d8eda9db67fc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:18.519420 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc6207-6f6d-45c7-a482-65fea45e93fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:18.520043 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc6207-6f6d-45c7-a482-65fea45e93fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:18.520324 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc6207-6f6d-45c7-a482-65fea45e93fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:18.520597 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc6207-6f6d-45c7-a482-65fea45e93fb admin admin] PATH_INFO: `/v3/users/b54ef88bd60146d5adfe9bdc3b51d106` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:18.521710 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc6207-6f6d-45c7-a482-65fea45e93fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b54ef88bd60146d5adfe9bdc3b51d106)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:18.523675 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc6207-6f6d-45c7-a482-65fea45e93fb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:18.750586 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cfbc6207-6f6d-45c7-a482-65fea45e93fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b54ef88bd60146d5adfe9bdc3b51d106'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:18.762471 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cfbc6207-6f6d-45c7-a482-65fea45e93fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b54ef88bd60146d5adfe9bdc3b51d106'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:18.774537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cfbc6207-6f6d-45c7-a482-65fea45e93fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b54ef88bd60146d5adfe9bdc3b51d106'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:18.774537 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cfbc6207-6f6d-45c7-a482-65fea45e93fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b54ef88bd60146d5adfe9bdc3b51d106'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:18.868545 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cfbc6207-6f6d-45c7-a482-65fea45e93fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b54ef88bd60146d5adfe9bdc3b51d106'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:18.875508 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1465/2923] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:41:18 2022] DELETE /identity/v3/users/b54ef88bd60146d5adfe9bdc3b51d106 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:41:18.880150 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05afb6-3088-4a66-bf5b-b48fdec90f0f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:18.880600 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05afb6-3088-4a66-bf5b-b48fdec90f0f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:18.880738 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05afb6-3088-4a66-bf5b-b48fdec90f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:18.900048 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5e05afb6-3088-4a66-bf5b-b48fdec90f0f None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:41:18.901296 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5e05afb6-3088-4a66-bf5b-b48fdec90f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:18.960470 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1459/2924] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:41:18.970708 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc6207-6f6d-45c7-a482-65fea45e93fb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:18.972188 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cfbc6207-6f6d-45c7-a482-65fea45e93fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:19.029264 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc6207-6f6d-45c7-a482-65fea45e93fb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:19.033092 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d526f-6335-4892-974a-291832f07051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:19.033776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d526f-6335-4892-974a-291832f07051 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:19.034065 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d526f-6335-4892-974a-291832f07051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:19.034337 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d526f-6335-4892-974a-291832f07051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:19.043732 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d526f-6335-4892-974a-291832f07051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:19.045231 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d526f-6335-4892-974a-291832f07051 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:19.054792 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1466/2925] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:41:19.527667 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05afb6-3088-4a66-bf5b-b48fdec90f0f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:19.529661 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5e05afb6-3088-4a66-bf5b-b48fdec90f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:19.547899 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05afb6-3088-4a66-bf5b-b48fdec90f0f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:19.548961 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae84b6-7a6c-4e51-aeb6-31bacd017741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:19.549590 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae84b6-7a6c-4e51-aeb6-31bacd017741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:19.549906 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae84b6-7a6c-4e51-aeb6-31bacd017741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:19.550183 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae84b6-7a6c-4e51-aeb6-31bacd017741 admin admin] PATH_INFO: `/v3/projects/b2ba7e0b070e4dd5b0bc0956463fa417` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:19.551314 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae84b6-7a6c-4e51-aeb6-31bacd017741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2ba7e0b070e4dd5b0bc0956463fa417)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:19.553271 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae84b6-7a6c-4e51-aeb6-31bacd017741 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:19.676432 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b7ae84b6-7a6c-4e51-aeb6-31bacd017741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2ba7e0b070e4dd5b0bc0956463fa417', 'request_id': 'req-b7ae84b6-7a6c-4e51-aeb6-31bacd017741'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:19.788563 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b7ae84b6-7a6c-4e51-aeb6-31bacd017741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2ba7e0b070e4dd5b0bc0956463fa417', 'request_id': 'req-b7ae84b6-7a6c-4e51-aeb6-31bacd017741'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:19.794745 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b7ae84b6-7a6c-4e51-aeb6-31bacd017741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2ba7e0b070e4dd5b0bc0956463fa417', 'request_id': 'req-b7ae84b6-7a6c-4e51-aeb6-31bacd017741'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:19.796371 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:41:19.816300 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b7ae84b6-7a6c-4e51-aeb6-31bacd017741 admin admin] The token cache is being invalidate because project b2ba7e0b070e4dd5b0bc0956463fa417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:41:19.816612 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b7ae84b6-7a6c-4e51-aeb6-31bacd017741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:19.817262 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b7ae84b6-7a6c-4e51-aeb6-31bacd017741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:19.818751 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1460/2926] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:41:19 2022] DELETE /identity/v3/projects/b2ba7e0b070e4dd5b0bc0956463fa417 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:41:29.050669 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=73,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:41:30.005252 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:41:42.740852 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d526f-6335-4892-974a-291832f07051 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:42.742393 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7f7d526f-6335-4892-974a-291832f07051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:42.755453 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d526f-6335-4892-974a-291832f07051 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:42.811726 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be793ce2-87e7-4633-9fc3-6d0c4d036cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:42.812352 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be793ce2-87e7-4633-9fc3-6d0c4d036cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:42.812637 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be793ce2-87e7-4633-9fc3-6d0c4d036cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:42.812911 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be793ce2-87e7-4633-9fc3-6d0c4d036cd1 admin admin] PATH_INFO: `/v3/users/cf1f4ada7d8b4f5fb16e7020faa8e18e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:42.814071 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be793ce2-87e7-4633-9fc3-6d0c4d036cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1f4ada7d8b4f5fb16e7020faa8e18e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:42.815990 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be793ce2-87e7-4633-9fc3-6d0c4d036cd1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:42.984964 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-be793ce2-87e7-4633-9fc3-6d0c4d036cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1f4ada7d8b4f5fb16e7020faa8e18e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:42.996919 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-be793ce2-87e7-4633-9fc3-6d0c4d036cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1f4ada7d8b4f5fb16e7020faa8e18e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:43.004480 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-be793ce2-87e7-4633-9fc3-6d0c4d036cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1f4ada7d8b4f5fb16e7020faa8e18e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:43.005139 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-be793ce2-87e7-4633-9fc3-6d0c4d036cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1f4ada7d8b4f5fb16e7020faa8e18e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:43.061980 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-be793ce2-87e7-4633-9fc3-6d0c4d036cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1f4ada7d8b4f5fb16e7020faa8e18e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:43.068701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1467/2927] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:41:42 2022] DELETE /identity/v3/users/cf1f4ada7d8b4f5fb16e7020faa8e18e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:41:43.080683 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d0d0-ce9c-4588-b83a-316a054eb7a6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:43.081145 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d0d0-ce9c-4588-b83a-316a054eb7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:43.081266 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d0d0-ce9c-4588-b83a-316a054eb7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:43.101143 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ca85d0d0-ce9c-4588-b83a-316a054eb7a6 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:41:43.105557 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ca85d0d0-ce9c-4588-b83a-316a054eb7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:43.160572 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1461/2928] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 15:41:43.171277 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be793ce2-87e7-4633-9fc3-6d0c4d036cd1 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:43.172701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-be793ce2-87e7-4633-9fc3-6d0c4d036cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:43.232192 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be793ce2-87e7-4633-9fc3-6d0c4d036cd1 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:43.235772 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a5628-769d-4c47-8fd2-5f2976ea1788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:43.236372 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a5628-769d-4c47-8fd2-5f2976ea1788 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:43.236649 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a5628-769d-4c47-8fd2-5f2976ea1788 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:43.236918 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a5628-769d-4c47-8fd2-5f2976ea1788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:43.245929 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a5628-769d-4c47-8fd2-5f2976ea1788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:43.247358 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a5628-769d-4c47-8fd2-5f2976ea1788 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:43.257175 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1468/2929] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:41:43.681020 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85d0d0-ce9c-4588-b83a-316a054eb7a6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:43.682602 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ca85d0d0-ce9c-4588-b83a-316a054eb7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:43.695109 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85d0d0-ce9c-4588-b83a-316a054eb7a6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:43.699821 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd31337-6322-4c19-bff9-ae1283c6a75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:43.700455 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd31337-6322-4c19-bff9-ae1283c6a75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:43.700788 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd31337-6322-4c19-bff9-ae1283c6a75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:43.701034 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd31337-6322-4c19-bff9-ae1283c6a75c admin admin] PATH_INFO: `/v3/projects/f528d553ff584b12ba0ad11f6570d95c` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:43.702239 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd31337-6322-4c19-bff9-ae1283c6a75c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f528d553ff584b12ba0ad11f6570d95c)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:43.704151 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd31337-6322-4c19-bff9-ae1283c6a75c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:43.816289 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-afd31337-6322-4c19-bff9-ae1283c6a75c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f528d553ff584b12ba0ad11f6570d95c', 'request_id': 'req-afd31337-6322-4c19-bff9-ae1283c6a75c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:43.890174 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-afd31337-6322-4c19-bff9-ae1283c6a75c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f528d553ff584b12ba0ad11f6570d95c', 'request_id': 'req-afd31337-6322-4c19-bff9-ae1283c6a75c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:43.895967 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-afd31337-6322-4c19-bff9-ae1283c6a75c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f528d553ff584b12ba0ad11f6570d95c', 'request_id': 'req-afd31337-6322-4c19-bff9-ae1283c6a75c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:43.907158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-afd31337-6322-4c19-bff9-ae1283c6a75c admin admin] The token cache is being invalidate because project f528d553ff584b12ba0ad11f6570d95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:41:43.907443 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-afd31337-6322-4c19-bff9-ae1283c6a75c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:43.908897 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-afd31337-6322-4c19-bff9-ae1283c6a75c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:43.909574 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1462/2930] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:41:43 2022] DELETE /identity/v3/projects/f528d553ff584b12ba0ad11f6570d95c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:41:43.914901 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2f2f8-512e-48ab-986a-53bea4b58eb6 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:43.915377 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2f2f8-512e-48ab-986a-53bea4b58eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:43.915483 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2f2f8-512e-48ab-986a-53bea4b58eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:43.935032 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8eb2f2f8-512e-48ab-986a-53bea4b58eb6 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:41:43.936212 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8eb2f2f8-512e-48ab-986a-53bea4b58eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:43.952810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:41:43.995776 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1469/2931] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:41:44.003119 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea3556-8b0b-47ed-a482-b20066b75422 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:44.003570 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea3556-8b0b-47ed-a482-b20066b75422 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:44.003856 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea3556-8b0b-47ed-a482-b20066b75422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:44.023349 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0eea3556-8b0b-47ed-a482-b20066b75422 None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:41:44.024555 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0eea3556-8b0b-47ed-a482-b20066b75422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:44.032737 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1463/2932] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:41:44.036923 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2f2f8-512e-48ab-986a-53bea4b58eb6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:44.046786 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2f2f8-512e-48ab-986a-53bea4b58eb6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:44.051227 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d232f4-d899-4b48-a4d4-3518a339addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:44.051810 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d232f4-d899-4b48-a4d4-3518a339addb admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:44.052090 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d232f4-d899-4b48-a4d4-3518a339addb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:44.052356 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d232f4-d899-4b48-a4d4-3518a339addb admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:44.053579 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d232f4-d899-4b48-a4d4-3518a339addb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 15:41:44.053912 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d232f4-d899-4b48-a4d4-3518a339addb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:44.055500 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d232f4-d899-4b48-a4d4-3518a339addb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:44.066592 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1470/2933] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Sep 23 15:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 15:41:44.070795 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea3556-8b0b-47ed-a482-b20066b75422 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:44.079823 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea3556-8b0b-47ed-a482-b20066b75422 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:44.084425 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5ff87-1f5e-41b0-bcbc-2ab5cd98c408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:44.085000 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5ff87-1f5e-41b0-bcbc-2ab5cd98c408 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:44.085279 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5ff87-1f5e-41b0-bcbc-2ab5cd98c408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:44.085548 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5ff87-1f5e-41b0-bcbc-2ab5cd98c408 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:44.086281 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5ff87-1f5e-41b0-bcbc-2ab5cd98c408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:44.088165 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5ff87-1f5e-41b0-bcbc-2ab5cd98c408 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:44.199079 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1464/2934] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Sep 23 15:41:44 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:41:44.203125 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d232f4-d899-4b48-a4d4-3518a339addb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:44.213042 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d232f4-d899-4b48-a4d4-3518a339addb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:44.267655 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0386ba-de3c-4310-b8e4-d743e02fa809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:44.268284 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0386ba-de3c-4310-b8e4-d743e02fa809 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:44.268564 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0386ba-de3c-4310-b8e4-d743e02fa809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:44.268835 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0386ba-de3c-4310-b8e4-d743e02fa809 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:44.269458 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0386ba-de3c-4310-b8e4-d743e02fa809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:44.271425 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0386ba-de3c-4310-b8e4-d743e02fa809 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:44.375932 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1471/2935] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Sep 23 15:41:44 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 15:41:44.380170 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5ff87-1f5e-41b0-bcbc-2ab5cd98c408 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:44.390428 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5ff87-1f5e-41b0-bcbc-2ab5cd98c408 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:44.395010 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd7d36-e51b-45fd-a37d-b7d9fe2f00a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:44.395600 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd7d36-e51b-45fd-a37d-b7d9fe2f00a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:44.395877 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd7d36-e51b-45fd-a37d-b7d9fe2f00a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:44.396152 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd7d36-e51b-45fd-a37d-b7d9fe2f00a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:44.397334 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd7d36-e51b-45fd-a37d-b7d9fe2f00a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:44.398957 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd7d36-e51b-45fd-a37d-b7d9fe2f00a3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:44.408856 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1465/2936] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:41:44.413399 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0386ba-de3c-4310-b8e4-d743e02fa809 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:44.423147 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0386ba-de3c-4310-b8e4-d743e02fa809 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:44.427816 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a21580-8b7d-47f9-82bb-883bf148f6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:44.428403 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a21580-8b7d-47f9-82bb-883bf148f6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:44.428685 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a21580-8b7d-47f9-82bb-883bf148f6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:44.428960 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a21580-8b7d-47f9-82bb-883bf148f6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:44.429594 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a21580-8b7d-47f9-82bb-883bf148f6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:44.431224 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a21580-8b7d-47f9-82bb-883bf148f6a8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:44.441684 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1472/2937] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Sep 23 15:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 15:41:44.445541 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd7d36-e51b-45fd-a37d-b7d9fe2f00a3 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:44.455285 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd7d36-e51b-45fd-a37d-b7d9fe2f00a3 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:44.460354 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc107d69-a303-41b0-9c2c-a8effb36a74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:44.461013 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc107d69-a303-41b0-9c2c-a8effb36a74d admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:44.461293 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc107d69-a303-41b0-9c2c-a8effb36a74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:44.461562 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc107d69-a303-41b0-9c2c-a8effb36a74d admin admin] PATH_INFO: `/v3/projects/16018350ef7d4cbbbf6c7eea1dfb858e/users/45805c09749b4b138f6951d97d07fcc8/roles/c18fbe0604b34383a2725a382d77d618` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:44.476515 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc107d69-a303-41b0-9c2c-a8effb36a74d admin admin] RBAC: Authorizing `identity:create_grant(project_id=16018350ef7d4cbbbf6c7eea1dfb858e, user_id=45805c09749b4b138f6951d97d07fcc8, role_id=c18fbe0604b34383a2725a382d77d618)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:44.479237 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc107d69-a303-41b0-9c2c-a8effb36a74d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:44.674075 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1466/2938] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Sep 23 15:41:44 2022] PUT /identity/v3/projects/16018350ef7d4cbbbf6c7eea1dfb858e/users/45805c09749b4b138f6951d97d07fcc8/roles/c18fbe0604b34383a2725a382d77d618 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:41:44.685559 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b249339-1f48-418b-8059-5a1477855ee3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:44.685883 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b249339-1f48-418b-8059-5a1477855ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:44.686185 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b249339-1f48-418b-8059-5a1477855ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:44.714091 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6b249339-1f48-418b-8059-5a1477855ee3 None None] MFA Rules not processed for user `45805c09749b4b138f6951d97d07fcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:41:44.715274 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6b249339-1f48-418b-8059-5a1477855ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:44.777796 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1473/2939] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:41:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:41:44.789178 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc107d69-a303-41b0-9c2c-a8effb36a74d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:44.790970 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bc107d69-a303-41b0-9c2c-a8effb36a74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:44.812067 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:41:44.847452 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc107d69-a303-41b0-9c2c-a8effb36a74d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:44.851181 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b00b9-98bb-4612-9287-819f42ea5c65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bd08ee89014df281d0c0d5f8f6cabc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:44.851781 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b00b9-98bb-4612-9287-819f42ea5c65 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:44.852062 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b00b9-98bb-4612-9287-819f42ea5c65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:44.852336 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b00b9-98bb-4612-9287-819f42ea5c65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:44.860466 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b00b9-98bb-4612-9287-819f42ea5c65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:44.862102 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b00b9-98bb-4612-9287-819f42ea5c65 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:44.870774 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1467/2940] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:41:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:41:44.897353 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b249339-1f48-418b-8059-5a1477855ee3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:44.917897 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:41:44.960414 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b249339-1f48-418b-8059-5a1477855ee3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:44.966781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd4e61-da4d-4c5c-8f19-af7d2da264c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:44.966781 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd4e61-da4d-4c5c-8f19-af7d2da264c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:44.966997 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd4e61-da4d-4c5c-8f19-af7d2da264c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:44.967184 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd4e61-da4d-4c5c-8f19-af7d2da264c1 admin admin] PATH_INFO: `/v3/users/45805c09749b4b138f6951d97d07fcc8` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:44.968378 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd4e61-da4d-4c5c-8f19-af7d2da264c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45805c09749b4b138f6951d97d07fcc8)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:44.970341 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd4e61-da4d-4c5c-8f19-af7d2da264c1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:45.207639 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e4bd4e61-da4d-4c5c-8f19-af7d2da264c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45805c09749b4b138f6951d97d07fcc8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:45.219981 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e4bd4e61-da4d-4c5c-8f19-af7d2da264c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45805c09749b4b138f6951d97d07fcc8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:45.226908 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e4bd4e61-da4d-4c5c-8f19-af7d2da264c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45805c09749b4b138f6951d97d07fcc8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:45.227598 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e4bd4e61-da4d-4c5c-8f19-af7d2da264c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45805c09749b4b138f6951d97d07fcc8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:45.284541 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e4bd4e61-da4d-4c5c-8f19-af7d2da264c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45805c09749b4b138f6951d97d07fcc8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:45.290339 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1474/2941] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Sep 23 15:41:44 2022] DELETE /identity/v3/users/45805c09749b4b138f6951d97d07fcc8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:41:45.294881 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e62681-cf86-44e1-8413-c047536c654c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:45.295399 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e62681-cf86-44e1-8413-c047536c654c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:45.295514 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e62681-cf86-44e1-8413-c047536c654c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:45.314419 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f1e62681-cf86-44e1-8413-c047536c654c None None] MFA Rules not processed for user `ea51d4ae639b4d778ec8a8872aa6531d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 15:41:45.315598 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f1e62681-cf86-44e1-8413-c047536c654c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:45.372368 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1468/2942] 10.222.0.82 () {58 vars in 958 bytes} [Fri Sep 23 15:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 15:41:45.382627 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd4e61-da4d-4c5c-8f19-af7d2da264c1 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:45.384051 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e4bd4e61-da4d-4c5c-8f19-af7d2da264c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:45.439636 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd4e61-da4d-4c5c-8f19-af7d2da264c1 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:45.443173 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a023e9-82bd-458a-a4f6-b8f55a2732a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'defbff3e8f934dab9c800c7207c1d539', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:45.443774 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a023e9-82bd-458a-a4f6-b8f55a2732a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:45.444055 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a023e9-82bd-458a-a4f6-b8f55a2732a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:45.444325 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a023e9-82bd-458a-a4f6-b8f55a2732a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:45.453120 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a023e9-82bd-458a-a4f6-b8f55a2732a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:45.454582 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a023e9-82bd-458a-a4f6-b8f55a2732a1 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:45.463710 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1475/2943] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 15:41:45.904037 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e62681-cf86-44e1-8413-c047536c654c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:41:45.905491 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f1e62681-cf86-44e1-8413-c047536c654c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:41:45.919669 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e62681-cf86-44e1-8413-c047536c654c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:41:45.924409 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40417c24-fad5-47f9-90ea-ade0c94347bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea51d4ae639b4d778ec8a8872aa6531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9413a28bc00744258077edf9f566b1b7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:41:45.925051 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40417c24-fad5-47f9-90ea-ade0c94347bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:41:45.925328 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40417c24-fad5-47f9-90ea-ade0c94347bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:41:45.925605 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40417c24-fad5-47f9-90ea-ade0c94347bc admin admin] PATH_INFO: `/v3/projects/16018350ef7d4cbbbf6c7eea1dfb858e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:41:45.927158 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40417c24-fad5-47f9-90ea-ade0c94347bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=16018350ef7d4cbbbf6c7eea1dfb858e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:41:45.929122 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40417c24-fad5-47f9-90ea-ade0c94347bc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:41:46.079632 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-40417c24-fad5-47f9-90ea-ade0c94347bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16018350ef7d4cbbbf6c7eea1dfb858e', 'request_id': 'req-40417c24-fad5-47f9-90ea-ade0c94347bc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:46.319418 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-40417c24-fad5-47f9-90ea-ade0c94347bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16018350ef7d4cbbbf6c7eea1dfb858e', 'request_id': 'req-40417c24-fad5-47f9-90ea-ade0c94347bc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:46.325357 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-40417c24-fad5-47f9-90ea-ade0c94347bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16018350ef7d4cbbbf6c7eea1dfb858e', 'request_id': 'req-40417c24-fad5-47f9-90ea-ade0c94347bc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:46.337030 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-40417c24-fad5-47f9-90ea-ade0c94347bc admin admin] The token cache is being invalidate because project 16018350ef7d4cbbbf6c7eea1dfb858e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 15:41:46.337260 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-40417c24-fad5-47f9-90ea-ade0c94347bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:46.337907 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-40417c24-fad5-47f9-90ea-ade0c94347bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 15:41:46.339401 dv-cinder-855013-3-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1469/2944] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Sep 23 15:41:45 2022] DELETE /identity/v3/projects/16018350ef7d4cbbbf6c7eea1dfb858e => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 15:41:55.459665 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:41:56.333364 dv-cinder-855013-3-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 15:46:14.924274 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a023e9-82bd-458a-a4f6-b8f55a2732a1 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 15:46:14.925684 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-86a023e9-82bd-458a-a4f6-b8f55a2732a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:46:14.994945 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a023e9-82bd-458a-a4f6-b8f55a2732a1 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 15:46:15.053478 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb06fdd-3aa7-49d2-8fcc-056253ce08ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25109eeb1b34b3689b10e3f7c44a6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '718a472b7d564c429849b127a44aaaad', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 15:46:15.054123 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb06fdd-3aa7-49d2-8fcc-056253ce08ef service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 15:46:15.054427 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb06fdd-3aa7-49d2-8fcc-056253ce08ef service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 15:46:15.054701 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb06fdd-3aa7-49d2-8fcc-056253ce08ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 15:46:15.056428 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4bb06fdd-3aa7-49d2-8fcc-056253ce08ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 15:46:15.068140 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb06fdd-3aa7-49d2-8fcc-056253ce08ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 15:46:15.070100 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb06fdd-3aa7-49d2-8fcc-056253ce08ef service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 15:46:15.079857 dv-cinder-855013-3-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1476/2945] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Sep 23 15:46:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 15:46:25.075696 dv-cinder-855013-3-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=58 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}